User-agent: * Disallow: /cgi Disallow: /cgi-bin Disallow: /css Disallow: /sandtrap Disallow: /ban-ip