# For domain: http://www.futureofcigs.com # All robots will spider the domain User-agent: * Disallow: # Disallow directory /cgi-bin/ User-agent: * Disallow: /cgi-bin/ Disallow: /_vti_log/ Disallow: /_vti_txt/ Disallow: /_vti_pvt/ Disallow: /_vti_cnf/ Disallow: /_vti_bin/ Disallow: /_private/ Disallow: /etc/ Disallow: /logs/