# Spider exclusion list instructions User-Agent: * Disallow: .htaccess Disallow: /cgi-bin/ Disallow: /css/ Disallow: /development/ Disallow: /downloads/ Disallow: /errors/ Disallow: favicon.ico Disallow: /FTP_Designforge/ Disallow: /FTP_Sharedfolder/ Disallow: /GeneratedItems/ Disallow: google24eb04c7411ef351.html Disallow: /images/ Disallow: /javascript/ Disallow: /pages/forms/ Disallow: /phpincludes/ Disallow: robots.txt Disallow: /sitemap/ Disallow: sitemap.xml Disallow: /under_construction/ Disallow: y_key_1acff0e208d3ab78.html