#==================== # NO ACCESS BOT LIST #==================== # NO access (e-collector) User-agent: ecollector User-agent: GenCrawler User-agent: Internet Cruiser Robot User-agent: jcrawler User-agent: Zeus User-agent: TurnitinBot User-agent: T-H-U-N-D-E-R-S-T-O-N-E User-agent: LinkWalker User-agent: polybot User-agent: LinkAlarm User-agent: Googlebot-Image Disallow: / #===================== # FULL ACCESS BOT LIST #===================== # FULL access Bot User-agent: Googlebot User-agent: Googlebot-Mobile User-agent: Mediapartners-Google Disallow: /admin/ Disallow: /ats/ Disallow: /aspnet_client/ Disallow: /anonymous/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /_private/ # ALL BOTS Disallow: /admin/ Disallow: /ats/ Disallow: /aspnet_client/ Disallow: /anonymous/ Disallow: /cgi-bin/ Disallow: /database/ Disallow: /images/ Disallow: /_private/