robots.txt details

saved: size: 503 kb md5 checksum: 0aecfe957331fef5126f1d71d2032cb9

websites using this robots.txt

content


User-agent: *
Disallow: *_10_*
User-agent: ia_archiver
User-agent: BacklinkCrawler
User-agent: bdbrandprotect
User-agent: BPImageWalker
User-agent: Ezooms
User-agent: findlinks
User-agent: Gigabot
User-agent: HTTrack
User-agent: HTTrack 3.0
User-agent: LinkWalker
User-agent: Net Vampire
User-agent: Python-urllib
User-agent: rogerbot
User-agent: Sogou web spider
User-agent: Sosospider
User-agent: spbot
User-agent: Updownerbot
User-agent: semalt.com
User-agent: 008
User-agent: wikiwix-bot
Disallow: /