robots.txt details

425875319138f3c0668570c0eb73b08c

saved: | size: 381kb | checksum: 425875319138f3c0668570c0eb73b08c

websites using this robots.txt

content


User-agent: *
Disallow: /

User-Agent: Googlebot
Crawl-Delay: 20
Disallow:

User-agent: Googlebot-Image
Crawl-Delay: 20
Disallow:

User-agent: Mediapartners-Google
Crawl-Delay: 20
Disallow:

User-Agent: Adsbot-Google
Crawl-Delay: 20
Disallow:

User-agent: msnbot
Crawl-Delay: 20
Disallow:

User-agent: bingbot
Crawl-Delay: 20
Disallow:

User-agent: slurp
Crawl-Delay: 20
Disallow: