robots.txt details

849b3bd0875d8cdbf1c5695d93214d19

saved: | size: 166kb | checksum: 849b3bd0875d8cdbf1c5695d93214d19

websites using this robots.txt

content


User-agent: *
Disallow: /fm/
Disallow: /_g/
Disallow: /cgi-bin/
Disallow: /php/
Disallow: /api/
Disallow: /six_external/
Disallow: /downloads/
Crawl-delay: 10