robots.txt details

9d03cba4368cfe7db96190a21ec7a11e

saved: | size: 71kb | checksum: 9d03cba4368cfe7db96190a21ec7a11e

websites using this robots.txt

content


User-agent: *
Request-rate: 1/20
Crawl-delay: 20
Visit-time: 0700-1300