robots.txt details

c354a1fdacb75c68357421bbdfcec0d1

saved: | size: 207kb | checksum: c354a1fdacb75c68357421bbdfcec0d1

websites using this robots.txt

content


User-agent: *
Crawl-delay: 10
Allow: /

User-agent: Eluta.ca
Crawl-delay: 60
Allow: /

User-agent: MS Search 6.0 Robot
Crawl-delay: 60
Allow: /

User-agent: gsa-crawler
Crawl-delay: 60
Allow: /