robots.txt details

42b43e5bcc5db8ac9c1f19b12bf5aa89

saved: | size: 97kb | checksum: 42b43e5bcc5db8ac9c1f19b12bf5aa89

websites using this robots.txt

content


User-agent: AhrefsBot
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: *
Crawl-delay: 10