robots.txt details

saved: size: 336 kb md5 checksum: fa9b01a913336c7d912ada36c3a38697

websites using this robots.txt

content


User-agent: *
Disallow: /zf/code/
Disallow: /zf/misc/
Allow: /
Crawl-delay: 2

User-agent: MJ12bot
Disallow: /

User-agent: AlphaSeoBot
Disallow: /

User-agent: AlphaSeoBot-SA
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: Yandex
Crawl-delay: 4

Sitemap: https://www.saltandpineclient.com/sitemap.xml