robots.txt details

saved: size: 424 kb md5 checksum: eb41f47fd6b976ad1846234b1cb2f82e

websites using this robots.txt

content


User-agent: *
Disallow: /my/
Crawl-delay: 3
Sitemap: https://tortodeloff.ru/sitemap.2903780.xml.gz

User-Agent: Yandex
Allow: /
Disallow: /my/
Crawl-delay: 3
Host: https://tortodeloff.ru
Sitemap: https://tortodeloff.ru/sitemap.2903780.xml.gz

User-agent: msnbot
Crawl-delay: 10

User-agent: MJ12bot
Crawl-delay: 20

User-agent: AhrefsBot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: SemrushBot-SA
Disallow: /