robots.txt details

saved: size: 396 kb md5 checksum: ff57dcb580e9ab0ebe86e69573da5d4e

websites using this robots.txt

content


Host: www.flagman.kiev.ua
Sitemap: https://www.flagman.kiev.ua/sitemap/www.xml.gz


User-agent: *
Disallow: /search/
Disallow: /checkout/
Disallow: /*sort=*
Disallow: */tab=*
Disallow: /signin/
Disallow: /ua
User-agent: psbot
Disallow: / 

User-agent: Slurp
Disallow: /

User-agent: Baiduspider
Disallow: /

User-Agent: bingbot
User-agent: msnbot
User-agent: MJ12bot
Disallow: /*=*
Crawl-delay: 3