robots.txt details

saved: size: 788 kb md5 checksum: 6adfce95a7bfff7caed764b5c096ccbc

websites using this robots.txt

content


User-agent: sogou spider
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: shopstyle bot/1.0
Disallow: /

User-agent: python-grcrawler
Disallow: /

User-agent: Mail.Ru
Disallow: /

User-agent: SEOkicks-Robot
Disallow: /

User-agent: Axis/1.4
Disallow: /

User-agent: proximic
Disallow: /

User-agent: grapeshot
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: Wget
Disallow: /

User-agent: AhrefsBot
Disallow: /

User-agent: *
Disallow: /mein-konto
Disallow: /kasse/
Disallow: /suche-keinergebnis*
Disallow: */OrderProcess-Basket
Disallow: */minibaskets/*
Disallow: /s$
Disallow: /maintenance

https://app.bllush.com/universal/stories-site-map