robots.txt details

845ded2a3a07de842ba65e0b9f5a0493

saved: | size: 664kb | checksum: 845ded2a3a07de842ba65e0b9f5a0493

websites using this robots.txt

content


User-agent: AhrefsBot
Disallow: /

User-agent: coccocbot-web
Disallow: /

User-agent: coccocbot-image
Disallow: /

User-agent: MauiBot
Disallow:/

User-agent: sogouspider
Disallow:/

User-agent: Sogou web spider
Disallow:/

User-agent: Baiduspider
Disallow: /

User-agent: Baiduspider-video
Disallow: /

User-agent: Baiduspider-image
Disallow: /

User-agent: BLEXBot
Disallow: /

User-agent: Yandex
Disallow: /

User-agent: YandexBot
Disallow: /

User-agent: dotbot
Disallow: /

User-agent: AspiegelBot
Disallow: /

User-agent: *
Disallow: /*_escaped_fragment_
Disallow: /api/*
Disallow: /image-server/*

Sitemap: https://shop.spreadshirt.de/shopfiles/sitemap.xml