robots.txt details

saved: size: 876 kb md5 checksum: 0636bd80121982c4d7e918782b8dbc13

websites using this robots.txt

content


User-agent: AhrefsBot
User-agent: Amazonbot
User-agent: Baiduspider
User-agent: BLEXBot
User-agent: GrapeshotCrawler
User-agent: Linguee Bot
User-agent: MJ12bot
User-agent: PetalBot
User-agent: Seekport
User-agent: Seekport Crawler
User-agent: SemrushBot
User-agent: SeznamBot
User-agent: Yandex
User-agent: YandexBot
User-agent: YandexImages
User-agent: Optimizer
Disallow: /

User-agent: *
Disallow: /cvs
Disallow: /download
Disallow: /fehlerseiten
Disallow: /logarchiv
Disallow: /logs
Disallow: /main/additional_files
Disallow: /main/ai-cache
Disallow: /main/cache
Disallow: /main/config
Disallow: /main/download
Disallow: /main/tmp
Disallow: /main/transfer
Disallow: /main/webman
Disallow: /node_modules
Disallow: /tmp
Disallow: /transfer
Disallow: /webman
Allow: /main/config/includes/templates

Disallow: /main/mitgliederausweise
Disallow: /main/ebay
Disallow: /main/pub