robots.txt details

79e74e8f7f2945fc14d1a54c8024c0a5

saved: | size: 425kb | checksum: 79e74e8f7f2945fc14d1a54c8024c0a5

websites using this robots.txt

content


User-agent: *
Disallow: /search.html
Disallow: /check/
Disallow: /files/
Disallow: /assets/
Disallow: /contao/
Disallow: /system/
Disallow: /templates/
Disallow: /vendor/
Disallow: /share/index.php
Disallow: /build.xml
Disallow: /composer.json
Disallow: /composer.lock
Disallow: /README.md
Allow: /system/cron/cron.txt
Allow: /system/modules/*/assets/
Allow: /system/modules/*/html/

Sitemap: https://www.varea.de/sitemap.xml