robots.txt viewer

www.bti.de @ 2018-12-06 14:17:07


website: https://www.bti.de
robots.txt: www.bti.de/robots.txt

/robots.txt (197B)

User-agent: *
Disallow: /*?*q=*
Disallow: /*.pdf$
Disallow: /*search*text=*
Disallow: /de/download.php
Sitemap: https://www.bti.de/shop-de/sitemap.xml
Sitemap: https://www.bti.de/bti.de-sitemap.xml