Sitemap: https://www.freenetmobile.de/sitemap.xml Sitemap: https://www.freenetmobile.de/shop/sitemap.xml User-agent: * Disallow: /error/ Disallow: /wartung/ Disallow: /templates/ Request-rate: 1/5 # maximum rate is one page every 5 seconds Crawl-delay: 5 # 5 seconds between page requests Visit-time: 0000-0600 # only visit between 00:00 and 06:00 UTC Disallow: /shop/cart/ Disallow: /shop/checkout/ Disallow: /shop/my-account/ Disallow: /shop/personal-data/ Disallow: /shop/compare/ Disallow: /shop/rest/ Disallow: /shop/ws410/ Disallow: /shop/*?q=* Disallow: /shop/*?*&q=* Disallow: /shop/*?sort=* Disallow: /shop/*?*&sort=* Disallow: /shop/*?text=* Disallow: /shop/*?*&text=*