# /robots.txt file User-agent: Twitterbot Disallow: /search/ User-agent: Googlebot Disallow: /search/ User-agent: MSNBot Disallow: /search/ User-agent: Lycos_Spider_(T-Rex) Disallow: /search/ User-agent: KIT-Fireball Disallow: /search/ User-agent: Scooter Disallow: /search/ User-agent: Teoma Disallow: /search/ User-agent: htdig Disallow: /search/ User-agent: gsa-crawler-zoa Disallow: /search/ User-agent: SAP-KM/WebRepository 1.2 Disallow: /search/ User-agent: fast Disallow: /search/ # --- yahoo --- User-agent: Slurp Disallow: /search/ User-agent: Baiduspider Disallow: /search/ User-agent: 360Spider Disallow: /search/ User-agent: Sougou+web+spider Disallow: /search/ User-agent: * Disallow: / Sitemap: https://www.basf.com/en/sitemap.xml Sitemap: https://www.basf.com/de/sitemap.xml Sitemap: https://www.basf.com/pt/sitemap.xml Sitemap: https://www.basf.com/zh/sitemap.xml Sitemap: https://www.basf.com/tr/tr/sitemap.xml Sitemap: https://www.basf.com/tr/en/sitemap.xml Sitemap: https://www.basf.com/es/es/sitemap.xml Sitemap: https://www.basf.com/us/en/sitemap.xml Sitemap: https://www.basf.com/cn/zh/sitemap.xml Sitemap: https://www.basf.com/cn/en/sitemap.xml Sitemap: https://www.basf.com/tw/zh/sitemap.xml Sitemap: https://www.basf.com/tw/en/sitemap.xml