User-agent: * Crawl-delay: 5 Disallow: /admin/ Disallow: /ServiceInterface/ Disallow: /data/ Allow: /data/mediadb/ User-agent: TurnitinBot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: SimplePie Disallow: / User-agent: Speedy Disallow: / User-agent: jobs.de-Robot Disallow: / Sitemap: https://www.nrw-tourismus.de/portal/frontend/sitemaps/de.xml Sitemap: https://www.nrw-tourism.com/portal/frontend/sitemaps/en.xml Sitemap: https://www.nrw-vakantie.nl/portal/frontend/sitemaps/nl.xml