User-agent: * # dyanmic article detail pages Disallow: /*/p/* # customer profile Disallow: /*/account Disallow: /*/account/* # api Disallow: /api/* # bots User-agent: MJ12bot Disallow: / User-agent: omgilibot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: WeSEE Disallow: / User-agent: Python-urllib Disallow: / User-agent: uMBot-FC Disallow: / User-agent: DotBot Disallow: / User-agent: Riddler Disallow: / User-agent: magpie-crawler Disallow: / User-agent: gimme60bot Disallow: / User-agent: linkdexbot Disallow: / User-agent: BLEXBot Disallow: / Sitemap: https://www.deindesign.de/sitemaps/sitemap_index.xml