robots.txt details

saved: size: 687 kb md5 checksum: d1e00b80f033f9c6f1de6b992c31fb47

websites using this robots.txt

content


User-Agent:*
Disallow: /suchen/
Disallow: /blogvision/
Disallow: /*?*iframe*
Disallow: /ws/AcVisiondata.ashx?*
Disallow: /ws/AcVisiondataV4.ashx?*
Disallow: /ws/ProfilLightGetModerationLink.ashx?*
Disallow: /ws/geocoding.ashx
Disallow: /ws_v7/geocoding.ashx
Disallow: /ws/WinnerListHandler.ashx
Disallow: /ws/PostRollTrailer.ashx?*
Disallow: /ws/partnerproxy.ashx?*
Disallow: /ws_v7/Disqus.asmx/
Disallow: /ws_v7/get_complete_photos_list.ashx?*
Disallow: /120157152/
Disallow: /doubleclick/
Disallow: /_/
Disallow: /_video/partner/
Disallow: /third-parties/

User-Agent: seekbot
Disallow: /

User-Agent: Exabot
Disallow: /

User-agent: Slurp
Disallow: /

User-agent: Cliqzbot
Disallow: /