robots.txt details

saved: size: 659 kb md5 checksum: 87c783349885054cdf81bd12577f48d3

websites using this robots.txt

content


User-Agent: *

Disallow: /cgi-bin
Disallow: /search/
Disallow: /*sort=*
Disallow: /*utm_medium=rooms*
Disallow: /*promotions/top_section*
Disallow: /*tab=*
Disallow: /*gclid=*
Disallow: /*yclid=*
Disallow: /*/delivery/
Disallow: /*utm_trafmaguid=*
Disallow: /comparison/
Disallow: /*/comparison/
Disallow: /landing_pages/*
Disallow: /*kits_costs*
Disallow: /landing-pages/*
Disallow: /lazy_load/*
Disallow: /*/recent.rss
Disallow: /ua/
Allow: /recent_recommends/action=getGoodsDetailsJSON/?goods_ids
Disallow: /*?*

User-agent: Yahoo
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: Mediapartners-Google
Disallow: /

User-agent: AhrefsBot
Disallow: /