robots.txt details

saved: size: 625 kb md5 checksum: de487f87b936d5ea0b16127f804e9f67

websites using this robots.txt

content


User-Agent: *

Disallow: /cgi-bin
Disallow: /search/
Disallow: /*sort=*
Disallow: /*utm_medium=rooms*
Disallow: /*promotions/top_section*
Disallow: /*tab=*
Disallow: /*gclid=*
Disallow: /*yclid=*
Disallow: /*/delivery/
Disallow: /*utm_trafmaguid=*
Disallow: /comparison/
Disallow: /*/comparison/
Disallow: /landing_pages/*
Disallow: /*kits_costs*
Disallow: /landing-pages/*
Disallow: /lazy_load/*
Disallow: /*/recent.rss
Disallow: /ua/
Disallow: /*?*

User-agent: Yahoo
Disallow: /

User-agent: MJ12bot
Disallow: /

User-agent: Mediapartners-Google
Disallow: /

User-agent: AhrefsBot
Disallow: /

Host: https://rozetka.com.ua