robots.txt details

saved: size: 715 kb md5 checksum: 24baa67ae6a9da466b9ab8608cdace4d

websites using this robots.txt

content


User-agent: *
Allow: */markets/*css
Allow: */markets/*js
Allow: */imagesandvideo/
Disallow: */markets/
Disallow: /na/error
Disallow: /us/search
Disallow: /ca/search
Disallow: /na/search
Disallow: /NoRobots 
Disallow: /*/sitecore
Disallow: /*/sitecore modules
Disallow: /*/search
Disallow: /*/error
Disallow: /*/search-results-page
Disallow: /*/test-pages
Disallow: /en-gb/search-results/
Disallow: /en-us/search-results/
Disallow: /en-ie/search-results/
Disallow: /fr-fr/search-results/
Disallow: /de-de/search-results/
Disallow: /es-es/resultados-de-búsqueda/
Disallow: *?year=*
Disallow: *?month=*
Disallow: *&year=*
Disallow: *&month=*
Disallow: /en-ie/
User-agent: BUbiNG
Disallow: /