robots.txt details

saved: size: 933 kb md5 checksum: 41ac2596e5f01542729b5878eb5a0c76

websites using this robots.txt

content


User-agent: *
Disallow: /announcement/management
Disallow: /browser-support.html
Disallow: /comment/activate.html
Disallow: /comment/update.html
Disallow: /company/financial.html
Disallow: /competence/import
Disallow: /competence/management
Disallow: /course/management
Disallow: /error
Disallow: /frame
Disallow: /job/import
Disallow: /job/management
Disallow: /log-out.html
Disallow: /machine/import
Disallow: /machine/management
Allow: /newsletter/
Disallow: /newsletter
Disallow: /newsletter/subscriber/update.html
Disallow: /newsletter/confirmSubscribe.html
Disallow: /newsletter/confirmUnsubscribe.html
Disallow: /newsletter/view.html
Disallow: /product/import
Disallow: /product/management
Disallow: /supplement/management
Disallow: /trckr
Disallow: /user/management
Disallow: /xml/schemes
Disallow: /js/notbot.js
Disallow: /void/

User-agent: Meltwater
Disallow: /
User-agent: MeltwaterNews
Disallow: /

Sitemap: /sitemap.xml