robots.txt details

b80a908414a6d43cbba68f28edee1a1a

saved: | size: 378kb | checksum: b80a908414a6d43cbba68f28edee1a1a

websites using this robots.txt

content


User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

User-agent: *
Disallow: /discuss/xtra/
Disallow: /misc/
Disallow: /search/
Disallow: /misc/sponsored-articles/

User-agent: Googlebot-News
Disallow: /galleries/
Disallow: /jobs/
Disallow: /noticeboard/
Disallow: /property/
Disallow: /misc/sponsored-articles/

Sitemap: https://www.thelocal.se/sitemap/index.xml