robots.txt details

6d79bc715f989d1c59af89feec7c6f59

saved: | size: 1249kb | checksum: 6d79bc715f989d1c59af89feec7c6f59

websites using this robots.txt

content

User-agent: *
Sitemap: http://www.nrk.no/sitemap.xml
Disallow: /testmappe/
Disallow: /_/
Disallow: /pyro/
Disallow: /programmer/radio/filmpolitiet/
Disallow: /p3/article/
Disallow: /p3/program/
Disallow: /p3tv/
Disallow: /Urort/search/Browse.aspx
Disallow: /urort/user/video.aspx
Disallow: /urort/WebResource.axd
Disallow: /urort/ScriptResource.axd
Disallow: /Urort/WebResource.axd
Disallow: /Urort/ScriptResource.axd
Disallow: /front/?pp-content-id=2.6642
Disallow: */wp-admin/
Disallow: */wp-includes/
Disallow: */wp-content/plugins/
Disallow: */wp-content/cache/
Disallow: */wp-content/themes/
Disallow: */trackback/
Disallow: */feed/
Disallow: */comments/
Disallow: */category/*/*
Disallow: */trackback/
Disallow: */feed/
Disallow: */comments/
Disallow: /buskerud/krf-politiker-utvist-for-eksamensjuks-1.289425
Disallow: /mr/xl/--er-glad-for-at-eg-fann-familien-min-1.12890966
Disallow: /video/PS*56957
Disallow: /nordland/mitt-liv-som-bipolar-1.11402353
Disallow: /nordland/--mange-som-kan-takke-ellen-olga-1.11405185
Disallow: /hordaland/demokratane-1.197875
Disallow: /ostlandssendingen/_-han-har-reddet-livet-mitt-1.11226102

User-agent: AppleNewsBot
Disallow: /satiriks/

User-agent: Googlebot-News
Disallow: /satiriks/

# Served by akamai