User-Agent: * Allow: / Disallow: *_Incapsula_Resource* Disallow: */search/?q=* Disallow: */quick-registration/?returnPath=* Disallow: *onlc=* Disallow: *ocrs=* Disallow: *station=* Disallow: */my-account/* Disallow: */sign-out/ User-Agent: MJ12Bot Crawl-delay: 20 Sitemap: https://www.lner.co.uk/sitemap.xml #Disallow: */live-train-times/depart/* #Disallow: */live-train-times/arrive/*