User-agent: * Disallow: /search/ Disallow: /changebrowser Disallow: /thirdpartyservice Disallow: /*/thirdpartyservice Disallow: /config/ Disallow: /*/config Disallow: /dzcfg Disallow: /*/dzcfg Disallow: /*/test-template Disallow: /*.json Disallow: /test/ Disallow: /topic/*? Disallow: /deeplinkid/ Disallow: /searchsuggest Disallow: /*/searchsuggest Disallow: /svgimageproc Disallow: /hive/ User-agent: Googlebot-News Disallow: /*-ugc-*.html Disallow: /about/ Disallow: /cbp-*.html Disallow: /*/cbp-*.html Disallow: /bp/* Disallow: /*-adstory.html Disallow: /*sns-ap Disallow: /*photogallery Disallow: /brandpublishing/ Disallow: /*/brandpublishing/ Disallow: /shopping/ Disallow: /*/shopping/ Disallow: /paid-posts/ Disallow: /*/paid-posts/ User-agent: Twitterbot Allow: / User-agent: Mediapartners-Google Allow: / User-agent: discobot Disallow: / User-agent: CCBot Crawl-Delay: 2 User-agent: Nutch Crawl-Delay: 2 Sitemap: http://www.latimes.com/sitemap.xml