User-agent: * Disallow: /divya-testing Disallow: /tour Disallow: /stage Disallow: /one-hundred-edition-nine Disallow: /web-briefing-three Disallow: /email-sign-ups Disallow: /web-briefing Disallow: /one-hundred-edition-ten Disallow: /editorial-board Disallow: /one-hundred-edition-eleven Disallow: /simon-testing Disallow: /simon-test-page Disallow: /test-one-hundred-container-ports-2022 Disallow: /one-hundred-container-ports-2019/data Disallow: /templates/two Disallow: /templates/one Disallow: /one-hundred-container-ports-2018/data Disallow: /test-one-hundred-edition-thirteen User-agent: MJ12bot Disallow: / User-agent: * Disallow:/rss/ User-agent: * Disallow:/data-tools/ User-agent: * Crawl-delay: 1 User-agent: Twitterbot Disallow: