# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead. # Please see https://developer.wordpress.com/docs/firehose/ for more details. Sitemap: https://yuji.wordpress.com/sitemap.xml Sitemap: https://yuji.wordpress.com/news-sitemap.xml User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php Disallow: /activate/ # har har Disallow: /cgi-bin/ # MT refugees Disallow: /mshots/v1/ Disallow: /next/ Disallow: /public.api/ User-agent: IRLbot Crawl-delay: 3600 # This file was generated on Thu, 19 Oct 2017 08:20:38 +0000