robots.txt details

saved: size: 628 kb md5 checksum: f7bdf3107376362097651ff86b7fb1b7

websites using this robots.txt

content


User-agent: *
Disallow: /wp-admin
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: */embed
Disallow: */feed
Disallow: /feed
Disallow: /cgi-bin
Disallow: *?s=
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /*author

Allow: /wp-includes/css/
Allow: /wp-includes/js/
Allow: /wp-includes/images/
Allow: /wp-content/*.css
Allow: /wp-content/*.js
Allow: /wp-content/*.png
Allow: /wp-content/*.jpg
Allow: /wp-content/*.jpeg
Allow: /wp-content/*.gif
Allow: /wp-content/*.svg
Allow: /wp-admin/admin-ajax.php

Host: https://bookwormlab.com
Sitemap: https://bookwormlab.com/sitemap_index.xml