robots.txt viewer

startpage statistics robots.txt history changelog login

www.forever21.com @ 2018-12-05 19:39:05


website: http://www.forever21.com
robots.txt: www.forever21.com/robots.txt

Link this file: https://www.robots-viewer.com/domain/www.forever21.com/1517824830

/robots.txt (496B)

# robots.txt 05/06/18
User-agent:*
Disallow: */core/
Disallow: */Account/
Disallow: */account/
Disallow: */CheckOut/
Disallow: */Checkout/
Disallow: */checkout/
Disallow: */search/
Disallow: */Search/
Disallow: */login/
Disallow: */Login/
Noindex: */Account/
Noindex: */account/
Noindex: */CheckOut/
Noindex: */Checkout/
Noindex: */checkout/
Noindex: */search/
Noindex: */Search/
Noindex: */login/
Noindex: */Login/

 

Sitemap: https://www.forever21.com/sitemap_index.xml