robots.txt viewer

www.cs.purdue.edu @ 2018-12-05 10:32:24


website: https://www.cs.purdue.edu
robots.txt: www.cs.purdue.edu/robots.txt

/robots.txt (658B)

User-agent: *
Disallow: /homes/spaf/Yucks/
Disallow: /homes/fultz
Disallow: /help
Disallow: /calendar
Disallow: /success/QA
Disallow: /academic_programs/courses/schedule/2002
Disallow: /academic_programs/courses/schedule/2003
Disallow: /academic_programs/courses/schedule/2004
Disallow: /academic_programs/courses/catalog/2002
Disallow: /academic_programs/courses/catalog/2003
Disallow: /academic_programs/courses/catalog/2004
Disallow: /academic_programs/courses/schedule/2005/Spring
Disallow: /academic_programs/courses/schedule/2005/Summer
Disallow: /academic_programs/courses/catalog/2005/Spring
Disallow: /academic_programs/courses/catalog/2005/Summer