# robots.txt for http://www.inference.phy.cam.ac.uk # welcome, come on in! # reason for disallowing stats: we don't want search engines # to discover URLS which aren't linked to anywhere but people have # nonetheless accessed (e.g. http://coll.ra.phy.cam.ac.uk URLS) User-agent: * Disallow: /wwwwais/ Disallow: /stats/ Disallow: /coll-stats/ Disallow: /wol-stats/ Disallow: /mackay/codes/EN/ Disallow: /djw30/dasher/files/ Disallow: /dasher/download/training/ Disallow: /dasher/download/english/ Disallow: /dasher/download/win_9x/ Disallow: /dasher/download/win_nt/ Disallow: /dasher/download/solaris/ Disallow: /stats.html Disallow: /cgi-bin/ Disallow: /dasher/download/portuguese/ Disallow: /dasher/download/dutch/ Disallow: /iaj21/Docs/ Disallow: /mackay/secret/