# # robots.txt # http://info.webcrawler.com/mak/projects/robots/robots.html # User-agent: ??? Disallow: User-agent: Due to a deficiency in Java it's not currently possible to set the User-agent. Disallow: User-agent: no Disallow: User-agent: none Disallow: User-agent: not available Disallow: User-agent: yes Disallow: User-agent: * Disallow: /at-home/ Disallow: /atf/ Disallow: /cgi-bin/ Disallow: /eknow/ Disallow: /files/ Disallow: /logs/ Disallow: /motorcycles/ Disallow: /rh-updates/ Disallow: /rpms/ Disallow: /private/ Disallow: /school/ Disallow: /servlets/ Disallow: /stats/voice/ Disallow: /~mharrell/ Disallow: /~gmiller/