# Sample robots.txt file 1 from http://www.almaden.ibm.com/cs/crawler/ User-agent: * Disallow: /contest/ Disallow: /accounts/