# Robots.txt file from http://www.313g.com # All robots will spider the domain User-agent: * Disallow: /313g/ Disallow: /AD/ Disallow: /2009/ Disallow: *.asp$ Disallow: *.js$ Disallow: *.css$