# robots.txt for http://www.calvin.edu # Created 03-02-1996 by KRV # Last modified 08-27-2003 by JDG (just to give me credit for doing something). # Last mofidied 02-12-2007 by mjeltema # This should keep those crawlers and spiders out of cgi and datatel User-agent: * Disallow: /cgi-bin/ Disallow: /archive/ #Disallow: /test/ #Disallow: /stats/ # And bail on anything personal #Disallow: /~