# Author: David Zwack # Create Date: 3/12/2007 # Name: robots.txt # Description: This file provides direction for Internet spiders on https://wdcrobcolp01.ed.gov/CFAPPS/RSA/ # History: # $Log: robots.txt,v $ # Revision 1.2 2008/02/05 18:42:46 dzwack # Start Mockup # # Revision 1.1 2007/03/12 17:40:41 dzwack # *** empty log message *** # # User-agent: * Disallow: /components Disallow: /DATAR Disallow: /includes Disallow: /scheduled-tasks Disallow: /styles # prevents some email harvesting User-agent: EmailSiphon Disallow: /