# Apply/Use the robots.txt to keep web crawlers, spiders and robots from indexing certain sections of my site # March 12, 2006-Marc J # Put the file at the top level of the web page directory hierarchy, same place as index.html # # prevent my images from being indexed by Google User-agent: Googlebot-Image Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /images2/ Disallow: /error/ Disallow: /logs/