# File created and uploaded 2010/02/20 after reviewing # the file: /var/log/httpd/error_log # Match all bots User-agent: * # To allow all directories/files use this: # Allow: / # No need to scan the old website files. Disallow: /var/www/html/about/sitemapObsolete Disallow: /var/www/html/calendar/obsolete Disallow: /var/www/html/oldsite Disallow: /var/www/html/usage