# Allow google full access to the site User-agent: googlebot Disallow: /CVS Disallow: /archive/ # Other bots shouldn't crawl the archive User-agent: * Disallow: /CVS Disallow: /archive/