User-agent: * Disallow: /_old # old html pages to be removed Disallow: /logs # ASP log files