User-agent: * Disallow Crawl-delay 5 Disallow /cgi-bin/ Disallow /database/ Disallow /aspnet_client/ Disallow /work/