User-Agent:*# Disallow all crawlers access to certain pages. Disallow:/_private Disallow:/_vti_log Disallow:/App_Data Disallow:/blog Disallow:/aspnet_client Disallow:/import Disallow:/import Disallow:/test Allow: /