User-Agent: * Disallow: /*.html Disallow: /*.asp$ Allow: /