User-agent: HTTrack User-agent: MSIECrawler Disallow: / User-agent: * Disallow: /littlescripts/ Disallow: /track.php Disallow: /*.js$ Disallow: /*.css$ Disallow: /*.asp$