User-agent: baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: Slurp Disallow: / User-agent: twiceler Disallow: / User-agent: stackrambler Disallow: / User-agent:* Disallow: /admin/ Disallow: /ajax/ Disallow: /application/ Disallow: /calendar/ Disallow: /class/ Disallow: /import/ Disallow: /inc/ Disallow: /lib/ Disallow: /log/ Disallow: /templates/ Allow: /lib/min/ Allow: /lib/jquery/