User-agent: Slurp
Crawl-delay: 20

User-agent: msnbot
Crawl-delay: 20

User-agent: baiduspider
Crawl-delay: 30

User-agent: RPT-HTTPClient/0.3-3E
Disallow: /