User-agent: *
Disallow: /get/
Disallow: /file/
Disallow: /load/
Request-rate: 1/900
Crawl-delay: 900