User-agent: * Disallow: /$ Crawl-delay: 30