User-agent: * Disallow: /admin/ Disallow: /assets/ Disallow: /cron/ Disallow: /store/custom/ Disallow: /extra_code/ Disallow: /files/ Disallow: /plugins/ Crawl-delay: 4 Request-rate: 1/5 Visit-time: 0100-1300