User-agent: * #Request-rate: 1/3 # maximum rate is one page every 5 seconds #Visit-time: 0500-0945 # only visit between 06:00 and 08:45 UTC (GMT) Disallow: /cat Disallow: /cats Disallow: /admin Disallow: /local Disallow: /cpanel