User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /components/ Disallow: /editor/ Disallow: /help/ Disallow: /images/ Disallow: /includes/ Disallow: /language/ Disallow: /mambots/ Disallow: /media/ Disallow: /modules/ Disallow: /templates/ Disallow: /installation/ Disallow: /staf_thanks.php Disallow: /staf_error.php Disallow: /option,com_staf/ Disallow: /secure/ # google allows the use of wildcards User-agent: googlebot Disallow: *.cgi Disallow: /secure/ Crawl-delay: 5