User-agent: * Disallow: *.php Disallow: *.xml Disallow: /*cgi* Disallow: _*