User-agent: * Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content Disallow: /wp-*.php* Disallow: /author Disallow: /2009/*/* Disallow: /2010/*/* Allow: / Allow: /files Allow: /?sitemap*