User-agent: * Crawl-delay: 30 Disallow: /tag/ Disallow: /feed/ Disallow: /tags/ Disallow: /page/ Disallow: /wp-content/