Wordpress Blogs and Google’s Supplemental Index
It seems that WordPress-based blogs have a tendency to be dropped into Google’s Supplemental Index pretty quickly. The general consensus is that this is due to the duplication of content present within WordPress. A typical installation will generate a minimum of five instances of a post - more if the post is identified in multiple categories.
To alleviate the problem, include the following Javascript in which ever template contains your <head> tag information:
<?php if(is_home() || is_single() || is_page()){
echo '<meta name="robots" content="index,follow">';
} else {
echo '<meta name="robots" content="noindex,follow">';
}?>
You may also want to block the Googlebot from your Feeds as well. Add the following to your robots.txt file:
User-agent: Googlebot Disallow: /*/feed/$ Disallow: /*/feed/rss/$ Disallow: /*/trackback/$
