sculley — 2012-05-17T10:49:12-04:00 — #1
Anyone know why this might be and how to fix?
Cllent site is: terrilonglandscape.com
Google Webmaster Tools is showing a "403 crawl error (access denied) on the blog page: http://www.terrilonglandscape.com/blog/"
"Googlebot couldn't crawl your URL because your server either requires login to access the page, or is blocking Googlebot from accessing your site."
Not sure why. Doesn't require a login to view it. I am just taking this site over for a client. Not sure why the robots.txt file has this but don't think that's blocking the blog:
Any ideas how to fix? I posted in Google WMT forum but nothing.
Thanks in advance!
ralphm — 2012-05-17T11:09:11-04:00 — #2
You have this meta tag at the top of your page, which sends Google away:
<meta name="robots" content="<font color='"#FF0000"'>noindex</font>, nofollow, <font color='"#FF0000"'>noarchive</font>, noodp, noydir" />
sculley — 2012-05-17T11:21:31-04:00 — #3
Wow, thanks Ralph! Didn't even think to check that! Weird that they're there. Client uses the Thesis Theme and all three of those meta tags are unchecked. Have no idea how they are getting on there.
sculley — 2012-05-17T14:04:55-04:00 — #4
Ralph, I see this meta tag:
<meta name="robots" content="noodp, noydir" />
But not the one you are seeing:
<meta name="robots" content="noindex, nofollow, noarchive, noodp, noydir" />
ralphm — 2012-05-17T20:34:16-04:00 — #5
Hm, weird, I just copied that from one of the pages, but don't see it now. Sorry for the confusion. Is there any chance those options were only chosen recently? Just a thought.
sculley — 2012-05-18T11:58:24-04:00 — #6
Hmmm...I'm not sure. That's weird. Do you know what else it could be?
sitemapgenerator — 2012-08-27T09:30:51-04:00 — #7
Check into if you have a plugin installed that denies (forbids = 403) crawlers access