I'm wondering if there is a tool, preferably a firefox extension that enables me to see at a glance whether a page has a noindex meta tag? I'm not so worried about robots.txt, just the meta tag.
Use the web developer toolbar. Under Information: view meta tag information.
View source the Page...CTRL-U for firefox
Thanks, good answers and pretty much what I expected. I know it seems like a silly question, but the reason I asked is that I'm looking after a fairly large site and I wondered if there was a real quick option, as I have to go through and check all the pages. This is because one of the highest ranking pages slipped out of google as a noindex tag was left undetected. I think I'll just do a find and replace for now...
download searchstatus at http://www.quirk.biz/searchstatus/
its a firefox plugin.
If you use PHP, it should be fairly easy to write a script that goes through the sites, fetches the page and parses them for 'nofollow'.
This topic is now archived. It is frozen and cannot be changed in any way.