corobori — 2011-12-28T15:21:00-05:00 — #1
I have got one issue on three websites where Google Webmaster tools found 1000s of "404 page not found" but I don't know how come he is searching those pages. For instance I am getting crawl errors for http://www.topvalais.ch/ZdRbW/Rubriques.aspx or http://www.topvalais.ch/RcjeO/ZYmXX/Rubriques.aspx or http://www.topvalais.ch/STXTP/OhbOX/Rubriques.aspx or http://www.topvalais.ch/PddjP/KWPjO/PSLZU/Rubriques.aspx etc... All those pages do not exist. The real existing page is http://www.topvalais.ch/Rubriques.aspx
Where does Google Crawler's find those URLs with garbage's characters ? Has it something to do with the URL Rewriting thing ?
And when looking at referrer again it's something I wouldn't know where Google's crawler found them. See details here: http://www.corobori.com/sos/picTopVS.jpg
Any clue welcome !
justin3163 — 2011-12-29T12:00:34-05:00 — #2
Is very strange. How old is your domain. Try to watch if your robots.txt is properly configurated and rebuild sitemap.
corobori — 2011-12-29T12:26:37-05:00 — #3
The domain is about 3 years old and I have made little changes lately. Will check the robots.txt
benhames — 2011-12-30T00:27:34-05:00 — #4
Is it a autoblogs or do you have a php script that can go arise
corobori — 2011-12-30T10:17:02-05:00 — #5
Home made stuff written in VB.NET
benhames — 2011-12-30T15:28:52-05:00 — #6
corobori — 2012-01-02T08:07:48-05:00 — #7
I know the problem is my code but I would like to know where.
technobear — 2012-01-02T09:22:50-05:00 — #8
In that case, you might get more help in the .NET forum. (You can click the orange flag on your post and ask a Moderator to move the thread for you, if you want.)
ralphm — 2012-01-02T22:56:19-05:00 — #9
Thread moved to .NET forum.
wwb_99 — 2012-01-03T13:06:01-05:00 — #10
My bet is you have the sessions setup to fall back onto url mode. Googlebot don't take cookies so it generates urls for the bot to use to hold onto it's session.
All that said it looks real odd.
mittineague — 2014-09-18T12:32:42-04:00 — #11
This topic is now archived. It is frozen and cannot be changed in any way.