Thread: Google webcrawl

I've published my site map to google and it has been verified but when i look at the overview, it says that 292 pages are not found, (error 404).

Can anyone advise me what to do about this problem and what might be the cause?

I have checked all the links and they work fine, I just cant figure it out.


www.citylifelive.co.uk

example: this is one of the pages that cannot be found

http://www.citylifelive.co.uk/eating-out-Newcastle.html

Hey Matty when i click on http://www.citylifelive.co.uk/eating-out-Newcastle.html
it works fine, try Crtl and F5 to view it again, maybe your looking at a cached version or something

Pam: I think you are misunderstanding the question here.

Matty: I see you have a visitor sitemap but have you created an SE sitemap?

Hi guys, thanks for responding.

Yes, I have made a SE sitemap ( http://www.citylifelive.co.uk/sitemap.xml )
and have submitted it to google.

When i first made they SE sitemap I had to put most of the pages in manually because the bluevoda crawler could not find the pages either.

Try making one here

http://www.xml-sitemaps.com/

Then place the file it creates onto your server overiding your existing sitemap.xml file on there

Thanks, i'll try that then let you know the outcome

Ramsey, that would not cause the 404 errors. And after looking at the site, the site map I see there is fantastic (see below).

This sounds like you must have a bunch of links that aren't working - have you looked at your stats for where your 404 not founds are coming from? That's what you have to do and fix. Just clicking around, everything I did worked and I didn't have time to put the site into a checker - which is something you might need to do to find the 404 errors.

And, I would NOT get rid of the site map you have - it's wonderful - and great for users! It's too bad more sites don't have such a great way for people to find everything.

Hi Beth, long time no speak.. good to see you.
Matty did show a page that the 404 was coming up for but the page exists, thats why i didnt think it was that. I also couldn't spot any bad links on his site, although a site of that size i obviously didn't scour it all so I guess it could be this ya.

and no I wasn't suggesting getting rid of the visitor sitemap, I agree 100% it's a wonderful addition that not enough people do.

I know that on sites where I have many hundreds of pages as Matty has that making the sitemap with sitemap .com was better than the building tool one (although this does work every other time)

No disagreement there - I think Google is finding all the pages - and also finding a bunch of bad pages - and at this time - it's important to find and get rid of the "bad guys" :)

Hi marincky, i made the sitemap on the site you said but i don not know how to get i onto blue voda and publish it.

And Bethers, how do i do a link checker with blue voda?

Thanks for the help guys

You don't put it on BV. Open BV > Tools > FTP Manager

Left hand side is your PC files / Right hand side is your server

Find file on L/H side and drag to R/H side and that's how you put a a file on your server.

With regards to checking your links, do a search on Google for one, most are free.

I've dragged it onto the left hand side and deleted the old one but it does not show online?

Originally Posted by mattyfergus

I've dragged it onto the left hand side and deleted the old one but it does not show online?

Matty read my post above yours again

It says Drag Left to right>>>>>>>

My bad, I was replacing it with a copy of the original.
I will submit it to google and see how I get on.
again, Thanks for the help

You're Welcome, but you still need to do a link check as beth has a good point there about what could be happening.

HI guys. I done all that and still having the same problems.

Any other ideas?

hmmm. somehow it's searching and finding 292 pages that either don't exist or somehow they are seeing them as non existant. I would just check check and check again... make sure that there are no links at all on your site that go to a dead page.

I have had something fairly similar before and I just left it and it sorted itself out after a few weeks. Sometimes (especially when a site is first published) YOU can see them but Google can't.. I have found this before.

Don't really know what else to suggest, maybe someone else may be able to help?

thanks for the advice.
I'll manually check all the links and hope for the best.

No problem, I wasn't really any help sorry.