Thread: site maps

I have added more pages with new content to one of my sites. I use http://sitemap.xmlecho.org/sitemap/
to generate the xml file. However, not all of the URL's/links that are on my index page are listed in the generated files. All URL's/links are text links.
Any suggestions? Could the sitemap software be seeing a cached version of my index page? HELP!!!

Some additional info. I went to another source http://www.xml-sitemaps.com and generated 3 sitemaps. They were all different with none including all URL's.

Yes its possible for a sitemap maker to run the SE gambit and use the cache to generate the map. Its also possible that if you are running a robots.txt file that you have disallowed robots to certain pages.. and that would INCLUDE sitemap spiders.

Karen

Thanks for the reply.
No robots.txt file. What is confusing is that I can run the sitemap generator and it comes up with different links displayed. Three different sitemaps on the tries.

Oooops...there is a robots.txt file but it allows "all"
I also have a "no cache" file.

I dont think that meta tag keeps the SE from caching your pages.. thats when someone lands on your site, after 64mb is loaded, then the rest are refreshed instead of cached in the browser. That wouldnt keep the SE from counting your pages etc.

What are you using to generate a sitemap?

Karen

Never mind.. just scrolled up..

Try this one..

http://www.rorweb.com/rormap.htm

Karen

I have also tried that one. It does a better job but still misses several URL's and lists other URL's for images that are on my gallery page.
What I have wound up doing is editing what is generated and add/subtract appropriate URL's.
I appreciate your help.