Sitemapper scans your website in the same way as the spiders from popular search engines such as Google , Yahoo! , and Bing . This means that it does not follow links in JavaScript, DHTML, or Flash files. Here's why: Search engine spiders can only follow HTML.

Let's use Flash as an example. A Flash-based webpage is pretty and interactive when a human looks at it, but when a search engine spider tries to scan it, all it sees is an <embed> tag. It can't go into the Flash animation to find the links, so it skips past the page, and your site doesn't get a good ranking. Simple as that.

So what's the solution? Use HTML for all your links and navigation . If you want your site to rank well in search engine results, to work correctly on all browsers, and to be accessible to people with disabilities, you have to structure your site with semantically valid HTML and add CSS and JavaScript using the principles of progressive enhancement .

Hmmm - I seem to have the 'non-seen' page problem on my site http://gblcg.com as well...

For example, I have seven pages under http://www.gblcg.com/goodman-bergh-values.html as referred to on that page in html. My sitemap only shows three...

When looking at http://www.gblcg.com/goodman-bergh-services.html, it references five pages which are all indexed correctly on the sitemap.

Bit stuck here - any idea what's going on and, more importantly, how to solve it?

I got the same result and didn't find anything that would be in common about the lost links. I would open a support topic and reference this thread.

This is because you are not using the same URL for all links. Some of them use http://www.gblcg.com and others use http://gblcg.com. That is why you are getting different results because those are 2 different URL's. You should either use relative path names (use a href="/goodman-bergh-values.html") or adjust them to all use the same URL http://www.gblcg.com

Always remember that WWW is a host name which could be a different location then domain.com (even though most are the same). It is similar to having shop.domain.com. For Sitemapper, all links have to be on the exact same domain as you are scanning.

good catch Scott.

I learnt this from Scott some time ago in connection with WI. I hadn't actually thought as far as the Sitemapper, which I guess I should have. Thanks for reminding me - and others.