Is there a limit to how many urls the Sitemapper software can handle? Just wondering if 100,000 is too much for it. I've had the progam crash twice now after finding 36,000 urls and having 55,000 in the queue.

I have no doubt some people will see that number and phreak out, but it's a fairly large site. It's certainly no Wal-Mart or Amazon, but the site does have a lot of links to products and groups of products.

Max limit is 50,000 pages.
http://www.coffeecup.com/forums/sitemapper/maximum-pages-scanned-limit/

wow, thanks for the fast reply. i appreciate the help.

Not a problem. Come on back any time!

Hey there!

That is the maximum amount of URL's allowed in a sitemap. This is according to the specifications set at http://www.sitemaps.org/faq.html

Q: How big can my Sitemap be?
Sitemaps should be no larger than 10MB (10,485,760 bytes) and can contain a maximum of 50,000 URLs. These limits help to ensure that your web server does not get bogged down serving very large files. This means that if your site contains more than 50,000 URLs or your Sitemap is bigger than 10MB, you must create multiple Sitemap files and use a Sitemap index file. You should use a Sitemap index file even if you have a small site but plan on growing beyond 50,000 URLs or a file size of 10MB. A Sitemap index file can include up to 1,000 Sitemaps and must not exceed 10MB (10,485,760 bytes). You can also use gzip to compress your Sitemaps.

50 million. That might be enough.