I would like robots and spiders to be able to index my site for sitemap purposes, but .htaccess is not allowing that. I know I can temporarily disable .htaccess to get a complete site map, but doesn't that depreciate my SEO if future search engines can not access the majority of my website because it's password protected?

Is there a command in .htaccess or in a robots.txt that I can add to allow indexing of the password protected site by search engines ? I've already tried

User-agent: *
Disallow:

in my robots.txt file. It doesn't work

This should help.
http://www.danmuzyka.com/blog/password- … d-htpasswd

Thanks Rolly. That article talks about how .htaccess prevents bots and spiders from crawling your site. My situation is that I've got about 50 pages on my website, and all but one of them are password protected. I'm concerned that having only one page viewable by search engines will lower my search engine ranking. So if that is so, I actually want the search engines to find the password protected pages, but just not have the content of those pages available to the public.

How about submitting a sitemap to Google. I did a little reading up on the subject and there's no full proof way. I think most users are placing summarized relevant content on a page that the search engine have access to with a link to the full content that allows login to read.