Hoping someone can help!
I run a finanical site with acouple of secure forms. I link to these https forms from non secure pages. Recently, i noticed that Google has started indexing https version of the entire site -- including the home page! (hello dup content)
According to Google, you need to have to separate robots.txt files - one served for http, the other for https in order to block access to other ares on site via https.
Here is what I added to .htaccess
RewriteCond %{SERVER_PORT} ^443$
RewriteRule ^robots.txt$ robots_ssl.txt
not working!!!!! Any ideas?
I run a finanical site with acouple of secure forms. I link to these https forms from non secure pages. Recently, i noticed that Google has started indexing https version of the entire site -- including the home page! (hello dup content)
According to Google, you need to have to separate robots.txt files - one served for http, the other for https in order to block access to other ares on site via https.
Here is what I added to .htaccess
RewriteCond %{SERVER_PORT} ^443$
RewriteRule ^robots.txt$ robots_ssl.txt
not working!!!!! Any ideas?