How to Prevent site from being indexed in SE
- Thread starter cherry_yuya
- Start date
Hi...
This is my first post!
You can upload a simple text file with the name "robots.txt" on the root of you site and there you can specify which spider/robot (search engines) you allow access or disallow and where on your site it will apply.
If you just like to disallow all of them from all of your site copy the following to you robots.txt file:
User-agent: *
Disallow: /
Good luck.
This is my first post!
You can upload a simple text file with the name "robots.txt" on the root of you site and there you can specify which spider/robot (search engines) you allow access or disallow and where on your site it will apply.
If you just like to disallow all of them from all of your site copy the following to you robots.txt file:
User-agent: *
Disallow: /
Good luck.
bear-this is right. However, keep in mind that this may only work for the largest search engines (those you mentioned) because their respect for a website's robots.txt file. This means that if a search engine crawler is set to intentionally disregard the contents of the robots.txt file and crawl everything it pleases, your website might just as well be indexed in smaller search engines.
A robots.txt as mentioned above, as well as the meta tag below...
Code:
<meta name="robots" content="noindex, nofollow" />
