![]() |
| |||||||
| Web Hosting Discussions on all aspects of web hosting, choosing a host, reviews and technical things. |
![]() |
| | LinkBack | Thread Tools | Display Modes |
| |||
| The only only other way is to remove the site from being accessible on the internet! The fact that the site is publicly available on the internet suggests to the web crawlers that it's OK to visit it. The robots.txt is the means for saying it's not OK to visit your site. Here's Yahoo!'s stance on the matter, from the help page: " If you want the status of pages that have been crawled and indexed to change, you will need to make changes to the site content or control documents that communicate to our crawler how these pages should be handled by the search engine. " |
![]() |
| Bookmarks |
| Thread Tools | |
| Display Modes | |
| |
Similar Threads | ||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| How to remove my name from yahoo's snail mail list and stop receiving yahoo search marketing post cards? | mov | Pay-Per-Click Marketing | 2 | 12-26-2006 11:27 PM |
| What should i do with the robots.txt file to have my site found with the search engin | MrScott | Web Hosting | 2 | 11-12-2006 05:26 AM |
| Why does yahoo ignore the robots.txt file? | sai14 | Web Hosting | 2 | 09-01-2006 08:57 PM |
| Can search engine crawlers still read a domains robots.txt file if its permission is set to 600? | MultikPultik | Web Hosting | 1 | 08-26-2006 06:07 PM |
| How do I keep Yahoo robots from scanning my webpage? I have a robots.txt file in place, but it's not working. | t4x | Web Hosting | 2 | 03-28-2006 04:32 PM |