Comments on: How to stop Google displaying links to my "hidden" website pages? http://www.dominatinglocalsearch.com/google-local/how-to-stop-google-displaying-links-to-my-hidden-website-pages Getting Search Engine Traffic to Your Local Website Tue, 20 Jan 2009 14:50:10 -0600 http://wordpress.org/?v=2.8.4 hourly 1 By: Michael from UK http://www.dominatinglocalsearch.com/google-local/how-to-stop-google-displaying-links-to-my-hidden-website-pages/comment-page-1#comment-615 Michael from UK Sun, 18 Jan 2009 22:00:59 +0000 http://www.dominatinglocalsearch.com/google-local/how-to-stop-google-displaying-links-to-my-hidden-website-pages#comment-615 Some search engines don't honour the robot.txt protocol mentioned above. Search engines find pages by 'crawling' the web, by starting at the 'index.html' file at your website top-level node and going to all links from that page, and all links from that page, and so on - like a spider crawling the web of links. So to hide a page (if the robot.txt doesn't work) just create your pages with no links to them. So the only way anyone can find them is for you to send them the url. So you'd need to type in 'www.mysite.com/fsf544/hidden/ewrt8t8323/directions.html' - rather than reach it from a link somewhere on your site.<br><b>References : </b><br> Some search engines don't honour the robot.txt protocol mentioned above.

Search engines find pages by 'crawling' the web, by starting at the 'index.html' file at your website top-level node and going to all links from that page, and all links from that page, and so on – like a spider crawling the web of links.

So to hide a page (if the robot.txt doesn't work) just create your pages with no links to them. So the only way anyone can find them is for you to send them the url.

So you'd need to type in 'www.mysite.com/fsf544/hidden/ewrt8t8323/directions.html'
- rather than reach it from a link somewhere on your site.
References :

]]> By: Nathan http://www.dominatinglocalsearch.com/google-local/how-to-stop-google-displaying-links-to-my-hidden-website-pages/comment-page-1#comment-614 Nathan Sun, 18 Jan 2009 21:38:59 +0000 http://www.dominatinglocalsearch.com/google-local/how-to-stop-google-displaying-links-to-my-hidden-website-pages#comment-614 I was going through my scripts last night and found something which does that, but I can't remember where! If I find it again, I'll email you the download link or put it here! Ok I think I got this download from google. It's called google sitemap creator, and it will help you index your pages quickly and easily. I'm trying to find a link for you! http://yiphee.co.cc/gsm.zip I don't know why, but the link won't work on yahoo so you should type it in.<br><b>References : </b><br> I was going through my scripts last night and found something which does that, but I can't remember where!
If I find it again, I'll email you the download link or put it here!

Ok I think I got this download from google. It's called google sitemap creator, and it will help you index your pages quickly and easily. I'm trying to find a link for you!
http://yiphee.co.cc/gsm.zip
I don't know why, but the link won't work on yahoo so you should type it in.
References :

]]> By: Elias http://www.dominatinglocalsearch.com/google-local/how-to-stop-google-displaying-links-to-my-hidden-website-pages/comment-page-1#comment-613 Elias Sun, 18 Jan 2009 21:05:59 +0000 http://www.dominatinglocalsearch.com/google-local/how-to-stop-google-displaying-links-to-my-hidden-website-pages#comment-613 You need to create a robot.txt file. When Google crawls the page, they will first find the robot.txt file and ignore pages you've specified to be ignored. All the information you need to create one can be found here: http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=40360<br><b>References : </b><br> You need to create a robot.txt file. When Google crawls the page, they will first find the robot.txt file and ignore pages you've specified to be ignored.

All the information you need to create one can be found here: http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=40360
References :

]]>