Comments on: One Standard Fits All: Robots Exclusion Protocol for Yahoo!, Google and Microsoft

By: Peter Kiss

Peter Kiss — Thu, 29 Oct 2009 05:59:07 +0000

Who thought of this idea,hope he or she gets public credit.

By: kocsog

kocsog — Sun, 11 Oct 2009 09:05:22 +0000

I’m really glad to see this progress

By: Adam

Adam — Fri, 16 Jan 2009 19:37:18 +0000

Does Yahoo have a site exclusion tool? If so, where is it?

By: Hans Neher

Hans Neher — Fri, 07 Nov 2008 00:39:09 +0000

It would be helpful if two text lines were added showing 1/ how to disallow crawling any .pdf on my site, and 2/ how to disallow crawling only .pdf files in a particular directory.

Please include all the single and double quotation marks, $-signs and whatever is needed.

“It may be well known to you, but is not known by me, and the purpose of help is to enable the reader to do what needs to be done, correctly, first time round”.

By: ankara evden eve

ankara evden eve — Wed, 08 Oct 2008 22:47:47 +0000

I love the Flickr plug-in – you are a god! I second the request for a plug-in to upload to Costco. Then life would be complete!

By: Christian Solei

Christian Solei — Tue, 30 Sep 2008 18:55:06 +0000

Thanks so much for allowing the request to rewrite URLs – this is nothing less than brilliant!

By: Karl Kiss

Karl Kiss — Tue, 30 Sep 2008 18:53:09 +0000

Thank you very much for the work. I’ll be posting about this and linking in this direction.

By: IT Help

IT Help — Mon, 22 Sep 2008 13:53:53 +0000

Having a separate robots for each search would be a nightmere, I’m glad there is one standard!

By: KellyLynch

KellyLynch — Fri, 01 Aug 2008 08:49:59 +0000

About the wildcards: does path ‘*.doc$’ mean the same as ‘.doc$’?

By: gdgrimm

gdgrimm — Tue, 01 Jul 2008 21:50:00 +0000

Where can we clarification on these? For example, does “Present no abstract for the page on search results.” for the NOSNIPPET directive mean that nothing will appear below the Title in the SERP, or that the META description tag of the page will always be used in the SERP, rather than some search engine generated abstract or snippet?