Google creates and breaks his own rules.
I am surprised to see this, but what is the purpose of robots.txt then? All Blogger.com blogs have robots.txt file and it blocks /search URLs. But, still URLs appear in Google's index.
Example:
http://googlesystem.blogspot.com/robots.txt
http://www.google.co.in/search?q=site%3Agooglesystem.blogspot.com+inurl%3Asearch%3Fupdated-max |
sorry for grammar mistakes! :) |