Google Blogoscoped

Forum

Google Added /tbproxy/ to Robots.txt

Suresh S [PersonRank 10]

Thursday, November 22, 2007
12 years ago3,155 views

Any comments on this?

Ionut Alex. Chitu [PersonRank 10]

12 years ago #

It's for Google Toolbar's actions. Nothing important.

Zim [PersonRank 10]

12 years ago #

The question is why that URL needs to be forbidden, if google toolbar does not serve web pages (does it?!)

Martin Porcheron [PersonRank 10]

12 years ago #

If someone links to it, a spider will still index it, which of course it doesn't need to. I guess Google's just making sure spiders don't try crawling it.

This thread is locked as it's old... but you can create a new thread in the forum. 

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!