Google Blogoscoped

Forum

Weird robots command for GoogleBot

NateDawg [PersonRank 10]

Thursday, August 10, 2006
16 years ago2,735 views

Was looking at the latest robots.txt for picasaweb and noticed this

<quote>
User-agent: Googlebot
Allow: /$
Disallow: /

User-agent: *
Disallow: /

</quote>
   I havn't been able to find any reference to the Allow: /$ command and the robots.txt validator came back with and "unknown command" error. Anybody seen this before or not what this might be refering to?

Links:
http://picasaweb.google.com/robots.txt
http://tool.motoricerca.info/robots-checker.phtml

Piotr Konieczny [PersonRank 9]

16 years ago #

Nate: RegExp?

Ludwik Trammer [PersonRank 10]

16 years ago #

I've checked in Google's own robots.txt analysis tool (www.google.com/webmasters/) and it's seems to work exactly the same as "Allow: /" – allows all.

NateDawg [PersonRank 10]

16 years ago #

Other than to quell competition, any other reason why Google would do this?? This seems like an odd function.

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!