Google Blogoscoped


Weird robots command for GoogleBot

NateDawg [PersonRank 10]

Thursday, August 10, 2006
17 years ago2,817 views

Was looking at the latest robots.txt for picasaweb and noticed this

User-agent: Googlebot
Allow: /$
Disallow: /

User-agent: *
Disallow: /

   I havn't been able to find any reference to the Allow: /$ command and the robots.txt validator came back with and "unknown command" error. Anybody seen this before or not what this might be refering to?


Piotr Konieczny [PersonRank 9]

17 years ago #

Nate: RegExp?

Ludwik Trammer [PersonRank 10]

17 years ago #

I've checked in Google's own robots.txt analysis tool ( and it's seems to work exactly the same as "Allow: /" – allows all.

NateDawg [PersonRank 10]

17 years ago #

Other than to quell competition, any other reason why Google would do this?? This seems like an odd function.

Forum home


Blog  |  Forum     more >> Archive | Feed | Google's blogs | About


This site unofficially covers Google™ and more with some rights reserved. Join our forum!