Was looking at the latest robots.txt for picasaweb and noticed this
<quote>
User-agent: Googlebot
Allow: /$
Disallow: /
User-agent: *
Disallow: /
</quote>
I havn't been able to find any reference to the Allow: /$ command and the robots.txt validator came back with and "unknown command" error. Anybody seen this before or not what this might be refering to?
Links:
http://picasaweb.google.com/robots.txt
http://tool.motoricerca.info/robots-checker.phtml |
I've checked in Google's own robots.txt analysis tool (www.google.com/webmasters/) and it's seems to work exactly the same as "Allow: /" – allows all. |
Other than to quell competition, any other reason why Google would do this?? This seems like an odd function. |
