Google Blogoscoped

Forum

Robots.txt specification from Google

Juha-Matti Laurio [PersonRank 10]

Saturday, November 27, 2010
13 years ago5,682 views

http://code.google.com/intl/de/web/controlcrawlindex/docs/robots_txt.html

via
http://www.webmasterworld.com/robots_txt/4234719.htm

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!