Google Blogoscoped

Forum

Google Calling Itself Names  (View post)

Ionut Alex. Chitu [PersonRank 10]

Tuesday, August 19, 2008
15 years ago3,541 views

Then how come Google indexes google.com/reader and displays appropriate title/description for Google Reader's login page:
http://www.google.com/search?q=google+reader&hl=en&gl=us

Ludwik Trammer [PersonRank 10]

15 years ago #

Ionut – I believe that's because the command in robots.txt is:

Disallow: /reader/

and not

Disallow: /reader

The intention probably was for robots to index www.google.com/reader, but ignore everything inside the /reader/ catalog.

Notice that the result you pointed out uses "www.google.com/reader" URL, while the german result Philipp talks about points to "www.google.de/reader/" (with slash at the end).

Ionut Alex. Chitu [PersonRank 10]

15 years ago #

Maybe search engines should be clever and use the data for google.de/reader. I wonder how they decide between google.de/reader and google.de/reader/.

http://www.mattcutts.com/blog/seo-advice-url-canonicalization/

Ramiro Gomez [PersonRank 1]

15 years ago #

That's the best search engine result page I have seem for a long time.

Sougata B [PersonRank 0]

15 years ago #

I'm guessing "Krake" and the kraken from pirates of the caribbean have the same etymology haha?

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!