Google Blogoscoped

Forum

YouTube has 1.4 MILLION Search Queries Spidered & Cached in GOOGLe

Search-Engines-Web.com [PersonRank 10]

Sunday, February 18, 2007
12 years ago2,191 views

google.com/search?hl=en&sa ...

Results 1 – 10 of about 1,380,000 from www.youtube.com/results. (0.44 seconds)

Only Two in Yahoo

Philipp Lenssen [PersonRank 10]

12 years ago #

Web search results ought to be disallowed via robots.txt. Not doing so is a favorite trick of spammers who don't offer any content of their own. In this case, the content is owned by YouTube, but ought to be already indexed through the individual video pages – the results indexing is just redundant. When you're allowing search results to be indexed you're creating an infinite mirror effect. No one really wants to click on a search result and stumble upon yet another search result. I wonder if Google ever made an official webmaster guideline discussing this.

Rich Hodge [PersonRank 6]

12 years ago #

Could not agree more with PL

Philipp Lenssen [PersonRank 10]

12 years ago #

I just posted this as a question to the Google Webmaster group:
groups.google.com/group/Google ...

John Honeck [PersonRank 10]

12 years ago #

Good Idea Philipp, but as you've seen with the cloaking issue they never really comment on anything of substance there. If it's in the webmaster guidelines they'll point you to them, but that's about it. Adam will let some pearls of wisdom sneak through, but I wouldn't expect a public answer on anything controvertial at all.

Philipp Lenssen [PersonRank 10]

12 years ago #

True, but I was hoping this is really non-controversial this time... though I guess you never know whether or not you hit on a "secret" (a "corpse in the basement," as we call them here, not sure if this is an English expression too?).

John Honeck [PersonRank 10]

12 years ago #

Or a "skeleton in the closet" just as we speak of this, Vanessa Chimes in on sneaky redirects!

groups.google.com/group/Google ...

Sorry for the threadjacking, this issue deserves better behavior than that.

This thread is locked as it's old... but you can create a new thread in the forum. 

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!