Google Blogoscoped

Forum

Content indexed in just 50 minutes!

Niraj Sanghvi [PersonRank 10]

Tuesday, July 24, 2007
16 years ago3,305 views

It's almost funny thinking of the days that the major search result changes happened every few months. A story I posted this evening at 7:06pm Central got a hit from a Google search exactly 50 minutes later.

So the obvious question is, how long before it gets indexed instantly? :)

To me the phrase isn't all that unique either. I posted a review of yesterday's episode of HBO's Entourage, and now I'm the third hit for "entourage beaver shot". (The episode had a gratuitous nudity)

http://www.google.com/search?hl=en&q=entourage+beaver+shot&btnG=Google+Search

Ludwik Trammer [PersonRank 10]

16 years ago #

I noticed this also in case of Google Blogoscoped. When Philipp post my text on the site I get an information from Google Alerts _immediately_ – manual information from Philipp and automatic information from Google comes together.

TOMHTML [PersonRank 10]

16 years ago #

I think there is something special with blogs, that is to say I think Google use Google Blogsearch bot (or "pings"?) to index page in Google Blogsearch and now in Google web search.
That's why the last time I put a new page on my website (not a blog), I had to wait 3+ days to get indexed. Even with sitemap and links from everywhere.

or [PersonRank 10]

16 years ago #

I think there is a difference with putting up a new page or new blog, and updating an existing page . It seems updates of existing pages or blogs now appear in google much faster than before.

Ludwik Trammer [PersonRank 10]

16 years ago #

Google keeps track of how often the site is updated, and adjust GoogleBot visits to that. Google Blogoscoped is a site with a high PageRank, updated many times a day, so Google Bot visits it constantly. Note that usually it takes it much more time to index the URL of a new article, than to index it on the homepage. Also note that some sites get an option in Google Webmasters Tool to allow Google Bot to visit more often. I don't know if Philipp has done this.

Tony Ruscoe [PersonRank 10]

16 years ago #

Ludwik, that's exactly how I understood it to work too.

Ionut Alex. Chitu [PersonRank 10]

16 years ago #

<< Google has two crawlers, each with a different function, to assure that it's index of the web is both deep and up to date. >> (http://searchengineland.com/070724-072605.php)

Is this true?

Also see: http://www.google.com/search?q=%22Google+has+two+crawlers%22

Roger Browne [PersonRank 10]

16 years ago #

47000 pages are returned on a search for [google freshbot]:
http://www.google.com/search?q=google+freshbot

I presume that's what is being referred to here.

Niraj Sanghvi [PersonRank 10]

16 years ago #

I'd believe that's true. It would certainly explain why the main pages of sites get indexed so much quicker than the linked, deeper pages.

And I know GoogleBot visits based on update frequency, but I only have at most 2-3 posts a day on a site that only gets a few hundred hits a day. So I was quite surprised at the quickness in this case. I could easily see it happening for a site like blogoscoped, but the fact that it happened to what is basically a relatively low/medium traffic blog is what really interested me.

Basically, I'm most surprised that even if they grab the content that quickly, they can change the top 10 results which can be based on all kinds of long-term analysis like how many times the site was clicked on (i.e. was correct) for a given search query, number of backlinks, etc.

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!