It's almost funny thinking of the days that the major search result changes happened every few months. A story I posted this evening at 7:06pm Central got a hit from a Google search exactly 50 minutes later.
So the obvious question is, how long before it gets indexed instantly? :)
To me the phrase isn't all that unique either. I posted a review of yesterday's episode of HBO's Entourage, and now I'm the third hit for "entourage beaver shot". (The episode had a gratuitous nudity)
http://www.google.com/search?hl=en&q=entourage+beaver+shot&btnG=Google+Search |
I noticed this also in case of Google Blogoscoped. When Philipp post my text on the site I get an information from Google Alerts _immediately_ – manual information from Philipp and automatic information from Google comes together. |
I think there is something special with blogs, that is to say I think Google use Google Blogsearch bot (or "pings"?) to index page in Google Blogsearch and now in Google web search. That's why the last time I put a new page on my website (not a blog), I had to wait 3+ days to get indexed. Even with sitemap and links from everywhere. |
I think there is a difference with putting up a new page or new blog, and updating an existing page . It seems updates of existing pages or blogs now appear in google much faster than before. |
Google keeps track of how often the site is updated, and adjust GoogleBot visits to that. Google Blogoscoped is a site with a high PageRank, updated many times a day, so Google Bot visits it constantly. Note that usually it takes it much more time to index the URL of a new article, than to index it on the homepage. Also note that some sites get an option in Google Webmasters Tool to allow Google Bot to visit more often. I don't know if Philipp has done this. |
Ludwik, that's exactly how I understood it to work too. |
<< Google has two crawlers, each with a different function, to assure that it's index of the web is both deep and up to date. >> (http://searchengineland.com/070724-072605.php)
Is this true?
Also see: http://www.google.com/search?q=%22Google+has+two+crawlers%22
|
47000 pages are returned on a search for [google freshbot]: http://www.google.com/search?q=google+freshbot
I presume that's what is being referred to here. |
I'd believe that's true. It would certainly explain why the main pages of sites get indexed so much quicker than the linked, deeper pages.
And I know GoogleBot visits based on update frequency, but I only have at most 2-3 posts a day on a site that only gets a few hundred hits a day. So I was quite surprised at the quickness in this case. I could easily see it happening for a site like blogoscoped, but the fact that it happened to what is basically a relatively low/medium traffic blog is what really interested me.
Basically, I'm most surprised that even if they grab the content that quickly, they can change the top 10 results which can be based on all kinds of long-term analysis like how many times the site was clicked on (i.e. was correct) for a given search query, number of backlinks, etc. |