Google Blogoscoped

Forum

"Google Indexer"

Brian M. [PersonRank 10]

Monday, November 7, 2005
17 years ago

A search on Google Scholar for, in quotes, "Google Indexer", reveals 310,000 results. Google has found a way into the deep web.

Philipp Lenssen [PersonRank 10]

17 years ago #

Can you explain please?

Brian M. [PersonRank 10]

17 years ago #

Here's a better example. Search regular Google for, in quotes, "Institution: google-indexer". 37 million results.

Brian M. [PersonRank 10]

17 years ago #

Hey Philipp. Sure – Google has made deals with all these websites whereas they grant Google's IP range an account, and allow Google to spider information that they don't allow casual surfers to access. Google uses this data to provide you results, but when you click the link you don't see the same data Google saw. You have to purchase an account at that website.

Philipp Lenssen [PersonRank 10]

17 years ago #

Are these 310,000 deep web articles exclusively at http://scholar.google.com or also at http://www.google.com ?

Brian M. [PersonRank 10]

17 years ago #

They appear to be indexed in both. Google seems to supress almost all of the "Google Indexer" phrases in the snippets on Scholar, but not on regular Google. Although Google supresses the phrase in the snippets it clearly still has it indexed. They likely have other purely IP based deals which aren't evident, and some places could have given them a different account name that this does not reveal.

This is also interesting from a cloaking perspective. Why not allow Google's spider's IP addresses in and then show the visitors that Google sends in a pay screen? Google does it for Scholar and News, so it clearly advocates this practice.

Brian M. [PersonRank 10]

17 years ago #

Just to see what happens, I created a web news alert for google-indexer. I hope it doesn't fill up my Gmail account. =)

Caleb E [PersonRank 10]

17 years ago #

I ran into a problem with this concept. I was looking for info on Latin (the language) for a reasearch paper and i got this:
http://tinyurl.com/e4o8n
if you click on the result itself you get a page askign you to buy the article for 12$ but if you click "view as html" you can see the whole thing for free

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!