A search on Google Scholar for, in quotes, "Google Indexer", reveals 310,000 results. Google has found a way into the deep web. |
Here's a better example. Search regular Google for, in quotes, "Institution: google-indexer". 37 million results. |
Hey Philipp. Sure – Google has made deals with all these websites whereas they grant Google's IP range an account, and allow Google to spider information that they don't allow casual surfers to access. Google uses this data to provide you results, but when you click the link you don't see the same data Google saw. You have to purchase an account at that website. |
Are these 310,000 deep web articles exclusively at http://scholar.google.com or also at http://www.google.com ? |
They appear to be indexed in both. Google seems to supress almost all of the "Google Indexer" phrases in the snippets on Scholar, but not on regular Google. Although Google supresses the phrase in the snippets it clearly still has it indexed. They likely have other purely IP based deals which aren't evident, and some places could have given them a different account name that this does not reveal.
This is also interesting from a cloaking perspective. Why not allow Google's spider's IP addresses in and then show the visitors that Google sends in a pay screen? Google does it for Scholar and News, so it clearly advocates this practice. |
Just to see what happens, I created a web news alert for google-indexer. I hope it doesn't fill up my Gmail account. =) |
I ran into a problem with this concept. I was looking for info on Latin (the language) for a reasearch paper and i got this:
http://tinyurl.com/e4o8n
if you click on the result itself you get a page askign you to buy the article for 12$ but if you click "view as html" you can see the whole thing for free |
