Google Blogoscoped

Forum

Google live search

David Mulder [PersonRank 10]

Monday, September 14, 2009
14 years ago3,576 views

http://www.greatslovakia.com/GoogleLive/

Really worth checking out project I did based on the recent search functionality... if google would release something like this it would probably be the end for twitter search :)

Before opening, pls one REQUEST:
   On the server I have hosted this script another of my services is hosted which tends to be pretty heavy (in the sense of generating about 100.000 images a month and opening about an equal amount)... so could you please try it out twice or thrice and then only use it for practical reasons. And also because I don't want to get blocked for being a scraper/bot too soon.

David Mulder [PersonRank 10]

14 years ago #

Unbelievable... for some reason after working once it now stopped working giving me a "Your client does not have permission to get URL /search?q=politics&tbs=qdr:s120,sbd:1 from this server. (Client IP address: 65.60.25.34)" message. Check out locally for the next few hours at http://85.223.0.116/Projects/GoogleLive/

Philipp Lenssen [PersonRank 10]

14 years ago #

I can't connect to the IP (getting a time out), but that may be a thing from China. Let us know when you got it up and running pls!

toml [PersonRank 6]

14 years ago #

http://www.google.pl/search?as_q=dobreprogramy&hl=pl&num=50&btnG=Szukaj+w+Google&as_epq=&as_oq=&as_eq=&lr=&cr=&as_ft=i&as_filetype=&as_qdr=s300&as_occt=any&as_dt=i&as_sitesearch=&as_rights=&safe=images

This link is from last 300 seconds

David Mulder [PersonRank 10]

14 years ago #

After quite a number of hours I finally created a solution to the problem... wouldn't say its the neatest solution... but still it ok I guess. Namely the client – you – will act as a proxy through a greasemonkey script or firefox add-on. Check out the homepage (http://www.greatslovakia.com/GoogleLive/?q=Politics) to see the instructions and test it out for yourself. Its working perfectly now I think.

Philipp Lenssen [PersonRank 10]

14 years ago #

The Firefox add on (XPI) does not install automatically in any way when I click on it. Is it possible to fix that?

Philipp Lenssen [PersonRank 10]

14 years ago #

By the way, can't you use Google's own screenscraper, as part of their googlemodules framework? They basically have their own proxy allowing you to grab external pages, so you could perhaps screenscrape Google results using that proxy.

For instance, the following iGoogle script screenscrapes the Blogoscoped Forum homepage and displays the the thread titles:

http://blogoscoped.com/homepage/fetch-test.xml

For more see http://code.google.com/apis/gadgets/docs/remote-content.html

David Mulder [PersonRank 10]

14 years ago #

[put at-character here]Philipp Lenssen: About the first thing, yeah I realized that... but I had no clue why it was happening... and I am so used to xpi's in general that without a thought I downloaded the file and dragged it unto firefox (allowing me to install it), not realizing that may be a pretty strange thing to do for somebody in general. Secondly, about the module api... can't that one only really be used inside modules...? Still I don't really think I will spent any real time on this anymore, as till now I had no positive feedback at all... I may still release the code for the 'local' version and solve the xpi thing, but that's about it.

Philipp Lenssen [PersonRank 10]

14 years ago #

You can embed modules on your own site, so it should work seamlessly outside iGoogle, I suppose. Worth a test!

Just tried your Live search using the XPI-onto-Firefox-dragging. Works nicely!

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!