Google Blogoscoped

Forum

Omgili, Discussion Forum Search  (View post)

Brian Mingus [PersonRank 10]

Monday, January 9, 2006
3 years ago

They are doing some custom scraping. I know this because the SDMB (site:boards.straightdope.com) has blocked spiders, yet they have it indexed.

/pd [PersonRank 10]

3 years ago #

its does not accept url's as a search term and parsed out the periods within a url to concat seperate search word(s).

This thread is locked as it's old... but you can create a new thread in the forum. 

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement (advertise here?)
Books about Google on Amazon

 

This site unofficially covers Google™ and more with some rights reserved. You can subscribe to the feed, email your tips and join our forum!