Google Blogoscoped

Forum

Google NOW Crawls Forms & Dropdowns  (View post)

* Miss UNIVERSE [PersonRank 7]

Friday, April 11, 2008
3 months ago1,122 views


However, it is only for a small number of 'high quality sites'

mattcutts.com/blog/solved-anot ...

Uri Lederman [PersonRank 1]

3 months ago #

I was under the impression that they always did???

I mean, as long as the dropdown takes you somewhere??

Ionut Alex. Chitu [PersonRank 10]

3 months ago #

* Miss UNIVERSE, previously known as Search-Engines-Web.com?

Above 3 comments were made in the forum before this was blogged,
below comments were made afterwards.

/pd [PersonRank 10]

3 months ago #

another way to pollute the index.. think of a nice legit looking site with the drop downs being sent to a host of urls that a hosts spam type of porn sites..

"it’s less about crawling search results and more about discovering new links."

likewise its good tool for SEO/SEM to "abuse" this feature too..

Mambo [PersonRank 10]

3 months ago #

<< I mean, as long as the dropdown takes you somewhere?? >>

That's more of a JS issue, rather than a form. You could use an onchange to make the drop-down menu do something once it has been selected.

TOMHTML [PersonRank 10]

3 months ago #

Google understands JavaScript since many years ago. Googlebot is able to read URL, even exploded in different variables, in javascript code. Many studies have shown that.

Submitting forms is just the following step.

Zim [PersonRank 10]

3 months ago #

I thought they were already doing this. When you search for some terms, you find spammy results. Say... "wav encoder". You get many results. One of the first I get is from a page called brothersoft.


img398.imageshack.us/img398/80 ...


If you look, it says "Software Search For wav encoder"
I've seen results like this since a lot of time.
Off-Topic: I tried (but failed) to do a custom search avoiding this kind of sites (like softpedia and other sites I really hate). If someone has ideas to create something like this, please tell me!

Eugene Villar [PersonRank 3]

3 months ago #

[put at-character here]Zim, it could be spam, or then again, it could be someone just doing a direct link to the search results page that are not robot excluded.

Alex [PersonRank 0]

3 months ago #

There is a lot of data hidden behind query forms. For example the addresses of UK train stations, time tables and other such stuff.

Ionut Alex. Chitu [PersonRank 10]

3 months ago #

<<it could be someone just doing a direct link to the search results page>>

Look at the links from the top of the Brothersoft page and the list of related searches.

Roger Browne [PersonRank 10]

3 months ago #

Google is only crawling "GET" forms. That makes sense. A "GET" form is likely to lead to an indexable page, whereas a "POST" form is likely to be carrying out some action before displaying the results of that action.

On the other hand, if a site publishes a sitemap, there should be no reason for Google to submit forms, because the sitemap should lead to all the pages that the site wants crawled.

Philipp Lenssen [PersonRank 10]

3 months ago #

> Google understands JavaScript since many years ago.

Thanks Tom for the correction. I updated the article.

This thread is locked as it's old... but you can create a new thread in the forum. 

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement (advertise here?) Find the right keywords for your campaigns at KeywordDiscovery.com Google Apps Hacks (book)

 

This site unofficially covers Google™ and more with some rights reserved. You can subscribe to the feed, email your tips and join our forum!