Back in 2005, SearchBistro.com already discovered information on Google’s quality raters. Note besides quality raters, Google also has trusted testers, but those are different job roles – and the latter is unpaid, last thing I heard.
Quality raters use the evaluation system EWOQ, logging in with their approved Gmail account. (If I understand it right, this system is part of a larger “Rater Hub” homepage. Note none of the two previous links should work for you unless you’re a rater, I’m just including them for reference.) If you want to work in quality evaluation, a Google job page states, you need to have in-depth, “up-to-date familiarity with English-speaking web culture and media,” as well as a broad ranges of interests and strong web research skills.
The quality rating options for a specific URL are: vital, useful, relevant, not relevant, off-topic, didn’t load, foreign language, and unratable. Also, a URL can be flagged as not spam, maybe spam, or spam, and malicious or pornography. We have reason to believe the feedback given by quality raters is then incorporated into the algorithms by Google engineers, or helps deciding with which fine-tuned variant of the algorithms to proceed. (Google once told people their results are “completely objectively,” “completely automated” and “independent of the beliefs” of people working at Google, but they since revised many occurrences of such wording on their help pages.)
As before, queries are grouped into the types navigational (when a user just wants to locate a specific webpage they have in mind, e.g. typing [ibm]), informational (when someone researches a topic to find out more about something, e.g. querying for [tsunami]), and transactional (when the user wants to buy something or download something or is looking for some other type of resource, as opposed to information, e.g. for a query like [download adobe reader]). These types are not mutually exclusive; Google lists the query ["ipod nano"] as an example of something which is navigational (going to the product page), informational (reading a review or info on the product page), as well as transactional (perhaps purchasing the product).
Update: Yeah, the document is authentic, I just received further confirmation.
*Edit: The document at vizualbod.com/f/spam-guidelines.htm has been removed by now so I removed the link, though the file is still circulating online in different places in both HTML and PDF versions.
>> More posts