Kudos to all involved, he went farther than the 'first click free' and made it 4-5 clicks free which really has the searcher in mind as they may want to click through the site some more after hitting the landing page.

Now that they are in the clear, I think we can expect a definitive follow up by Matt on his blog or even an 'official' webmaster blogpost from Adam.

Cloakers beware!

(oh-oh! I said cloaking, now this will turn into a 100 comment thread of it's-cloaking vs. its-not-cloaking)

Sounds like a good plan :-). Let's hope it sticks.

Useless Updating.

As a test, I already downloaded 1697 pages from WMW this morning. I will wait the result if WMW give me the error page. Now, I did not find any error pages.

god help you Philipp if you had any ulterior motive or skin in the game of persuing Brett and WMW for this long length of time.

You too if you had any ulterior motive in posting that comment, Jersey ;)

This should apply to all newspapers.

Now, I downloaded 6460 pages at WMW, Still not find error pages.

"Hong Xiaowan
Now, I downloaded 6460 pages at WMW, Still not find error pages"

It's things like above that make Brett block users.

Now, the error pages works. Need I fake IP to test again? Useless.

Downloading form 03-07 05:45 to 03-08 01:13
Threads total 34607, Success download 7654, Total rate is 21.86%.
To success all 34607 threads, still need 3days and about 14 hours.

WMW seams not block my IP, just give me a rate to success the pages.
Rate 500 equal 100%, Thread and success are real amount in the per minute
http://hongxiaowan.googlepages.com/wmw.gif

Xiaowan, do you follow the robots.txt guidelines while screenscraping WMW? If not, I think it's unfair to Brett to do this.

This way that WMW did, really make many person interested in trying to research how to download pages from WMW.

I know, there were another 7 guys also researching now. I think there will be more persons join this senseless buy funny test.

If WMW opened all pages, they will lost interest and stop at once.

Dear Philipp Lenssen
Yes, I followed the robots.txt. And used real cookies. It is rule, and, I think I have rights to download the pages when I obeyed the rules.
Best regards.

User-agent: *
Disallow: /

Now I see the rules just. Means all bot not have rights to download pages.

Sorry, I not followed the rules. I use the bot and let bot followed the robots.txt. Something wrong. I am checking.

The logs said it followed the robots, there should be three robots files. The "enter letter" of first file is not realy "enter letter", then the robots follow the rules in other two files.

10:40:09 Warning: Link www.webmasterworld.com/profilev4.cgi?action= view&member=Mikevanh not scanned (follow robots meta tag)
10:41:38 Warning: Link www.webmasterworld.com/profilev4.cgi?action= view&member=Vahid not scanned (follow robots meta tag)

But this bot not followed all rules, that should have 17s for delay.

Excuse me. I now stop the botting and ask other guys stop downloading the pages cause WMW said they only allow four botting.

This thread made GBC(Google Blogoscoped in Chinese) down for a while per day.