Media conglomerate News Corp. partial holdings include many newspapers along with the Fox cable news channel. The Wall Street Journal is one of those newspapers. News Corp's chairman Rupert Murdoch's rhetoric has indicated he does not want Google to index those sites. He has not used robots.txt or other technical means to achieve that.

In The New York Times, Eric Pfanner analyzes who needs whom.

http://www.nytimes.com/2009/11/30/business/media/30iht-cache30.html

Being discussed here: http://blogoscoped.com/forum/163788.html