Google Blogoscoped

Forum

Google Sitemaps: choose your crawling speed

Oscar Riera [PersonRank 1]

Monday, September 18, 2006
17 years ago3,070 views

I've posted this myself to the Telendro website (http://telendro.com.es/2006/09/18/velocidad-de-rastreo-en-sitemaps-de-google/) -well, I just sent the screen capture), but as I've not seen this at any English blog, I thought it could be of your interest (and sorry for that bit of self promotion).

Basically, Sitemaps has an alpha feature which lets you choose your desired crawling speed: low, medium, high....

It seems, really, more serious than those old revisit meta tags.

All the best

Oscar

[Fixed link – Tony]

Sohil [PersonRank 10]

17 years ago #

Coooooooooooool.

Sorry, this is awesome.

What was it, before Google offered this option ?

Sohil [PersonRank 10]

17 years ago #

Er, the link you provided is a 404

/pd [PersonRank 10]

17 years ago #

http://google-code-updates.blogspot.com/2006/09/sitemaps-in-django.html

TOMHTML [PersonRank 10]

17 years ago #

In the url you have the word "crawlrate" ? ;)

Tony Ruscoe [PersonRank 10]

17 years ago #

Another post about this, in English, here:

http://www.bigmouthmedia.com/live/articles/crawl-control--google-sitemap-crawl-rate-control.asp

<< We are testing an alpha version of our new tool with a small percentage of webmasters who use Sitemaps. You should leave this control at the Normal setting unless you are having trouble with the speed at which Googlebot is crawling your server.

Simply select the rate at which you would like the Googlebot to crawl your server and click save. During this stage of testing, we will evaluate requests to determine the best way of using this data and providing this tool to everyone. >>

Oscar Riera [PersonRank 1]

17 years ago #

Hi all,

Mmm... Google and my life weare/are really the same, but simply I needed a big website to get indexed and "hooop", this option magically appears on its account. Worth trying it don't you think?

404 Error. remove the ")" at the end.

Yes, the URL looks like: http: // www.google.com/ webmasters/sitemaps/crawlrate? siteUrl=http:example.com

And thanks to al for the English links!

TOMHTML [PersonRank 10]

17 years ago #

Doesn't work for me
need the new version!!!

Forum home

Advertisement

 
Blog  |  Forum     more >> Archive | Feed | Google's blogs | About
Advertisement

 

This site unofficially covers Google™ and more with some rights reserved. Join our forum!