Something's very wrong with either my site or googlebot. I am currently getting over 20.000 hits a day from googlebot on the forums of SPi-V dev, the (drupal based) developers resource for all thing SPi-V.
The urls that are getting hammered like this all have a strange double PHPSESSID, eg:
66.249.65.43 - - [24/Aug/2005:03:43:09 +0200] " GET /spv-dev/forum/21?sort=asc&order=Created&from=25& PHPSESSID=d189b62c250d354a12fb509a2769592a& PHPSESSID=a8be7921586fa24d59fc9f352379e8c9 HTTP/1.1" 200 7523 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Very odd..
Update: Yesterday, googlebot reached up to about 35.000 hits. Almost all of them had the weird double PHPSESSID. Is googlebot indexing in an infinite loop, getting new PHPSESSIDs every time and thinking it's a new page?
I have found this post on Drupal.org and have now turned off PHP's session handling for SPi-V dev. I will see if that puts googlebot at ease.
Another update: After three more days of googlebot DoS-ing SPi-V dev (with up to 40.000 hits a day), googlebot now seems to be done with the site. Not sure if it has anything to do with me turning off the PHPSESSID thing...