Monday, November 29, 2004

Blogger - software hell

We've had to restart the databases multiple times today because of server freezes. During the freezes, users would have encountered error pages when trying to access their blogs.

We're planning on a number of improvements this week to address this very serious situation. First, we will be pushing new code to both gather information on these freezes as well as revise some features to put less strain on the database. Second, we will be effectively doubling the number of machines used to handle the db workload.

Blogger is in flames. The status page is an impressive set of short reports, which are all variations on the theme of "we're doomed". Their shoving machines in and patching code on the fly, trying to figure out why their databases are going down several times a day.

I think they should shut down for a week and get some sleep.

No comments: