OUTAGE (10/4/2009)

[MDGarcia]

We were down for approximately 7 hours, starting at 3:03am local time (PDT).

There was another emergency reboot of the web server.  This is being caused by the heavy use of the SQL server.  I'm looking into moving the SQL data off-server to another location to help keep the load off of washu.

Thanks for your patience.

MDg

[Miranda Fave]

Thanks for the heads up Mike.

[SLWalker]

Thanks, Mike.  Is it possible to move the SQL and still use Washu like that?

[MDGarcia]

Yeah, but it will most likely require a second server to be brought up and made public for SQL queries.  Honestly?  I kind of figured this would happen sooner or later, as the DB grows and accesses start contending for resources on the web server.  I was looking at our analytics, and we have pretty high visitor loyalty (highest I've ever seen on any website), 6+ pages per access, and since we started tracking this stuff, we've had 308+k pageviews.

We're growing!

MDg

[Miranda Fave]

Oh that's cool to hear about the having such a high visitor loyalty! How very nice. All down to Steff and yourself creating and fixing an awesome site. Many thanks again.

[PSGarak]

At least the reason for the outage is a good reason! That's awesome that we're getting the traffic.

[kes7]

I don't understand what any of that means, but it sounds like it's good .... so keep up the great work on this amazing site!

[MDGarcia]

As an update, I made some configuration changes to SQL and this seems to no longer be a problem.  I'm limiting the memory overhead for SQL to prevent it from running away with the server.

MDg