Outage today - resolved

Rod · Jan 22, 2014

This morning we experienced a hardware failure on the server. This resulted in the server shutting down ungracefully, thus corrupting the databases. The hardware was fixed within 30 min, however the databases remained corrupted. The first attempt was to restore to this mornings backup, however that too was corrupt (it was too close to the point at which the server began failing).

We have restored to our Jan 20 backup, and all seems well. I never like to lose data, however when trying to preserve 14 years worth of memories, 2 days is a small price to pay.

So far it seems everything is now stable. Please let me know if anything odd occurs.

Thank you, and I apologize for the downtime and lost data.

Best,
Rod

thinde · Jan 22, 2014

Shat happens. Thanks for all the effort you put into the site.

whylieineedacigar · Jan 22, 2014

thinde said:
Shat happens. Thanks for all the effort you put into the site.

X2

extremeXconcepts · Jan 22, 2014

No worries, thanks for getting this back up and running.

Tall Paul · Jan 22, 2014

Any way to recover a review I posted?

Rod · Jan 22, 2014

I have an offsite backup from last night which is really a DR backup and would be a pain in the ass to restore. Let me see what I can do Paul. I might be able to restore it to another server and send you the review.

Tall Paul · Jan 23, 2014

It was is the blind review thread. Thanks Rod

broblues · Jan 23, 2014

Damn computers. :laugh:

bfreebern · Jan 23, 2014

Great, there goes my post count!

Thanks Rod for all the hard work.

grateful1 · Jan 23, 2014

Rod said:
I have an offsite backup from last night which is really a DR backup and would be a pain in the ass to restore. Let me see what I can do Paul. I might be able to restore it to another server and send you the review.

Can you make it like he never happened!?

Mrepp · Jan 23, 2014

grateful1 said:
Can you make it like he never happened!?

yeah Gary suddenly lost 200 off his post count

tone-ny · Jan 23, 2014

Thanks Rod for keeping us up and running.

Bayamos · Jan 23, 2014

My post of Gary's favorite barnyard animals is gone! How lucky can one guy get............

emoshun · Jan 23, 2014

We're still hacked, or at least new visitors will be scalped on first click through after finding us via a search engine.

emoshun · Jan 23, 2014

https://www.dropbox.com/s/2p5t3euzjwuh4ca/cp_hacked.mov

Rod · Jan 23, 2014

Thanks for the info Jimmy. That's a whole different issue. Working on it now.

emoshun · Jan 23, 2014

Thanks for all the hard work Rod! :thumbs:

Bayamos · Jan 23, 2014

Thanks for all you do Rod.

Rod · Jan 23, 2014

Jimmy - it should be fixed now. 4 1/2 hours later ... I scanned the entire database and cleaned up some entries, and removed a skin. Most time was spent reverse engineering how the forum writes data. Let me know if you see any further issues. Thanks.

emoshun · Jan 23, 2014

Will check tomorrow but from what I am see at home we're good.

Outage today - resolved

Administrator

Lobstah; the other white meat!

Yolalatlpwry

eXtreme Concepts

"insecure little bitch"

Administrator

"insecure little bitch"

planning and plotting

Yada, Yada, Yada.

Oh My!

To boldly troll where no Troll has trolled before

I smoke therefore I am!

You reap what you sow...

SoCal Herfin'

SoCal Herfin'

Administrator

SoCal Herfin'

You reap what you sow...

Administrator

SoCal Herfin'