After 36 hours of almost everything going wrong that can go wrong, we're back ... hope you missed us :p
Here is what happened:
03.06 - 7:03 - After only 43 days of operation a brand new samsung spinpoint decides to lose sectors - the system decides to stop writing to it but remains mainly operational. This is the drive holding the operating system of the hardwarenode (HN) where gtv's virtual server (explained this before) runs on.
03.07. 17:32 - After actually standing up the guys from fragstore and I S.M.A.R.T.'ed around locating the problem - it is soon clear that that drive is gonna go to hell in a matter of hours.
04.07. 0:12 - Agreeing on the strategy of recovery with local support in the servercenter we decide to try to clone the (still readable) old drive sector by sector to a new one.
04.07. 5:36 - The system is responding to pings again with the old system on a new drive but doesnt boot properly anymore. A little investigation shows that from all the space this 320Gb drive had to offer, vital libs were fragged (including parts of the libc) - fucking unlucky :-(
*** The following 6 to 10 hours your average internet nerd will sleep ***
04.07. 9:48 - Weeeeeee, the gtv shirts are here - but SHAME ON YOU MR POSTMAN - YOU WOKE ME UP :-(
04.07. 14:12 - The operator advises us to have the OS completely reinstalled - out of other options and luck we agree.
04.07. 18:32 - The new OS is rolling - we still have to copy ~200Gb of data and configs from the old (broken) drive around.
04.07. 21:34 - We're all set, i shut the system down so the broken drive can be removed
*** Only having really slept 3 hours the day before, I go to bed again shortly after 12 ***
05.07. 14:30 - Omg I can log in to a fully operational hardwarenode - i start openvz and boot gtv ;-)
Generally a story about beeing out of any luck possible - thanks to the folks at fragstore who were ofc involved in the whole process ;-)
arni
Forum » About GamesTV » GamesTV Coverage » We're back in business
arni
|
We're back in business on
05.06.08 16:00
|
Anaconda
|
LOL :)
i really lolled at 9.48 xD and yes, we missed GTV :( |
blAckmAmbA
|
i cant live without you guyz! Yesterday i was extremly whining allover the day
nice to see GTV back! |
h3ll
|
Yes I missed GTV :X
lets hope the new drive will last longer than ..43.. days :X Anyway, well done and thx for bringing it back :p |
Brisk deleted his own post (05.06.08 21:08) |
ng
|
i'm ready for another 43 day ride. :-)
|
BaZ
|
A little late to reply but nice to see your back, appreciate the *free work* you Admins do here :)
|
foO |
I only missed Anaconda's avatar tbh !
|
This Thread is closed and cannot be commented on anymore. |