Disk Crash
log in

Advanced search

Message boards : News : Disk Crash

Author Message
Profile Kevin
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Avatar
Send message
Joined: 27 Jul 12
Posts: 507
Credit: 14,344,251
RAC: 1,489
Message 1086 - Posted: 27 Jan 2013, 9:23:14 UTC

Well the load got to the system and crashed the disk on the main server. I use GlusterFS to replicate the disk live, just in case - so I was able to recover pretty much everything. I'll be sending the logs to the GlusterFS community so they can see if they can see what happened. It looks to be like the load just got too much and the FS started to miss blocks.

Whilst the disk rebuilt, I upgrade the two server from an AWS m1.small instance to a c1.medium so I can cope with more load (I hope).

Thanks for you patience.
____________
Regards
Kevin
-----
International Centre for Radio Astronomy Research

Profile StephenD
Send message
Joined: 1 Aug 12
Posts: 2
Credit: 5,220,144
RAC: 0
Message 1098 - Posted: 28 Jan 2013, 4:01:47 UTC

That was a fantastic recovery operation and to boot increased capacity. Good work!
Looks like the number crunching has indeed increased almost exponentially in the last few days!


KUDOS to the POGS Team

Stephen D Green
North Saanich, BC, Canada

Message boards : News : Disk Crash


Main page · Your account · Message boards


Copyright © 2017 The International Centre for Radio Astronomy Research