Sourcefinder Beta - Attempt 2
log in

Advanced search

Message boards : News : Sourcefinder Beta - Attempt 2

Author Message
Profile sam6321
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 11 Dec 14
Posts: 50
Credit: 701,666
RAC: 2,147
Message 5124 - Posted: 9 Feb 2017, 7:33:42 UTC

Hi Everyone,

Earlier today we were having some issues with the hard disk size of the sourcefinder server. While I was attempting to increase the disk size, I accidentally terminated the amazon instance causing the server to be destroyed.

After a large amount of facepalming and re-installing, the server is back up with a larger hard disk at the following address: http://54.196.169.236/duchamp/.

Unfortunately all of the forum posts have been deleted along with the server, and there may be a few latent setup issues that I haven't addressed quite yet.

Before accidentally destroying everything, I did copy off some of the bug reports that people had already made in to a Trello board. This board will store all of the current issues that I'm investigating, so you can all keep track of what I'm doing. https://trello.com/b/Y3XkcXMJ/sourcefinder-public. Once I've read a bug report on the forums, I'll update that board with the relevant details and get to work on fixing it.

I also plan on posting a weekly changelog of everything I've managed to fix so far.

I'm uploading a 30GB packet of work units to the server for everyone to work on. I'll get them sent the moment I can.

I'm truly sorry about all of this, and I hope everyone will still be happy enough to participate in sourcefinder.

Sam

Dave Peachey
Send message
Joined: 18 Nov 16
Posts: 2
Credit: 2,446,446
RAC: 9,151
Message 5125 - Posted: 9 Feb 2017, 10:22:30 UTC - in response to Message 5124.
Last modified: 9 Feb 2017, 10:24:37 UTC

Sam,

I'm assuming that the change of IP address for the Sourcefinder server means that we'll have to reattach the project in the BOINC Manager (with the new IP address) and create a new account as well (I tried to log in on the new server with my details from the previous IP address but I get a "No such account" message).

Dave

MechanoRealist
Send message
Joined: 12 Jun 15
Posts: 1
Credit: 522,010
RAC: 227
Message 5126 - Posted: 9 Feb 2017, 10:41:10 UTC - in response to Message 5124.

Yes, lol everything got wiped. Had to recreate my account. xD
~Eagerly awaits continuation~

Profile sam6321
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 11 Dec 14
Posts: 50
Credit: 701,666
RAC: 2,147
Message 5127 - Posted: 9 Feb 2017, 22:51:06 UTC - in response to Message 5125.

Yep that's right, everyone needs to re-create their accounts and re-attach :(

richhaynes
Send message
Joined: 23 Jul 13
Posts: 1
Credit: 1,770
RAC: 0
Message 5129 - Posted: 13 Feb 2017, 11:57:28 UTC - in response to Message 5127.

Yep that's right, everyone needs to re-create their accounts and re-attach :(


Hi Sam,

Not like I should to tell you what to do but my number one rule on server administration is:

Never set up a server without the backup plan in place first!

I know from experience that cloud services are a nightmare as one click of a button can destroy weeks of work :/ I had a colleague delete our IP address from our VPS and I spent hours checking every piece of config on the server. Now I leave the config until after I check out the VPS control panel!

Even then, a simple mistake by someone else can cause the same problems. It happened the last time I had a server disaster as the host used a buggy script and wiped my server from existence! (quote: "an error made during maintenance 'effectively deleted' what was on some of its servers" http://www.bbc.co.uk/news/technology-36072240)

Luckily I had my backups in place this time so I only lost 4 hours of forum comments, uploads and accounts. One piece of database advice I can give is set up a replicate db server as when failure occurs, replicating this back to your recovered server is so easy! (unless its MSSQL...)

The only concern for you I would have is the cost of backing up 1TB+ of data. My backups came in around 80GB so cost was low. Oh, and have more than one backup! Encrypt a copy and store on a drive at home. As long as its strong encryption, you shouldnt have any Data Protection issues here in the UK :)

Profile sam6321
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Send message
Joined: 11 Dec 14
Posts: 50
Credit: 701,666
RAC: 2,147
Message 5131 - Posted: 14 Feb 2017, 0:10:22 UTC - in response to Message 5129.

Yeah a backup of the database would've been a good idea, that was the worst thing to lose.
Luckily I built setup scripts for the main server installation, which makes that part pretty fast.

Matt
Send message
Joined: 26 Sep 13
Posts: 22
Credit: 1,077,861
RAC: 37
Message 5133 - Posted: 18 Feb 2017, 17:57:30 UTC - in response to Message 5124.

It's cool, don't be afraid to admit to mistakes. It's any attempt at cover up the people resent.

Matt
Send message
Joined: 26 Sep 13
Posts: 22
Credit: 1,077,861
RAC: 37
Message 5151 - Posted: 3 Mar 2017, 19:59:33 UTC

Anyone else have a funny story about data loss? Suggestions or help or advice?
Funny stories mostly... C'mon support the guy!

Anon
Send message
Joined: 20 Nov 14
Posts: 4
Credit: 31,201,440
RAC: 49,904
Message 5152 - Posted: 17 Mar 2017, 13:55:48 UTC - in response to Message 5151.

Yep.
In the big picture loosing a server doesn't even register as an ink blot. It's repairable.
Rendering our planet unfit for human habitation isn't.
It's not like you're having to deal with the intelligence level of the President of the United States of America here.
Keep doing what you're doing please.
Cheers from Oz.


Post to thread

Message boards : News : Sourcefinder Beta - Attempt 2


Main page · Your account · Message boards


Copyright © 2017 The International Centre for Radio Astronomy Research