Go Back  Bike Forums > Bike Forums > Touring
Reload this Page >

Crazyguyonabike server crash

Notices
Touring Have a dream to ride a bike across your state, across the country, or around the world? Self-contained or fully supported? Trade ideas, adventures, and more in our bicycle touring forum.

Crazyguyonabike server crash

Old 06-20-09, 12:00 PM
  #1  
Crazyguyonabike
Thread Starter
 
Join Date: Nov 2003
Location: Lebanon, OR
Posts: 697

Bikes: Co-Motion Divide

Mentioned: 1 Post(s)
Tagged: 0 Thread(s)
Quoted: 35 Post(s)
Likes: 0
Liked 3 Times in 2 Posts
Crazyguyonabike server crash

Hi all,

There seems to have been some kind of hardware failure on the crazyguyonabike server. I got up this morning to find a read-only filesystem which pretty much stops me from doing anything. There are some clues in the logs which would seem to point to something in the RAID or disk controller, or perhaps one or more hard drives. I have put a message in to our hosting company to ask when they can look at this. Since it's the weekend (of course) it's possible that it might be Monday before anything really gets done, but I'll post updates here if I hear anything.

Neil
NeilGunton is offline  
Old 06-20-09, 12:14 PM
  #2  
Newbie
 
AKTed's Avatar
 
Join Date: Jun 2005
Location: Michigan/Alaska
Posts: 46

Bikes: Norther Lyon, Ritchey Ti Cross Breakaway, Gunnar Sport, Santa Cruz Chameleon, Salsa Beargrease, Santana Arriva, 907 Fatbike, Airborne Lucky Strike, Surly LHT

Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 2 Post(s)
Likes: 0
Liked 0 Times in 0 Posts
Thanks Neil for the update. Hope it gets sorted out sooner rather than later. I just finished an 8-day tour here in Alaska with my son, and was looking to get caught up with a few tour logs I'm following.

Ted
AKTed is offline  
Old 06-20-09, 12:47 PM
  #3  
Senior Member
 
Join Date: May 2009
Posts: 53
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Likes: 0
Liked 0 Times in 0 Posts
Will all the journals, forum posts etc still be there when the problem is worked out?
johndavis is offline  
Old 06-20-09, 12:56 PM
  #4  
Galveston County Texas
 
10 Wheels's Avatar
 
Join Date: Nov 2007
Location: In The Wind
Posts: 33,221

Bikes: 02 GTO, 2011 Magnum

Mentioned: 18 Post(s)
Tagged: 0 Thread(s)
Quoted: 1346 Post(s)
Liked 1,236 Times in 617 Posts
Ken Payton put so many miles on it it crashed
__________________
Fred "The Real Fred"

10 Wheels is offline  
Old 06-20-09, 01:00 PM
  #5  
Crazyguyonabike
Thread Starter
 
Join Date: Nov 2003
Location: Lebanon, OR
Posts: 697

Bikes: Co-Motion Divide

Mentioned: 1 Post(s)
Tagged: 0 Thread(s)
Quoted: 35 Post(s)
Likes: 0
Liked 3 Times in 2 Posts
Originally Posted by johndavis
Will all the journals, forum posts etc still be there when the problem is worked out?
I use MySQL database replication to instantaneously copy updates from the main server in Vegas to two remote computers (one server hosted in Canada, and my home workstation in California). Also, pics (which aren't stored in the MySQL database) are mirrored via a separate cronjob every minute. All data is also separately backed up to an external hard drive here at home. There are also other external hard drives which are backed up to weekly and stored in a firesafe. So even if a complete hardware failure should completely wipe out the server in Vegas, we should have multiple versions of the data in distributed geographical locations. Usually we should be looking at zero data loss, or at worst a minute's worth of pic updates.

So while the data might not still be there on the server's hard drives, it is restorable from elsewhere, probably up-to-the-minute or better.

This doesn't say how long it'll take to bring the server back up, of course - but the data itself should be ok.

Neil

Last edited by NeilGunton; 06-20-09 at 05:17 PM. Reason: typo
NeilGunton is offline  
Old 06-20-09, 01:02 PM
  #6  
Crazyguyonabike
Thread Starter
 
Join Date: Nov 2003
Location: Lebanon, OR
Posts: 697

Bikes: Co-Motion Divide

Mentioned: 1 Post(s)
Tagged: 0 Thread(s)
Quoted: 35 Post(s)
Likes: 0
Liked 3 Times in 2 Posts
Originally Posted by 10 Wheels
Ken Payton put so many miles on it it crashed
See my reply above - "crashed" does not mean "lost". Hardware crashes; you can't do anything about that, and I currently cannot afford to run multiple hot spares. However you can take steps to make sure the data is safe in the event of a hardware failure, and this I believe I have done. So Ken's journal (and everyone else's) will be just fine.

Of course, I apologise to all for the downtime.

Neil
NeilGunton is offline  
Old 06-20-09, 01:29 PM
  #7  
Senior Member
 
jmio's Avatar
 
Join Date: Sep 2008
Location: Tulsa, Oklahoma
Posts: 611

Bikes: raleigh carbon competition, trek 6500 hardtail

Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Likes: 0
Liked 0 Times in 0 Posts
i think that was a joke^^^^^^^^^^^^^
jmio is offline  
Old 06-20-09, 04:51 PM
  #8  
Crazyguyonabike
Thread Starter
 
Join Date: Nov 2003
Location: Lebanon, OR
Posts: 697

Bikes: Co-Motion Divide

Mentioned: 1 Post(s)
Tagged: 0 Thread(s)
Quoted: 35 Post(s)
Likes: 0
Liked 3 Times in 2 Posts
The server is back up again. It appears to have been some kind of hiccup with the RAID controller losing the connection with one of the drives, rather than an actual hardware failure. I have posted a thread with more of a possible explanation (from the guy who built the server and runs the hosting company where it is currently colocated) on crazyguyonabike.

https://www.crazyguyonabike.com/forum...read_id=124235

Neil
NeilGunton is offline  
Old 06-20-09, 08:46 PM
  #9  
Older than dirt
 
CCrew's Avatar
 
Join Date: May 2008
Location: Winchester, VA
Posts: 5,342

Bikes: Too darn many.. latest count is 11

Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 1 Post(s)
Likes: 0
Liked 2 Times in 2 Posts
Originally Posted by NeilGunton
some kind of hiccup with the RAID controller losing the connection with one of the drives
Thought that was the purpose of RAID..so if a drive died it kept running.. But I only do it for a living so what do I know
CCrew is offline  
Old 06-20-09, 09:09 PM
  #10  
Senior Member
 
Join Date: Apr 2009
Posts: 119
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Likes: 0
Liked 0 Times in 0 Posts
well, that would depend upon the raid.

i would question the controller or interface (backplane, cable, etc.).
jgsatl is offline  
Old 06-20-09, 10:19 PM
  #11  
Crazyguyonabike
Thread Starter
 
Join Date: Nov 2003
Location: Lebanon, OR
Posts: 697

Bikes: Co-Motion Divide

Mentioned: 1 Post(s)
Tagged: 0 Thread(s)
Quoted: 35 Post(s)
Likes: 0
Liked 3 Times in 2 Posts
Originally Posted by CCrew
Thought that was the purpose of RAID..so if a drive died it kept running.. But I only do it for a living so what do I know
See my post over on the crazyguyonabike thread for a possible explanation from Rob Tyree.
NeilGunton is offline  
Old 06-21-09, 01:03 AM
  #12  
Day trip lover
 
mr geeker's Avatar
 
Join Date: May 2009
Location: capital city of iowa
Posts: 814

Bikes: '16 Giant Escape 3 (fair weather ride), Giant Quasar (work in progress), 2002 saturn vue (crap weather ride)

Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 21 Post(s)
Likes: 0
Liked 0 Times in 0 Posts
i noticed it went down, it happend while i was reading one of the journals "Around the united states on a budget".
mr geeker is offline  
Old 06-21-09, 07:00 PM
  #13  
Senior Member
 
Join Date: Aug 2008
Posts: 93
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Likes: 0
Liked 0 Times in 0 Posts
Best of luck and thanks for the great site!
IvanK- is offline  
Old 06-22-09, 05:47 AM
  #14  
Older than dirt
 
CCrew's Avatar
 
Join Date: May 2008
Location: Winchester, VA
Posts: 5,342

Bikes: Too darn many.. latest count is 11

Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 1 Post(s)
Likes: 0
Liked 2 Times in 2 Posts
Originally Posted by jgsatl
well, that would depend upon the raid.

i would question the controller or interface (backplane, cable, etc.).
I guess I'm too used to top end stuff where you can snatch a drive out on the fly

But we only see 20mil so a day users, so they're not stressed much
CCrew is offline  

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Thread Tools
Search this Thread

Contact Us - Archive - Advertising - Cookie Policy - Privacy Statement - Terms of Service -

Copyright © 2024 MH Sub I, LLC dba Internet Brands. All rights reserved. Use of this site indicates your consent to the Terms of Use.