Cycling and bicycle discussion forums. 
   Click here to join our community Log in to access your Control Panel  


Go Back   > >

Forum Suggestions & User Assistance Have a suggestion for the forums? Need help with the Forums? Post here.

User Tag List

Reply
 
Thread Tools Search this Thread
Old 11-28-06, 02:17 AM   #1
HostGeekZ
Member
Thread Starter
 
Join Date: Jul 2006
Bikes:
Posts: 36
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Forums

The forums are now back online and should be working correctly for the most part.

There does appear to be some missing threads towards the end of the table which we are unable to recover due to the way it has repaired.

Whilst repairing the table the database server kernel paniced which corrupted the thread and user tables. The temporary data files were so corrupt that they infact were reading 16tb in disk usage(incorrect), we have recovered these and the only things that appear to be missing is some newer threads, instead of restoring a backup from yesterday this seems the best course of action to sustain.

However due to the consistant kernel panics the database server encounters we are deciding on what to do about it, we do however have the kernel panic and have repaired the main cause of that now.

Apologises for the extended downtime however we could not have prevented it.

-Scott
HostGeekZ is offline   Reply With Quote
Old 11-28-06, 04:52 AM   #2
Siu Blue Wind
Flowers for mom
 
Siu Blue Wind's Avatar
 
Join Date: Apr 2005
Bikes:
Posts: 10,978
Mentioned: 3 Post(s)
Tagged: 0 Thread(s)
Quoted: 101 Post(s)
Scott, I did not understand a word you just said but thank you to you and Joe anyway.
__________________
Quote:
Originally Posted by Buddha
We are what we think. All that we are arises with our thoughts. With our thoughts, we make the world.
Quote:
Originally Posted by making View Post
Please dont outsmart the censor. That is a very expensive censor and every time one of you guys outsmart it it makes someone at the home office feel bad. We dont wanna do that. So dont cleverly disguise bad words.
Siu Blue Wind is offline   Reply With Quote
Old 11-28-06, 05:10 AM   #3
Stacey
Non Tribuo Anus Rodentum and off to the next adventure (RIP)
 
Stacey's Avatar
 
Join Date: Dec 2002
Bikes:
Posts: 9,161
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
He said that the kernel (Colonel?) is prone to anexiety attacks and needs the help of a good psycartrist
__________________
Stacey is offline   Reply With Quote
Old 11-28-06, 05:35 AM   #4
DannoXYZ 
Senior Member
 
DannoXYZ's Avatar
 
Join Date: Jul 2005
Location: Saratoga, CA
Bikes:
Posts: 11,606
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 3 Post(s)
Good job guys! I think we should line up an alternate supplier of chickens so that the Colonel doesn't panic when the supply gets low...
DannoXYZ is offline   Reply With Quote
Old 11-28-06, 05:49 AM   #5
linux_author
370H-SSV-0773H
 
linux_author's Avatar
 
Join Date: May 2005
Location: Penniless Park, Fla.
Bikes: Merlin Fortius, Specialized Crossroads & Rockhopper, Serotta Fierte, Pedal Force RS2
Posts: 2,750
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
http://www.linux-ha.org/
linux_author is offline   Reply With Quote
Old 11-28-06, 07:53 AM   #6
RoadToad
Flatman
 
RoadToad's Avatar
 
Join Date: Jun 2004
Location: Texas
Bikes: Giant TCR2
Posts: 912
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
huh?
RoadToad is offline   Reply With Quote
Old 11-28-06, 09:05 AM   #7
Air
Destroyer of Wheels
 
Air's Avatar
 
Join Date: May 2006
Location: Creating some FA-Qs
Bikes: Nishiki Sport, Downtube IXNS, 1950's MMB3 Russian Folding Bike, MTB
Posts: 3,598
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Someone feed that man a chicken!

Great job guys, thannks!
__________________
The Almighty Clyde FAQ || Northeast Index
eTrex Vista References || Road Reference


It's the year of the enema!
Air is offline   Reply With Quote
Old 11-28-06, 10:48 AM   #8
Fritz_S
HEY! I'm talkin' to YOU!
 
Fritz_S's Avatar
 
Join Date: Nov 2006
Location: Sunnyvale, CA (Silicon Valley)
Bikes: Trek 7.5/FX 2006, 1980's Specialized Allez
Posts: 45
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Any hope at all that more of the lost recent threads will be restored? I am a junior member, so 1/2 of my subscribed threads, and 3/4 of my postings are GONE! I may never forget how to ride a bike, but I might forget (for example) where that advice on fitting a saddle went. (whine, ..whinge, ..., whimper, ...) -- but THANKS to the heroic IT folks for all they could save!!
Fritz_S is offline   Reply With Quote
Old 11-28-06, 01:48 PM   #9
Machka 
Long Distance Cyclist
 
Machka's Avatar
 
Join Date: Jan 2003
Location: I ride where the thylacine roamed!
Bikes: Lots
Posts: 46,237
Mentioned: 19 Post(s)
Tagged: 0 Thread(s)
Quoted: 336 Post(s)
Quote:
Originally Posted by HostGeekZ
The forums are now back online and should be working correctly for the most part.

There does appear to be some missing threads towards the end of the table which we are unable to recover due to the way it has repaired.

we have recovered these and the only things that appear to be missing is some newer threads, instead of restoring a backup from yesterday this seems the best course of action to sustain.

Newer threads .... like everything in the last MONTH or so? It was like some weird Twilight Zone flashback coming on here today!! Can any of it be restored?
Machka is offline   Reply With Quote
Old 11-28-06, 02:15 PM   #10
Stacey
Non Tribuo Anus Rodentum and off to the next adventure (RIP)
 
Stacey's Avatar
 
Join Date: Dec 2002
Bikes:
Posts: 9,161
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Quote:
Originally Posted by Fritz_S
Any hope at all that more of the lost recent threads will be restored? I am a junior member, so 1/2 of my subscribed threads, and 3/4 of my postings are GONE! I may never forget how to ride a bike, but I might forget (for example) where that advice on fitting a saddle went. (whine, ..whinge, ..., whimper, ...) -- but THANKS to the heroic IT folks for all they could save!!

Want some



with that whine?

__________________
Stacey is offline   Reply With Quote
Old 11-28-06, 03:17 PM   #11
HostGeekZ
Member
Thread Starter
 
Join Date: Jul 2006
Bikes:
Posts: 36
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Hello,

It does appear more than just a few threads from the bottom of the table are missing as originally thought. Due to the options available being leave it as it presently is, roll back to yesterday(loosing a full day of posting, which would also mean another 8 hours just to repair) it's best just to leave it like it is.

Unfortunately all missing threads will not be returning and will have to be re-created, we are looking into possibly inserting specific data from those threads to newly created ones.

This is essentially what happened, we were reparing the database(because it was not showing the post body, this is due to the table being corrupt), in the middle of repairing the threads table the kernel paniced which caused the server to halt in the middle of repairing the data files, when it was back online the thread table was reporting a 127 error(MySQL error code 127: Record-file is crashed), we recovered this as much as we could as the usual mysql repairing tools(myisamchk,mysqlcheck) are not designed to recover in such a way and all they done was loop over and over until the disk was full. After recovering everything we could from the TMD file we made this the new data file(hence some missing threads) and then began to repair the index to have the id's resort in order.

What all of that means is, the database crashed while being repaired, that broke the threads completely, we recovered rather than restoring a backup(loosing a day worth of data), at first it appeared only a few threads were missing but there does appear to be more than the initial inspection however now it's not worth going back to well over 24 hours worth of data being missing and another 8 hours of downtime to repair this.

All we can do is apologize for the inconvenience and we are looking into making sure this doesn't happen again, starting with a new database server to resolve the constant problems the present one has.

-Scott
HostGeekZ is offline   Reply With Quote
Old 11-28-06, 04:48 PM   #12
webist
Huachuca Rider
 
webist's Avatar
 
Join Date: Jun 2002
Location: Charlotte, NC
Bikes: Fuji CCR1, Specialized Roubaix
Posts: 4,275
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Quote:
Originally Posted by HostGeekZ
All we can do is apologize for the inconvenience and we are looking into making sure this doesn't happen again, starting with a new database server to resolve the constant problems the present one has.

-Scott
Does Joe have enough cash reserves to accomplish this? Or, do we need to have a fundraiser?
__________________
Just Peddlin' Around
webist is offline   Reply With Quote
Old 11-28-06, 05:17 PM   #13
banerjek
Portland Fred
 
banerjek's Avatar
 
Join Date: Oct 2005
Bikes: Custom Winter, Challenge Seiran SL, Fuji Team Pro, Cattrike Road/Velokit, РOS hybrid
Posts: 11,190
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 14 Post(s)
Quote:
Originally Posted by HostGeekZ
Unfortunately all missing threads will not be returning and will have to be re-created, we are looking into possibly inserting specific data from those threads to newly created ones.
As good luck would have it, topics tend to be revisited frequently on BF anyway....
banerjek is offline   Reply With Quote
Old 11-30-06, 11:48 AM   #14
Katzenjammer
Utility Cyclist
 
Join Date: Oct 2006
Bikes:
Posts: 345
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
For them wot don't know what "kernal panic" means, it's a term from a particular computing subculture meaning that the central part of the software that runs the server got completely confused, stopped working (which is not unlike "stopped juggling the chainsaws"), and screamed for help.

A public-service announcement from a retired nerd.
Katzenjammer is offline   Reply With Quote
Old 11-30-06, 12:13 PM   #15
Katzenjammer
Utility Cyclist
 
Join Date: Oct 2006
Bikes:
Posts: 345
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
I hope someone is still working hard on the forum software, btw. I've noticed that the paging is broken...you won't necessarily see all the posts in a thread unless you diddle around with the posts-per-page option.
Katzenjammer is offline   Reply With Quote
Old 11-30-06, 06:25 PM   #16
Brian
Senior Member
 
Brian's Avatar
 
Join Date: Nov 2004
Location: Between the mountains and the lake.
Bikes: 8 bikes - one for each day of the week!
Posts: 16,683
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Quote:
Originally Posted by Siu Blue Wind
Scott, I did not understand a word you just said but thank you to you and Joe anyway.
The server's farked. Carked it.
Brian is offline   Reply With Quote
Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



All times are GMT -6. The time now is 12:14 PM.