Page 1 of 4 1234 LastLast
Results 1 to 25 of 77

Thread: Downtime - Our Sincerest Apologies

  1. #1
    Join Date
    Jan 2004
    Location
    Bournemouth, England
    Posts
    16,226

    Default Downtime - Our Sincerest Apologies

    Hi guys

    I'm sure you're wondering what is going on. Basically, the forum server just suddenly died. It was first thought that the hard drive failed, but it turned out that the entire file system was corrupted somehow.

    Here's a timeline of what happened:

    Saturday evening: Forums went completely wonko. Stopped accepting input, no SSH access, couldn't even send ping responses. It wouldn't boot at all.

    We had the server people replace the hard drive which we thought was an issue, but when the hard drives were recompiled, the file format system was corrupted, causing complete loss of data. The server continued to send kernel panics and never boot.

    Later that night, they had installed the new hard-drives and reformated everything and we started reinstalling the forums in a lengthy process. However, around 70% through it, we lost connection to the MySQL server and the drives were giving loads of I/O errors. It seems the hard drives were corrupted still.

    The server support believed that it could be any one of the drives and that replacing them all wasn't feasible because they're fairly old style hard drives. This left us with a slim choice and one which unfortunately came with a delay; replacing the entire hard-drive setup with a totally new system.

    This seems like a no-brainer but unfortunately, while support and maintenance are 24/7, the sales team, which this needed to go through first, only work weekdays. Thankfully, they somehow responded Sunday night, but then there was a big gap of nothing which caused the delay to today, followed by a corruption in the database. Horrible, situation with a couple of mistakes, but it's all sorted

    Unfortunately, this has caused us to have to revert to the last backup of the forum server. Thankfully it wasn't that long ago, just 5 days of posts as we backed up Tuesday morning. This does mean that the last 5 days of posts, activity and user registrations were lost. We truly apologise for this, but it was out of the blue and unavoidable.


    We're working on getting it back to normal as soon as possible. There may be some issues here and there while we do our jiggery-pokery to get the forums back up

    Once again, we are truly sorry for the lost posts. If you spot any errors, let us know here.

    ~Serebii

  2. #2
    Join Date
    Aug 2013
    Posts
    55

    Default

    **** happens, nothing to do about it
    Pokemon Y
    friend code: 2509-2353-8829
    friend safari type: poison
    friend safari pokemon: cascoon,garbodor, toxicroak

    Cool.. as ice

  3. #3
    Join Date
    Jan 2014
    Location
    Lostlorn Forest
    Posts
    1,826

    Default

    I am glad it's back though. You guys did a great job.
    ASB | TPC | TCD
    Claimed Typhlosion.

  4. #4
    Join Date
    Nov 2011
    Location
    Valhalla
    Posts
    4,717

    Default

    Great job fixing the issue. Thanks a bunch!

  5. #5
    Join Date
    Jan 2004
    Location
    Bournemouth, England
    Posts
    16,226

    Default

    All the credit goes to our admin ricocheting who has spent so much time fiddling with the servers the past few days.

  6. #6
    Join Date
    Nov 2011
    Location
    Valhalla
    Posts
    4,717

    Default

    Then all glory to ricocheting!! Either way, the issue is fixed now with minimal 'damage'. Thanks to everyone working their bottoms off to fix it!

  7. #7
    Join Date
    Feb 2006
    Location
    Canada
    Posts
    5,537

    Default

    Quote Originally Posted by Serebii View Post
    All the credit goes to our admin ricocheting who has spent so much time fiddling with the servers the past few days.
    In that case, thanks a lot ricocheting!

    So happy that the forums are back up. I can't live without them

  8. #8
    Join Date
    Nov 2013
    Location
    Finland
    Posts
    200

    Default

    Thousand thanks to ricocheting!

    I'm so happy that forums are working correctly again. I was feeling empty because I couldn't check forums.

    I hope this doesn't happen ever again.
    Click my babies to help them to grow!


    I have claimed Zebstrika! Thunder zebra power!
    I have also claimed Sacred Grove theme from The Legend of Zelda: Twilight Princess!
    In-game name:Annabel
    Friend-code: 4957-3860-9818

  9. #9
    Join Date
    Jul 2010
    Location
    California, USA
    Posts
    14,838

    Default

    Thank god, I was starting to face withdrawals lol. I haven't been away from the forum for this long in years .
    Proud claimer of Cyndaquil and Ezio Auditore from Assassin's Creed !!
    Also proud claimer of Assassin's Creed 2 the game!!
    Just became the proud claimer of the Marvel's Agent's of S.H.I.E.L.D. TV show ^_^!!!

  10. #10
    Join Date
    Jan 2004
    Location
    Bournemouth, England
    Posts
    16,226

    Default

    Quote Originally Posted by Sutittaja View Post
    Thousand thanks to ricocheting!

    I'm so happy that forums are working correctly again. I was feeling empty because I couldn't check forums.

    I hope this doesn't happen ever again.
    You and me both.

  11. #11
    Join Date
    May 2010
    Location
    Equestria
    Posts
    4,066

    Default

    Well, I didn't lose too many posts, and compared to another website I frequent that lost ALL it's information, losing 5 days isn't that bad. xD
    Credit to Sworn Metalhead for the banner

    RPer's profile, 3DS Friend Code, and Nintendo Network ID

  12. #12
    Join Date
    Jan 2014
    Posts
    4

    Default

    Hooray! Welcome back, Serebiiforums! Thank you for all the hard work, ricocheting and the rest of the staff!

  13. #13
    Join Date
    Nov 2011
    Location
    Napping the day away...
    Posts
    838

    Default

    Huzzah! It's back! It's weird how these things happen, though. But hey, it could have been ALOT worse...
    Darkness is just a friend you can't see!
    3DS FC: 4227 - 0729 - 3560

    My ASB Profile

  14. #14
    Join Date
    Jan 2004
    Location
    Bournemouth, England
    Posts
    16,226

    Default

    Quote Originally Posted by Trot Away View Post
    Huzzah! It's back! It's weird how these things happen, though. But hey, it could have been ALOT worse...
    Indeed. There was a bit of a lax attitude towards backups and the one before this one would have lost a month, so we got lucky. We're now back onto doing it weekly.

  15. #15
    Join Date
    Mar 2014
    Location
    Avia, Ransei
    Posts
    402

    Default

    Hey, things happen. I'm glad you got the forums back up and running!
    Claimed Braviary, Masamune Date, and Pokemon Conquest
    "Dragons are loyal, and they will always see their mission through."
    "In the wake of my demise, may you still continue." Source of gifs
    ~Merry Christmas and Happy New Year~

  16. #16
    Join Date
    Jan 2014
    Location
    ✪ UNOVA ✪
    Posts
    185

    Default

    I was worried the forums were gone for good

    But I probably shouldn't of worried, the forums admins here are pros

    Im just glad the forums are back up *happy dance*

  17. #17
    Join Date
    May 2011
    Location
    Florida
    Posts
    5,617

    Default

    A few couple of lost posts isn't gonna hurt anyone (I hope), so don't worry.
    As the first post said, sh** happens.
    3DS FC: 3652-1012-6122

    Baking Soda, I got Baking Soda!


  18. #18
    Join Date
    Jul 2014
    Posts
    301

    Default

    I'm just glad it's back, idc about the missing posts. Tbh, all those other forums had really tacky designs, i couldn't handle it.
    Anyway, thanks for the hard work!

  19. #19
    Join Date
    Feb 2012
    Location
    Canada
    Posts
    1,427

    Default

    That was pretty quick. I thought it would have taken much longer so good job!

  20. #20
    Join Date
    Jun 2013
    Location
    Coumarine City
    Posts
    1,206

    Default

    That sure was a weird downtime. Oh well, I'm glad everything is back to normal. Thanks a lot ricocheting!
    Last edited by PokemontrainerY; 14th October 2014 at 1:51 PM.
    Pokémon XY


    Kalos, Where Dreams and Adventures Begin!

    Quote Originally Posted by DaDonYordel View Post
    Are we not just silly people writing silly complaints on this message board?

  21. #21
    Join Date
    Jul 2011
    Location
    That way
    Posts
    6,779

    Default

    Good to see the forums working again. Thank you ricocheting for your hard work.

  22. #22
    Join Date
    Jul 2014
    Location
    Greece
    Posts
    121

    Default

    Hey, don't worry about it. Mistakes happen! Everything's back to normal.
    Speaking of errors, that reminds me when I was playing on a minecraft server years ago and the owner messed up and had to revert to a 6 month old backup...
    Anyway, 頑張って In the future!

  23. #23
    Join Date
    Aug 2012
    Location
    At south of Kalos.
    Posts
    2,211

    Default

    A question,

    Even thought Joe is from the UK, is true that the servers of Serebii are located in the United States?

  24. #24
    Join Date
    Apr 2011
    Location
    AZ USA
    Posts
    332

    Default

    Thanks to everyone involved in getting and keeping the forums up!

    Joe for footing the bills and choosing a great company for support.
    Riccochet for excellent trouble shooting and time and hard work.
    And everyone else who had a part large or small...

    LLR
    LLR

    P.S.
    East Sea Shellos (blue) with HA available
    I trade Vivillons for Vivillons and have a All 18 non-event of patterns. Ask!
    Dex 718/718 Thank you ShinyPanda! Living Dex: 711/718.


    My Friend Code: 1907-9797-0140. In game name: Sage.
    I'm using this one for trades and to check safaris for folks.
    I'll be periodically deleting older cards from my friend list.
    If you still want access just let me know and I'll be happy to add you again.

  25. #25
    Join Date
    Mar 2014
    Location
    Hell
    Posts
    1,753

    Default

    So glad the problem has been sorted out Serebii and ricocheting. Thanks, especially the latter.

    Also dunno if anyone has this problem but I've been getting 404s like every other page...

Page 1 of 4 1234 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •