imschur Posted January 29, 2011 Report Share Posted January 29, 2011 Our host had some scheduled network maintenance that took us offline for way too long >:( Quote Link to comment Share on other sites More sharing options...
techmike Posted January 29, 2011 Report Share Posted January 29, 2011 I noticed! Being the nightowl that I am-perhaps they could put up a maintenance message rather than a generic error? :o Quote Link to comment Share on other sites More sharing options...
imschur Posted January 29, 2011 Author Report Share Posted January 29, 2011 The forum software generates that error page.I just got this message We're terribly sorry for the issues that the extended network maintenance early this morning caused for our customers. While the work was absolutely necessary to improve and streamline our network it was not our intent that service be disrupted for so long. Quote Link to comment Share on other sites More sharing options...
techmike Posted January 29, 2011 Report Share Posted January 29, 2011 Ahh. I got a data base connection error msg. Quote Link to comment Share on other sites More sharing options...
imschur Posted January 29, 2011 Author Report Share Posted January 29, 2011 yep thats the one. If you look at one of my wordpress sites you will see a similar message in a different font. I considered doing a redirect and making a status page of my own but i figured as soon as I finished the issue would be resolved.You guys should bookmark this page. If you see a mysql,PS or VPS issue most likely that is why this site is down. Shared hosting issues should not affect us.lastly if the main page works that will tell you its the mysql down. SMF (this forum) runs off of a mysql database.Even though I pay for a private server they still run the databases elsewhere. A dedicated mysql would double the operating costs. Quote Link to comment Share on other sites More sharing options...
imschur Posted March 14, 2011 Author Report Share Posted March 14, 2011 Major network issues all day, still not resolved Quote Link to comment Share on other sites More sharing options...
imschur Posted March 15, 2011 Author Report Share Posted March 15, 2011 Network outage Posted (March 14th, 2011 at 2:20 am PST) by patrickm We apologize for the downtime as our core network is offline at the moment. Our network admin is addressing the issue and we expect service to resume shortly. This will prevent access to the customer web panel.Update 4:00 am (Pacific): This issue is now resolved! This was due to network maintenance which was not supposed to have any effect on connectivity, but sadly did. We are investigating this more thoroughly and if we have any additional info to provide, it will be posted here! Thanks for your patience with this outage. Please contact Support if you are still experiencing any issues.Update 5:41 am (Pacific): We apologize, as we are experiencing another outage. Our network admin is working on the issue at this time and we expect it to be resolved shortly. This outage will affect core services such as the Web Panel and WebMail. We will update this post as soon as we have more information or when the issue is resolved!Update 7:11 am (Pacific): We are currently operating on half of a core, so partial connectivity has been restored. We are working to resolve an issue with one of the cisco core supervisors not maintaining it’s configuration. Systems that are affected by this are our servers located at our downtown Los Angeles, CA location (including the panel)– servers at our LAX data center are not affected by this outage.Update 11:15 am (Pacific):Connectivity has been restored to a large part of our network. We are still experiencing routing issues that may cause outages for certain machines located in our LAX or Downtown Los Angeles data centers. This post will be updated as soon as we have more information on the source of these outages. Update 1:45 pm (Pacific):We’re sorry for the lack of updates on this issue. Unfortunately, there haven’t been any updates here because we don’t have any new information. Our network admins have been working non-stop since this morning to fix these problems, but we’re still not sure when it will be resolved. This post is just meant to let you know that we are doing everything we possibly can to restore our system to normal and that we are not ignoring the situation. If you have already submitted a support ticket regarding this, you will receive updates by email as soon as we have them. Again, we apologize for the inconvenience this has caused you and thank you for your patience as we try to get things back to normal.Update 3:45 pm (Pacific):We have just received word from our admin team that these issues have been resolved now. All services should be restored at this point to (web)mail, mysql and web servers. As we posted above, one of our main switches in one of our datacenters locked up and needed to be rebooted. When it came up, it was missing its configuration files. This caused all kinds of routing issues on our backend and resulted in many vital servers to lose their connections. Unfortunately, there was no way to recover the configs, so they had to be rebuilt from scratch. Most of the day was spent reconfiguring the switch, so we didn’t have any new updates other than what was already posted above. We’re currently going over all the information we have and will have much to say about it over the next few days. Please keep an eye on this status page, as well as our blog (blog.dreamhost.com), for more specific details on what caused this outage and what we plan to do to prevent it in the future. Again, we can’t apologize enough for the inconvenience this has caused our customers. Please contact us with any further questions/comments you have and we’ll be happy to assist you.Update: 5:30 pm (Pacific): Our admin team has noticed a bit of internal packet loss that seems to be related to the earlier networking issue. This is causing some issues with sites that connect to MySQL databases. So while we’re not out of the woods just yet, we are aware of the problem and are working on fixing it up now.Update: 6:20 pm (Pacific): Even tho the admins are uncovering more configuration issues, things are getting better for a number of folks. Customers who were still seeing slowdowns with POP, IMAP and webmail may notice improvements after we tweaked a setting. Other folks with MySQL issues may be seeing a speed increase as well. We’re still pounding away at this, so don’t think we’ve called it a day if you’re still seeing issues. Hopefully we’ll have more updates soon!Update: 7:28pm (Pacific):The network is confirmedly looking much better, but we continue keeping an eye on it. If you’re still having any issues, please submit a ticket with as much details as you can provide, so we can use that to evaluate if your case is unrelated or if there is still something else lurking around waiting to be fixed. We’ll update again as the evening progresses, but so far so good. We very much appreciate your patience and understanding regarding this outage. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.