© 2007 All Rights Reserved. Do not distribute or repurpose this work without written permission from the copyright holder(s).
Printed from https://www.damninteresting.com/damn-downtime/
Apologies for the nasty patches of downtime recently… our hosting provider seems to have experienced some heavy technical difficulties at their data center:
…a Phase C Conductor Cable on UPS #4 has been compromised to the point that immediate action to repair it is necessary or a ground fault will occur to the building systems. […] The supervisor in one of our core routers went kaput when the power went off. […] Further problems arose with corrupt configurations left over from the old supervisor. […] One-point-twenty-one Gigawatts! Great scott!
As of now, things roughly resemble normalcy, though that plane of reality can be highly unstable. Barring any further unforeseen complications, we plan to come up with something new faster than a sousaphone full of crackers.
© 2007 All Rights Reserved. Do not distribute or repurpose this work without written permission from the copyright holder(s).
Printed from https://www.damninteresting.com/damn-downtime/
Since you enjoyed our work enough to print it out, and read it clear to the end, would you consider donating a few dollars at https://www.damninteresting.com/donate ?
Hmmm…it seems the past few months have been like this ALAN. Don’t make me stomp a mud-hole in you.
You guys must use Dreamhost. LOTS of sites were effected by that outage, including my own. Though Dreamhost is great when they’re up, they don’t seem to handle unscheduled downtime very gracefully. Last summer they kept having outages due to brownouts, apparently because they have no real redundancy and a useless UPS/generator backup system.
Yep dreamhost it appears to be:
1: CPE-124-178-55-157.wa.bigpond.net.au (124.178.55.157) 0.331ms pmtu 1500
1: 172.18.113.67 (172.18.113.67) asymm 2 378.796ms
2: 172.18.74.6 (172.18.74.6) 378.070ms
3: a-61-9-241-199.deploy.akamaitechnologies.com (61.9.241.199) 368.118ms
4: TenGigabitEthernet9-3.pie2.Perth.telstra.net (165.228.144.69) 378.162ms
5: TenGigabitEthernet0-8-0-2.pie-core1.Perth.telstra.net (203.50.115.193) 367.168ms
6: POS0-0-1-0.way-core4.Adelaide.telstra.net (203.50.6.213) 418.078ms
7: Pos0-4-1-0.exi-core1.Melbourne.telstra.net (203.50.6.189) 435.178ms
8: bundle-POS1.chw-core2.Sydney.telstra.net (203.50.6.13) 437.209ms
9: 10GigabitEthernet1-0.oxf-core1.Sydney.telstra.net (203.50.6.2) asymm 13 458.753ms
10: 10GigabitEthernet6-0.syd-core04.Sydney.reach.com (203.50.13.34) asymm 14 455.546ms
11: i-10-0.syd-core03.net.reach.com (202.84.221.85) asymm 14 428.053ms
12: i-4-2.sydp-core01.net.reach.com (202.84.249.13) asymm 14 429.889ms
13: i-14-0.wil-core03.net.reach.com (202.84.143.246) asymm 11 588.694ms
14: i-4-2.wil03.net.reach.com (202.84.251.194) asymm 12 588.700ms
15: ge-6-20.car3.LosAngeles1.Level3.net (4.68.111.133) asymm 13 598.661ms
16: ae-11-53.car1.LosAngeles1.Level3.net (4.68.102.76) asymm 14 579.993ms
17: ge1-L3.dreamhost.com (4.78.192.66) 599.707ms
18: basic-heavy.tequila.dreamhost.com (208.97.134.223) asymm 16 618.606ms reached
I have Dreamhost too… but they where saying it was a router that decided to die at the same time the power came back up, they replaced the blade that went bad, but config problems and typical gremlins are still effecting it.
My site is down totally currently, but I don’t have near the amount of traffic I’m sure you do.
Great Scott!
jiminy crickets!
Impact Hosting has never failed me in the six years I’ve used them. Just sayin’
Hmmmmmm bummer.
Alex Wells said: “Hmmmmmm bummer.”
That is unfortunate, you are my only salvation from my job….
Yeah well, the price of DamnH… erm, DreamHost is very nice for what you get. I for one welcome our sometimes-down overlords. This downtime was mostly due to building management (again) rather than the DreamHost folks. They have complained several times about it, but the task of moving large datacenters would probably cause even more downtime. From what I understand, they were about to move until last year when MySpace and several others moved out of the building, lowering the overal power demands. However, it is only a matter of time till these power issues force them to move.
As far as Damn Interesting, it looks like you guys were on one of the “Drink” servers which had issues coming back up.. Unfortunate, but it looks like the trouble is over.
“One-point-twenty-one Gigawatts! Great scott!”
Shouldn’t that be Jigawatts?
Dreamhost is pretty good, they do have some growing pains… but I can live with a 99% uptime for the price.
Sousaphone full of crackers?