Knowledgebase

SoftLayer is down? [MERGED]

Posted by absolut, 06-24-2007, 02:09 PM
Hi It seems like SF is down. It's the first time for me... Sadly.

Posted by hosteur, 06-24-2007, 02:09 PM
Ping Results: PING softlayer.com (66.228.118.22) 56(84) bytes of data. --- softlayer.com ping statistics --- 5 packets transmitted, 0 received, 100% packet loss, time 4002ms It just me or... It was ok a few hour ago and now...

Posted by 0utlier, 06-24-2007, 02:10 PM
Yes, my servers on the 66.228.121.x IP's are down.

Posted by absolut, 06-24-2007, 02:11 PM
It's looks as power failure.

Posted by hosteur, 06-24-2007, 02:11 PM
75.126.1xx.xxx Mine are up and running... Last edited by hosteur; 06-24-2007 at 02:16 PM.

Posted by TCP/IP Warrior, 06-24-2007, 02:17 PM
I am experiencing the same thing from Florida... can't get to their home page. However, I can get to the internal network and to the server itself.

Posted by 0utlier, 06-24-2007, 02:18 PM
www.softlayer.com is down for me too.

Posted by jasonhk, 06-24-2007, 02:19 PM
Same here.. po52.fcr01.dal01.dallas-datacenter.com then timeouts ..

Posted by vengefuldeath87, 06-24-2007, 02:21 PM
one of my servers is down, other is up, cant vpn or get on half of their site...

Posted by eth00, 06-24-2007, 02:22 PM
Down here as well for parts of it. It gets into the datacenter and appears to go to the last switch before dieing

Posted by eth00, 06-24-2007, 02:24 PM
Good to know, so at least your server has not lost power, hopefully that is the case with others as it would minimize the time to get it all back up.

Posted by sanudeep, 06-24-2007, 02:24 PM
softlayer site is down , but our servers are running

Posted by WHRKit, 06-24-2007, 02:25 PM
Very frustrating. How many times has something like this now happened this year?! This is it for me. I just saw the competing offer from the planet (10% below Softlayer + free setup) and my stuff will be moving soon. I never had that much downtime with the planet before I moved everything to Softlayer. Christoph

Posted by thedavid, 06-24-2007, 02:27 PM
Hmm, I was able to get to the portal, and add a ticket for the downtime, but now I'm not. Perhaps they're fixing the problem, or maybe it's getting worse. I dunno. Edit: Now everything's down, including our other servers there.

Posted by kafloofen, 06-24-2007, 02:29 PM
Can anyone reach softlayer?

Posted by animelab, 06-24-2007, 02:30 PM
My bad! Just kidding. I am down too 208.101.42.10!

Posted by Servax, 06-24-2007, 02:31 PM
All my servers in softlayer just went down..

Posted by vengefuldeath87, 06-24-2007, 02:31 PM
yep, just lost the other server too...

Posted by Increhost, 06-24-2007, 02:31 PM
I´m in Uruguay an cannot, 15 minutes down I think, I don´t know why at least they put an offsite support panel... so we can see at least what´s happening...

Posted by eth00, 06-24-2007, 02:31 PM
http://www.webhostingtalk.com/showthread.php?t=615203 Looks like network, some people are ssh'ing via the private network and the servers are still online

Posted by thedavid, 06-24-2007, 02:31 PM
Direct your attention to the softlayer thread in the outages forum: http://www.webhostingtalk.com/showthread.php?t=615203

Posted by Servers4me, 06-24-2007, 02:31 PM
Yeh everthing is down for us aswell. Its getting to the Border Router and dieing. There outages and network is starting to go downhill, when they first started out they never had this many problems. We still won't move away from them as they have always done right by us.

Posted by TCP/IP Warrior, 06-24-2007, 02:31 PM
Same here

Posted by QualityHost, 06-24-2007, 02:31 PM
Yes, all our servers are down also

Posted by 3x-a-D3-u5, 06-24-2007, 02:32 PM
So they've been down before? cos i've just started hosting i cant get a bad name already...

Posted by (Stephen), 06-24-2007, 02:32 PM
Bah, off network forums are down now due to this. Our network is up and chugging along just the softlayer based external forums are down

Posted by kafloofen, 06-24-2007, 02:32 PM
This is the second time in a span of what 2 months?

Posted by drumman24, 06-24-2007, 02:32 PM
Down Down Down, someone should add up the total downtime in the past year. Ridiculous! I will be moving soon!

Posted by IHSL, 06-24-2007, 02:32 PM
All servers we have there are up but their portal is down. It's also sending tons of false alerts. Simon

Posted by Loktari, 06-24-2007, 02:32 PM
Another downtime point for softlayer... at least we had some issue-free weeks, let's hope for a full month without issues now (sigh).

Posted by TonyB, 06-24-2007, 02:33 PM
Only machines up for me are in sr04 everything else is down.

Posted by Increhost, 06-24-2007, 02:33 PM
yeah, even softlayer.com is down

Posted by Servax, 06-24-2007, 02:33 PM
Three servers just went down here.

Posted by kafloofen, 06-24-2007, 02:34 PM
It seems they have no contingency whatsoever

Posted by Servers4me, 06-24-2007, 02:35 PM
Our servers are backup now.

Posted by (Stephen), 06-24-2007, 02:36 PM
not here

Posted by kafloofen, 06-24-2007, 02:36 PM
still down here

Posted by MrLister, 06-24-2007, 02:37 PM
where are they located? any storm reports?

Posted by Increhost, 06-24-2007, 02:37 PM
I think at least they should put an offsite support panel... so we can see what´s happening... too many minutes down, and our customers doesn´t care about if we can get inside our servers by vpn, they just want website & email working, it´s frustrating not to have any info about this issue

Posted by Servers4me, 06-24-2007, 02:37 PM
Don't think its power related, as the Border router is still online.

Posted by 3x-a-D3-u5, 06-24-2007, 02:37 PM
IP's 208.101.45.117* still down 2

Posted by jhadley, 06-24-2007, 02:38 PM
We really have so many problems that a "this appears to be an issue concerning the whole SoftLayer facility...." canned response in our ticket system is really quite necessary. Uptime at SoftLayer is terrible, unfortunately we still have some customers at the facility who can't easily be moved to another facility.

Posted by RadixHosting, 06-24-2007, 02:38 PM
Their site seems to be online, portal down though. Server on 75.126.x.x down. My timer is running, I'll be looking at their SLA soon...

Posted by eth00, 06-24-2007, 02:38 PM
Dallas TX, http://www.weather.com/weather/map/c...nav_undeclared weather looks fine Still everything is down here

Posted by 2Mhost, 06-24-2007, 02:39 PM
most of my servers there are down .. welcome!

Posted by kafloofen, 06-24-2007, 02:40 PM
My previous provider had better uptime than SL. Too bad I transferred.

Posted by paulius, 06-24-2007, 02:40 PM
it's down... WOW!

Posted by Plutomic-Andrew, 06-24-2007, 02:40 PM
Softlayer is down for me too as well as one of our servers.

Posted by BitSurFer, 06-24-2007, 02:40 PM
same here down Last edited by BitSurFer; 06-24-2007 at 02:45 PM.

Posted by Acroplex, 06-24-2007, 02:42 PM
Same here.

Posted by RadixHosting, 06-24-2007, 02:42 PM
Their sales department is closed by the way, though they should be open: 9:00AM to 7:00PM Central time Saturday and Sunday. Does anyone has a technical support phone number? I can't reach their contact page...

Posted by MIRhosting.com, 06-24-2007, 02:42 PM
Yes, too bad for them... Seems, we should begin to think about possibility to move some servers away

Posted by Servax, 06-24-2007, 02:43 PM
I haven't had many issues with SoftLayer, last downtime I received on any server from SoftLayer was about two three months I think.

Posted by heavypredato, 06-24-2007, 02:43 PM
tech support phone is set to record messages. 1-866-403-7638

Posted by Acroplex, 06-24-2007, 02:43 PM
Same here. A large online community, NamePros.com is also down as well due to them being hosted on Softlayer.

Posted by Servers4me, 06-24-2007, 02:44 PM
(214) -442-0602 - Office (866) -398-7638 - Toll Free

Posted by taranonline, 06-24-2007, 02:44 PM
Down here too

Posted by ckissi, 06-24-2007, 02:44 PM
Is there anybody who knows what's going on there ?

Posted by smithm34, 06-24-2007, 02:44 PM
SLA BEGINS AGAIN!! LOLOL

Posted by digdugdog, 06-24-2007, 02:45 PM
Most of my servers are up, but a few of my main ones down, so it's all effectively down! erg. It's looking bad. Any guesses on timeframe for recovery?

Posted by JeddaHost, 06-24-2007, 02:45 PM
The same thing softlayer and all my servers are down !!!

Posted by kafloofen, 06-24-2007, 02:45 PM
no contingency measures that's a sign of great provider

Posted by RadixHosting, 06-24-2007, 02:46 PM
That's their sales department... Tried to call but get voicemail.

Posted by NetLineHost, 06-24-2007, 02:46 PM
All of my servers with Softlayer are also down. Wonder if they are going to use "The tech dropped the router off the counter" this time...

Posted by prixone, 06-24-2007, 02:46 PM
hard to know when their phone has nobody to pickup support plus sales = secretary machine btw im on the boat

Posted by rv_irl, 06-24-2007, 02:46 PM
This is just ridiculous. Only one of our servers at SL seems affected, but nevertheless it is pathetic how many problems they have.. I guess it is time to start planning a migration

Posted by Servers4me, 06-24-2007, 02:47 PM
Sales are there, so it must be because there all busy with this issue.

Posted by TonyB, 06-24-2007, 02:47 PM
You can't win it seems

Posted by sigmaweb, 06-24-2007, 02:47 PM
45 minutes down!!!

Posted by joshw, 06-24-2007, 02:48 PM
Same here. My server and the softlayer.com server itself. Does anyone have a phone number for their support team? I only see the sales number, and nobody ever picks that up.

Posted by Loktari, 06-24-2007, 02:48 PM
Bwah, every time you think and hope they got their act together, another issue arises. It's so frustrating when at every outage, all of your servers go down... there's just no way to "route around" an outage there, except by going to another DC.

Posted by q2261, 06-24-2007, 02:48 PM
i'm getting pretty tired of this as well...my main webserver had a Hard drive issue about 8 hours ago, box went offline, came back only after 1.5 hours. Then same problem came back a couple of hours ago, box just disappeated off the face of the earth, SL has been investigating for two hours, and now in the middle of all this half the DC goes down. WTF?

Posted by heavypredato, 06-24-2007, 02:48 PM
im online now

Posted by zefefre, 06-24-2007, 02:48 PM
anybody knows whats going on? I couldn't even access the support portal.

Posted by 3x-a-D3-u5, 06-24-2007, 02:49 PM
Servers4me: That a happy thought just hope you're right

Posted by Valera, 06-24-2007, 02:49 PM
After two or three consequtive downtimes few months ago, here we go again. I was just getting calm about it all... I recommend watching your downtime minutes carefully as last time they've cheated on the amount of SLA credit for me and at least some other customers.

Posted by Servax, 06-24-2007, 02:49 PM
One of mine just went back up, two to go.

Posted by Acroplex, 06-24-2007, 02:49 PM
"At 4pm Eastern president GW Bush will address the nation. We are at war with China. A nuclear warhead has been intercepted over California but conventional warheads made it to Texas." This is the only excuse I'd accept for such downtime :-)

Posted by rumahweb, 06-24-2007, 02:50 PM
2 server down ( 1 up (75.126.201.10) I hope it's not a power failure again!

Posted by TonyB, 06-24-2007, 02:50 PM
Only machines that are up for me are in sr04 (newest area SL is putting servers)

Posted by Increhost, 06-24-2007, 02:50 PM
how many time is this down ? I can´t belive it, my $7.90 VPS has better uptime than SL no phone support? no offsite support ? no explanations at all ? just pathethic, looking really for a new provider to migrate

Posted by tuwebfacil, 06-24-2007, 02:50 PM
My servers are online online now (wasn't online minutes ago), but I can't access their website. But, as far I can access my servers I am pretty happy First time for me in about a year.

Posted by ckissi, 06-24-2007, 02:50 PM
My is up again

Posted by RadixHosting, 06-24-2007, 02:50 PM
Your HD must have caught fire and burned down the whole dc

Posted by Acroplex, 06-24-2007, 02:51 PM
We're back up, thank you Mr. Bush for restoring the Internets

Posted by animelab, 06-24-2007, 02:51 PM
Woot i am up! Server didn't reboot, so looks like a network issue.

Posted by Samuraid, 06-24-2007, 02:51 PM
My server was down a moment ago, and I could not reach the Portal nor softlayer.com, but it seems like my server is back on the public network now, and the uptime is 23 days so it's definitely some sort of network issue.

Posted by smithm34, 06-24-2007, 02:51 PM
only 2 numbers tech, 866-403-7638 sales, 866-398-7638 And no one picks up anywhere. I think i'll go play some wow and try not to stress out about my 5000 msgs and emails and money im loosing right now.

Posted by Servers4me, 06-24-2007, 02:51 PM
Everyone breath in and breath out. They have probably put there resources into fixing the problem. But yes it is causing frustration as this isnt the first and I doubt it will be the last.

Posted by digdugdog, 06-24-2007, 02:51 PM
some of my servers are starting to show life. Looks like it was network, not power. Servers still have uptime. Like, on one of my servers, I have public network, but not private network. Last edited by digdugdog; 06-24-2007 at 02:55 PM.

Posted by prixone, 06-24-2007, 02:51 PM
if they even cared about us they should have changed the phone message at least instead of monday to friday work time since they wont pickup their phones

Posted by zefefre, 06-24-2007, 02:52 PM
my server is up again now.

Posted by RadixHosting, 06-24-2007, 02:52 PM
The Planet used to have such issues which is why I moved to SL... Anyways mine is up again too. Hope it stays like this.

Posted by rumahweb, 06-24-2007, 02:52 PM
Network problem I guess. My servers is up now and there was no problem with uptime (still 126 days since last reboot)

Posted by 2Mhost, 06-24-2007, 02:52 PM
up again, outage for me was 10 mins or so

Posted by NetLineHost, 06-24-2007, 02:53 PM
Looks like all services are back to running?

Posted by donniesd, 06-24-2007, 02:54 PM
Any one tally how long we were down?

Posted by Valera, 06-24-2007, 02:54 PM
Back up for me. 26 min downtime according to Pingdom, that means no SLA credit, heh.

Posted by Veus, 06-24-2007, 02:54 PM
208.101.14.* is still down for me.

Posted by smithm34, 06-24-2007, 02:55 PM
Looks like no.

Posted by Increhost, 06-24-2007, 02:55 PM
not at all, their site is down, and my server too

Posted by 3x-a-D3-u5, 06-24-2007, 02:55 PM
Well im still down... ;-(

Posted by zymic, 06-24-2007, 02:55 PM
backup for me now, phew

Posted by CozmicShredder, 06-24-2007, 02:56 PM
Doh all our servers are down as well!!!!

Posted by smithm34, 06-24-2007, 02:57 PM
Anyone know the exact time of outage ?

Posted by coight, 06-24-2007, 02:57 PM
We are still down, have a bunch in 208.101.X down still. No info from them via phone (voicemail)

Posted by joshiee, 06-24-2007, 02:57 PM
we're back up 208.101.60.x

Posted by Servax, 06-24-2007, 02:57 PM
Two servers up here, one down still.

Posted by RadixHosting, 06-24-2007, 02:58 PM
Get some Prozac

Posted by Increhost, 06-24-2007, 02:58 PM
what do you mean ? you don´t pay ? how many minutes is the limit ?

Posted by Loktari, 06-24-2007, 02:58 PM
Some are up, some are down... private network is more down than up.

Posted by 3x-a-D3-u5, 06-24-2007, 02:59 PM
Well 208.101.45.* still out.. (must the VERY last server in the rack....)

Posted by (Stephen), 06-24-2007, 02:59 PM
We had downtime from 1:06PM until 1:56PM

Posted by rv_irl, 06-24-2007, 03:00 PM
My one server that was done, is now up again. But as soon as that went up, a different server went down. Really not happy about this.. Tried to cheat us out of it too. All monitoring systems showed we qualified for SLA credit, they refused.. We had to compromise and accept something less..

Posted by HE/LW-Sam, 06-24-2007, 03:01 PM
May be some one stepped on power again They are really getting common now

Posted by RadixHosting, 06-24-2007, 03:01 PM
I still can't access their site properly. Do you mind pasting their SLA table?

Posted by digdugdog, 06-24-2007, 03:01 PM
customer portal is back for me, it's showing everything as ok, though, a few servers still unreachable.

Posted by 3x-a-D3-u5, 06-24-2007, 03:01 PM
LOL Really now, is that the first thing that comes to your mind?

Posted by joshiee, 06-24-2007, 03:02 PM
server cant access dns resolvers AHG

Posted by RadixHosting, 06-24-2007, 03:03 PM
I'm afraid so...

Posted by hytek, 06-24-2007, 03:03 PM
Public Network, Private Network, Customer Portal, and Infrastructure SLA listed below: Uptime Guarantee SLA Credit 99.9% Guaranteed 99.8% 10% 99.7% 20% 99.6% 30% 99.5% 40% 99.4% 50% 99.3% 60% 99.2% 70% 99.1% 80% 99.0% 90% Less than 99.0% 100%

Posted by rv_irl, 06-24-2007, 03:04 PM
23 minute downtime on one server... but it's up now.. Another server has 35 minute downtime and is still down..

Posted by Valera, 06-24-2007, 03:04 PM
Well, SL guarantees 99.9% uptime. 30 days x 24 hours x 60 minutes = 43200 minutes * 0.1% = 43.2 min So you've got to be down for over 40 min to be able to claim 10% off for this month. I must admit I prefer not being down than racking up SLA credit though. It's peak time now too.

Posted by kafloofen, 06-24-2007, 03:04 PM
one hour downtime here

Posted by smithm34, 06-24-2007, 03:04 PM
Can you give me the link to the portal digdugdog ?

Posted by Ks Jeppe, 06-24-2007, 03:05 PM
The portal shows all public networks are failed, but my server works fine, and connecting to it works as well... It's in the new area though, so might just be the old ones as TonyB pointed out..

Posted by prixone, 06-24-2007, 03:05 PM
good calcs... up there inst that 1hour and 14 minutes for 31 days

Posted by QualityHost, 06-24-2007, 03:06 PM
If this was FITX, most people would be screaming up their $@#%$& by now ..... LOL I do hope SL can fix this repeated downtime issue ASAP.

Posted by coight, 06-24-2007, 03:06 PM
DNS is down as mentioned earlier. We still have a handful of servers that are NOT working.

Posted by joshiee, 06-24-2007, 03:07 PM
ok i just changed the resolvers in /etc/resolv.conf to 4.2.2.2 and 4.2.2.3 the only dns servers i know by heart. haha

Posted by Increhost, 06-24-2007, 03:08 PM
softlayer.com is up, my server still down !!!! so only 10% discount ? it´s a joke

Posted by kafloofen, 06-24-2007, 03:08 PM
Date: 06-24-2007 Start time (CDT): 13:00 Services Affected: Public Network Device: SR01 Location: dal01 Duration: Emerging Issue Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly Sincerely, SoftLayer Emergency Response Team

Posted by digdugdog, 06-24-2007, 03:08 PM
Start time (CDT): 13:00 Services Affected: Public Network Device: SR01 Location: dal01 Duration: Emerging Issue Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly

Posted by sigmaweb, 06-24-2007, 03:09 PM
Where exactly in the customer portal can be proven the exact downtime?

Posted by kafloofen, 06-24-2007, 03:09 PM
Date: 06-24-2007 Start time (CDT): 13:00 Services Affected: Public Network Device: SR01 Location: dal01 Duration: Emerging Issue Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly Sincerely, SoftLayer Emergency Response Team

Posted by jackonline, 06-24-2007, 03:10 PM
yep my VPS http://www.domainsdot.net and all websites is down too

Posted by smithm34, 06-24-2007, 03:10 PM
Yea its just SR01 / SR02 Umm it appears to be comming back up though

Posted by hosteur, 06-24-2007, 03:11 PM
SoftLayer.com is back online, now! ----------------------------------------- Date: 06-24-2007 Start time (CDT): 13:00 Services Affected: Public Network Device: SR01 Location: dal01 Duration: Emerging Issue Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly Sincerely, SoftLayer Emergency Response Team https://status.softlayer.com -------------------------------------------------------- From the portal

Posted by HE/LW-Sam, 06-24-2007, 03:11 PM
The main site is up for me now....seems like everything shall be normal soon.

Posted by Valera, 06-24-2007, 03:12 PM
Well, the "guaranteed" is next to 99.9%, that means they got to pay if your uptime is any lower than 99.9%. If they pay only if uptime is 99.8% or lower, that means they are actually guaranteeing 99.8%. They use various strategies to avoid paying as much SLA credit as they're supposed to. So keep careful logs, persist, and let them know that you'll be making the matter public on WHT where they advertise, if they don't acknowlege reliable reports that you supply from third party monitoring.

Posted by Crucial Web Host, 06-24-2007, 03:12 PM
As bad as two network outages in as many months are... SoftLayer is STILL by far better than ThePlanet. All our servers are up and running. Only lost one vlan in this downtime.

Posted by RadixHosting, 06-24-2007, 03:12 PM
The funny part is: About 1 hour ago I replied the following to a sales ticket: "Our servers are hosted on the SoftLayer public network, which is extremely redundant and reliable." Well actually that's not funny at all, I'm losing potentional customers...

Posted by SoftDux, 06-24-2007, 03:13 PM
I can access their site, is anyone else still having problems?

Posted by 0utlier, 06-24-2007, 03:14 PM
My servers at 66.228.121.x are still down

Posted by prixone, 06-24-2007, 03:15 PM
all fine here, i am checking now for how long we being offline to know if we fit in the SLA...

Posted by Loktari, 06-24-2007, 03:15 PM
Yes, some servers are still down and the private network doesn't work. All in all: it's down. Bah!

Posted by prixone, 06-24-2007, 03:18 PM
by what i see we will get refund only at 99.8% softlayer.com/sla.html

Posted by coight, 06-24-2007, 03:18 PM
Yes 1 server now

Posted by Servax, 06-24-2007, 03:20 PM
An update to it: Date: 06-24-2007 Start time (CDT): 13:00 Services Affected: Public Network Device: SR01 Location: dal01 Duration: Emerging Issue Description: 2:15PM: All service has been restored to normal. Engineers are onsite and still working. A formal notice will be available within 4 hours. Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly Sincerely, SoftLayer Emergency Response Team https://status.softlayer.com Funny how one of my servers are still down though.

Posted by Kasey, 06-24-2007, 03:21 PM
Same here... only lost one of my three during this whole event, and it's still down.

Posted by 3x-a-D3-u5, 06-24-2007, 03:21 PM
Apparently These are still offline: 66.228.121.x 208.101.45.x

Posted by thedavid, 06-24-2007, 03:21 PM
Looks like a power issue: root@civateto2 [~]# uptime 15:18:40 up 6 min, 1 user, load average: 8.03, 5.49, 2.32 root@obayifo [~]# uptime 15:25:14 up 10 min, 1 user, load average: 11.43, 6.23, 2.81

Posted by kmike, 06-24-2007, 03:22 PM
Two of our servers were rebooted, and the private network is still down. And what's more, just a few minutes before the outage, one of the servers had the hard disk failure in its RAID. I wonder how much time will pass till the support will be able to look into it now.

Posted by smithm34, 06-24-2007, 03:22 PM
1 of my machines still down. Wanted to check power status; Power strip control is not available for this server at this time.

Posted by Veus, 06-24-2007, 03:22 PM
and 208.101.14.x is still down

Posted by jNive, 06-24-2007, 03:26 PM
if the private network is down then that would still be downtime as i believe its included in the SLA isnt it

Posted by Ks Jeppe, 06-24-2007, 03:28 PM
From the client portal

Posted by Valera, 06-24-2007, 03:28 PM
Well this is another subtle lie, as "99.9% guaranteed" by definition means "no less than 99.9% uptime guaranteed" and then in reality avoidance of compensation between 99.9% and 99.8% uptime. But mainly this is to throw 10% off the next SLA tiers. I've had 3h 22m downtime during this one. Interesting thing to note is that both issues are on SR01.

Posted by prixone, 06-24-2007, 03:35 PM
SO CONFUSED with all this time passed. my bandwidth graphs stopped at 12:00 ... and since i am still with no vpn access i cant really check from inside one of my servers.

Posted by digdugdog, 06-24-2007, 03:38 PM
looks like all mine are back. 1.5 hours downtime.

Posted by MrLister, 06-24-2007, 03:41 PM
power issue in sr01

Posted by kishornsk, 06-24-2007, 03:41 PM
The SL server are now back up. Still no update from them what caused the issue.

Posted by steven-v, 06-24-2007, 03:43 PM
Nothing for me, must be isolated issue... My servers are up.

Posted by MrLister, 06-24-2007, 03:45 PM
only some are back up. servers in sr01 are experiencing power failure (IMPI indicated power status if off) and network issues

Posted by ImageLeet, 06-24-2007, 03:52 PM
Softlayer.com was down for me but our servers were up

Posted by jasonhk, 06-24-2007, 03:53 PM
208.101.45.x is UP...

Posted by RadixHosting, 06-24-2007, 03:54 PM
2500 Amps? Don't they mean milliampere? Edit: Nevermind Last edited by RadixHosting; 06-24-2007 at 04:04 PM.

Posted by MrLister, 06-24-2007, 03:56 PM
load balancer still down but all the servers up

Posted by Loktari, 06-24-2007, 03:56 PM
Everything is back up, but some servers have lost power. I was almost beginning to worry: it's not true SL style downtime unless there's power loss involved!

Posted by kafloofen, 06-24-2007, 04:02 PM
my server was down 1.5 hours, am I eligible for SLA credit? How do I claim SLA?

Posted by HD Fanatic, 06-24-2007, 04:05 PM
Good thing my server is in sr04. I do hope they get their act together and fix this asap.

Posted by kishornsk, 06-24-2007, 04:06 PM
Finally they gave the update: ====================== Emergency Notification Center Click to Open / Close Known Events https://manage.softlayer.com/img/space.gifhttps://manage.softlayer.com/img/space.gif Date: 06-24-2007 Start time (CDT): 13:00 Services Affected: Public Network Device: SR01 Location: dal01 Duration: Emerging Issue Description: 2:30PM: All service is normal. Due to the high volume of tickets and calls, delays may occur. If your server appears offline, reboot your server or make certain all services are running as normal. The emergency response team is onsite for a post motem analysis and assistance going forward. 2:15PM: All service has been restored to normal. Engineers are onsite and still working. A formal notice will be available within 4 hours. Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly Sincerely, SoftLayer Emergency Response Team https://status.softlayer.com

Posted by RadixHosting, 06-24-2007, 04:09 PM
Post a support ticket? Response time might be higher than usual though.

Posted by MrLister, 06-24-2007, 04:13 PM
Why would he start posting tickets about SLA now and wasting their time when people still have some of their servers down?

Posted by thedavid, 06-24-2007, 04:14 PM
SLA tickets go to sales, not support. And it's his right as a customer to communicate with the company he's purchasing servers from, period.

Posted by smithm34, 06-24-2007, 04:18 PM
You cant, you dont, you wont. Not Long enough all mine seem to be 100%

Posted by WHRKit, 06-24-2007, 04:58 PM
Still down here. The "recommended" reboot from their emergency center notice did not do anything either. At least they responded to my ticket, but we'll see how fast they fix the problems .... Christoph

Posted by resellertr, 06-24-2007, 04:59 PM
I found our server was on Power Off condition. I Power On'ed server.

Posted by digdugdog, 06-24-2007, 05:04 PM
I believe so. it would bring your uptime down to 99.8%, which may result in a 10% credit. You go through the ticket system, but I think you have to be able to prove your case. You SHOULD try it. It'll give them more of a reason to improve their infrastructure.

Posted by Loktari, 06-24-2007, 06:00 PM
I agree. It's not out of spite or greed, but a form of mutually beneficial feedback. That's the price for putting up such an SLA. If they don't want such a financial hit after every outage, all they have to do is to get rid of the SLA. It has to be said: we have some servers with other companies too and a few even offer a 100% SLA. We've never once had to even consider making a claim.

Posted by digdugdog, 06-24-2007, 06:08 PM
I'm not sure this event is over yet. Looks like the private network is down again for me.

Posted by Loktari, 06-24-2007, 06:12 PM
DNS and NAS are both down... I'm hoping the private net doesn't go down, because that would suck (fingers crossed!)

Posted by digdugdog, 06-24-2007, 06:19 PM
Well, it looks like the Private network just came back. It was down for 20 minutes for me. Servers were up, but couldn't connect to the DB server.

Posted by Loktari, 06-24-2007, 06:22 PM
Has anyone had this type of downtime at other providers? I really like the overall setup and attitude at SL and things are great whenever there aren't problems, but every time there is this type of downtime, I can't help feeling stupid for not leaving to a better place.

Posted by digdugdog, 06-24-2007, 06:59 PM
Ugh. The private network being down is killing me. Luckly, it's part of the SLA. Going on over 2 hours of downtime.

Posted by jNive, 06-24-2007, 07:02 PM
yup :-) sent in a ticket about it for good measure. My server is up but cant access it via private network which is also guaranteed to 99.9% so - ah well :-)

Posted by dex101, 06-25-2007, 08:18 AM
Excellent timing! I just moved from LT to SL. Had no downtime with LT in the past *year*.

Posted by digdugdog, 06-25-2007, 03:21 PM
Phew. going on over 24 hours of private network downtime now. I can't believe it! If I could find a place win the same range as softlayer with a private network, I'd certainly consider it!

Posted by sirius, 06-26-2007, 03:20 PM
This is a forum to discuss outages. It is for customers of the provider in question only. Any questions - contact the Helpdesk - http://www.webhostingtalk.com/helpdesk Last edited by sirius; 06-26-2007 at 05:27 PM. Reason: fixed spellin' error

Posted by kafloofen, 06-26-2007, 11:55 PM
SL staff don't care. They didn't even bother to answer the questions put up on their forum about the outage and what they plan to do to avoid the recurrence of such event. Two power outages in 3 months. Go figure.

Posted by nettigritty, 06-29-2007, 02:50 AM
how much downtime has that been?

Posted by HD Fanatic, 06-29-2007, 10:45 AM
https://forums.softlayer.com/showthread.php?t=1716 There was good reason for the delay.

Posted by QualityHost, 06-29-2007, 11:03 AM
Actually, thats not true. SL CEO (Lance) posted a very detailed reply about what happened and what they are doing to prevent this from happening again. I will not post that reply here (maybe they dont want to). If someone from the SL staff reads this topic, maybe they will post it. The forums link above will not work for everyone and is for SL customers only. SL have been great to work with and outages like the ones that happened are a true example of "Murphy's Law". I really do hope they wont happen again.

Posted by Loktari, 06-29-2007, 11:05 AM
I believe the reply wasn't known about or created when the poster made the comment. Nonetheless, such a reply is well received and well appreciated. Now if there is no further downtime (which I hope), then we may forget about these regrettable episodes...



Was this answer helpful?

Add to Favourites Add to Favourites

Print this Article Print this Article

Also Read
Softlayer Down? (Views: 652)
LXAdmin DNS problems (Views: 568)
what is nthe functions (Views: 554)


Language:

Client Login

Email

Password

Remember Me

Search