Posted by absolut, 06-24-2007, 02:09 PM |
Hi
It seems like SF is down. It's the first time for me... Sadly.
|
Posted by hosteur, 06-24-2007, 02:09 PM |
Ping Results:
PING softlayer.com (66.228.118.22) 56(84) bytes of data.
--- softlayer.com ping statistics ---
5 packets transmitted, 0 received, 100% packet loss, time 4002ms
It just me or...
It was ok a few hour ago and now...
|
Posted by 0utlier, 06-24-2007, 02:10 PM |
Yes, my servers on the 66.228.121.x IP's are down.
|
Posted by absolut, 06-24-2007, 02:11 PM |
It's looks as power failure.
|
Posted by hosteur, 06-24-2007, 02:11 PM |
75.126.1xx.xxx
Mine are up and running...
Last edited by hosteur; 06-24-2007 at 02:16 PM.
|
Posted by TCP/IP Warrior, 06-24-2007, 02:17 PM |
I am experiencing the same thing from Florida... can't get to their home page.
However,
I can get to the internal network and to the server itself.
|
Posted by 0utlier, 06-24-2007, 02:18 PM |
www.softlayer.com is down for me too.
|
Posted by jasonhk, 06-24-2007, 02:19 PM |
Same here..
po52.fcr01.dal01.dallas-datacenter.com then timeouts ..
|
Posted by vengefuldeath87, 06-24-2007, 02:21 PM |
one of my servers is down, other is up, cant vpn or get on half of their site...
|
Posted by eth00, 06-24-2007, 02:22 PM |
Down here as well for parts of it. It gets into the datacenter and appears to go to the last switch before dieing
|
Posted by eth00, 06-24-2007, 02:24 PM |
Good to know, so at least your server has not lost power, hopefully that is the case with others as it would minimize the time to get it all back up.
|
Posted by sanudeep, 06-24-2007, 02:24 PM |
softlayer site is down , but our servers are running
|
Posted by WHRKit, 06-24-2007, 02:25 PM |
Very frustrating. How many times has something like this now happened this year?! This is it for me. I just saw the competing offer from the planet (10% below Softlayer + free setup) and my stuff will be moving soon. I never had that much downtime with the planet before I moved everything to Softlayer.
Christoph
|
Posted by thedavid, 06-24-2007, 02:27 PM |
Hmm, I was able to get to the portal, and add a ticket for the downtime, but now I'm not.
Perhaps they're fixing the problem, or maybe it's getting worse. I dunno.
Edit: Now everything's down, including our other servers there.
|
Posted by kafloofen, 06-24-2007, 02:29 PM |
Can anyone reach softlayer?
|
Posted by animelab, 06-24-2007, 02:30 PM |
My bad!
Just kidding. I am down too 208.101.42.10!
|
Posted by Servax, 06-24-2007, 02:31 PM |
All my servers in softlayer just went down..
|
Posted by vengefuldeath87, 06-24-2007, 02:31 PM |
yep, just lost the other server too...
|
Posted by Increhost, 06-24-2007, 02:31 PM |
I´m in Uruguay an cannot, 15 minutes down I think, I don´t know why at least they put an offsite support panel... so we can see at least what´s happening...
|
Posted by eth00, 06-24-2007, 02:31 PM |
http://www.webhostingtalk.com/showthread.php?t=615203
Looks like network, some people are ssh'ing via the private network and the servers are still online
|
Posted by thedavid, 06-24-2007, 02:31 PM |
Direct your attention to the softlayer thread in the outages forum:
http://www.webhostingtalk.com/showthread.php?t=615203
|
Posted by Servers4me, 06-24-2007, 02:31 PM |
Yeh everthing is down for us aswell.
Its getting to the Border Router and dieing. There outages and network is starting to go downhill, when they first started out they never had this many problems.
We still won't move away from them as they have always done right by us.
|
Posted by TCP/IP Warrior, 06-24-2007, 02:31 PM |
Same here
|
Posted by QualityHost, 06-24-2007, 02:31 PM |
Yes, all our servers are down also
|
Posted by 3x-a-D3-u5, 06-24-2007, 02:32 PM |
So they've been down before? cos i've just started hosting i cant get a bad name already...
|
Posted by (Stephen), 06-24-2007, 02:32 PM |
Bah, off network forums are down now due to this. Our network is up and chugging along just the softlayer based external forums are down
|
Posted by kafloofen, 06-24-2007, 02:32 PM |
This is the second time in a span of what 2 months?
|
Posted by drumman24, 06-24-2007, 02:32 PM |
Down Down Down, someone should add up the total downtime in the past year. Ridiculous! I will be moving soon!
|
Posted by IHSL, 06-24-2007, 02:32 PM |
All servers we have there are up but their portal is down. It's also sending tons of false alerts.
Simon
|
Posted by Loktari, 06-24-2007, 02:32 PM |
Another downtime point for softlayer... at least we had some issue-free weeks, let's hope for a full month without issues now (sigh).
|
Posted by TonyB, 06-24-2007, 02:33 PM |
Only machines up for me are in sr04 everything else is down.
|
Posted by Increhost, 06-24-2007, 02:33 PM |
yeah, even softlayer.com is down
|
Posted by Servax, 06-24-2007, 02:33 PM |
Three servers just went down here.
|
Posted by kafloofen, 06-24-2007, 02:34 PM |
It seems they have no contingency whatsoever
|
Posted by Servers4me, 06-24-2007, 02:35 PM |
Our servers are backup now.
|
Posted by (Stephen), 06-24-2007, 02:36 PM |
not here
|
Posted by kafloofen, 06-24-2007, 02:36 PM |
still down here
|
Posted by MrLister, 06-24-2007, 02:37 PM |
where are they located? any storm reports?
|
Posted by Increhost, 06-24-2007, 02:37 PM |
I think at least they should put an offsite support panel...
so we can see what´s happening... too many minutes down, and our customers
doesn´t care about if we can get inside our servers by vpn, they just want website & email working, it´s frustrating not to have any info about this issue
|
Posted by Servers4me, 06-24-2007, 02:37 PM |
Don't think its power related, as the Border router is still online.
|
Posted by 3x-a-D3-u5, 06-24-2007, 02:37 PM |
IP's 208.101.45.117* still down 2
|
Posted by jhadley, 06-24-2007, 02:38 PM |
We really have so many problems that a "this appears to be an issue concerning the whole SoftLayer facility...." canned response in our ticket system is really quite necessary.
Uptime at SoftLayer is terrible, unfortunately we still have some customers at the facility who can't easily be moved to another facility.
|
Posted by RadixHosting, 06-24-2007, 02:38 PM |
Their site seems to be online, portal down though.
Server on 75.126.x.x down.
My timer is running, I'll be looking at their SLA soon...
|
Posted by eth00, 06-24-2007, 02:38 PM |
Dallas TX,
http://www.weather.com/weather/map/c...nav_undeclared
weather looks fine
Still everything is down here
|
Posted by 2Mhost, 06-24-2007, 02:39 PM |
most of my servers there are down .. welcome!
|
Posted by kafloofen, 06-24-2007, 02:40 PM |
My previous provider had better uptime than SL. Too bad I transferred.
|
Posted by paulius, 06-24-2007, 02:40 PM |
it's down... WOW!
|
Posted by Plutomic-Andrew, 06-24-2007, 02:40 PM |
Softlayer is down for me too as well as one of our servers.
|
Posted by BitSurFer, 06-24-2007, 02:40 PM |
same here
down
Last edited by BitSurFer; 06-24-2007 at 02:45 PM.
|
Posted by Acroplex, 06-24-2007, 02:42 PM |
Same here.
|
Posted by RadixHosting, 06-24-2007, 02:42 PM |
Their sales department is closed by the way, though they should be open:
9:00AM to 7:00PM Central time Saturday and Sunday.
Does anyone has a technical support phone number? I can't reach their contact page...
|
Posted by MIRhosting.com, 06-24-2007, 02:42 PM |
Yes, too bad for them... Seems, we should begin to think about possibility to move some servers away
|
Posted by Servax, 06-24-2007, 02:43 PM |
I haven't had many issues with SoftLayer, last downtime I received on any server from SoftLayer was about two three months I think.
|
Posted by heavypredato, 06-24-2007, 02:43 PM |
tech support phone is set to record messages.
1-866-403-7638
|
Posted by Acroplex, 06-24-2007, 02:43 PM |
Same here. A large online community, NamePros.com is also down as well due to them being hosted on Softlayer.
|
Posted by Servers4me, 06-24-2007, 02:44 PM |
(214) -442-0602 - Office
(866) -398-7638 - Toll Free
|
Posted by taranonline, 06-24-2007, 02:44 PM |
Down here too
|
Posted by ckissi, 06-24-2007, 02:44 PM |
Is there anybody who knows what's going on there ?
|
Posted by smithm34, 06-24-2007, 02:44 PM |
SLA BEGINS AGAIN!! LOLOL
|
Posted by digdugdog, 06-24-2007, 02:45 PM |
Most of my servers are up, but a few of my main ones down, so it's all effectively down! erg. It's looking bad. Any guesses on timeframe for recovery?
|
Posted by JeddaHost, 06-24-2007, 02:45 PM |
The same thing
softlayer and all my servers are down !!!
|
Posted by kafloofen, 06-24-2007, 02:45 PM |
no contingency measures
that's a sign of great provider
|
Posted by RadixHosting, 06-24-2007, 02:46 PM |
That's their sales department... Tried to call but get voicemail.
|
Posted by NetLineHost, 06-24-2007, 02:46 PM |
All of my servers with Softlayer are also down. Wonder if they are going to use "The tech dropped the router off the counter" this time...
|
Posted by prixone, 06-24-2007, 02:46 PM |
hard to know when their phone has nobody to pickup
support plus sales = secretary machine
btw im on the boat
|
Posted by rv_irl, 06-24-2007, 02:46 PM |
This is just ridiculous. Only one of our servers at SL seems affected, but nevertheless it is pathetic how many problems they have..
I guess it is time to start planning a migration
|
Posted by Servers4me, 06-24-2007, 02:47 PM |
Sales are there, so it must be because there all busy with this issue.
|
Posted by TonyB, 06-24-2007, 02:47 PM |
You can't win it seems
|
Posted by sigmaweb, 06-24-2007, 02:47 PM |
45 minutes down!!!
|
Posted by joshw, 06-24-2007, 02:48 PM |
Same here. My server and the softlayer.com server itself. Does anyone have a phone number for their support team? I only see the sales number, and nobody ever picks that up.
|
Posted by Loktari, 06-24-2007, 02:48 PM |
Bwah, every time you think and hope they got their act together, another issue arises. It's so frustrating when at every outage, all of your servers go down... there's just no way to "route around" an outage there, except by going to another DC.
|
Posted by q2261, 06-24-2007, 02:48 PM |
i'm getting pretty tired of this as well...my main webserver had a Hard drive issue about 8 hours ago, box went offline, came back only after 1.5 hours. Then same problem came back a couple of hours ago, box just disappeated off the face of the earth, SL has been investigating for two hours, and now in the middle of all this half the DC goes down. WTF?
|
Posted by heavypredato, 06-24-2007, 02:48 PM |
im online now
|
Posted by zefefre, 06-24-2007, 02:48 PM |
anybody knows whats going on? I couldn't even access the support portal.
|
Posted by 3x-a-D3-u5, 06-24-2007, 02:49 PM |
Servers4me: That a happy thought just hope you're right
|
Posted by Valera, 06-24-2007, 02:49 PM |
After two or three consequtive downtimes few months ago, here we go again. I was just getting calm about it all...
I recommend watching your downtime minutes carefully as last time they've cheated on the amount of SLA credit for me and at least some other customers.
|
Posted by Servax, 06-24-2007, 02:49 PM |
One of mine just went back up, two to go.
|
Posted by Acroplex, 06-24-2007, 02:49 PM |
"At 4pm Eastern president GW Bush will address the nation. We are at war with China. A nuclear warhead has been intercepted over California but conventional warheads made it to Texas."
This is the only excuse I'd accept for such downtime :-)
|
Posted by rumahweb, 06-24-2007, 02:50 PM |
2 server down (
1 up (75.126.201.10)
I hope it's not a power failure again!
|
Posted by TonyB, 06-24-2007, 02:50 PM |
Only machines that are up for me are in sr04 (newest area SL is putting servers)
|
Posted by Increhost, 06-24-2007, 02:50 PM |
how many time is this down ?
I can´t belive it, my $7.90 VPS has better uptime than SL
no phone support? no offsite support ? no explanations at all ?
just pathethic, looking really for a new provider to migrate
|
Posted by tuwebfacil, 06-24-2007, 02:50 PM |
My servers are online online now (wasn't online minutes ago), but I can't access their website.
But, as far I can access my servers I am pretty happy
First time for me in about a year.
|
Posted by ckissi, 06-24-2007, 02:50 PM |
My is up again
|
Posted by RadixHosting, 06-24-2007, 02:50 PM |
Your HD must have caught fire and burned down the whole dc
|
Posted by Acroplex, 06-24-2007, 02:51 PM |
We're back up, thank you Mr. Bush for restoring the Internets
|
Posted by animelab, 06-24-2007, 02:51 PM |
Woot i am up! Server didn't reboot, so looks like a network issue.
|
Posted by Samuraid, 06-24-2007, 02:51 PM |
My server was down a moment ago, and I could not reach the Portal nor softlayer.com, but it seems like my server is back on the public network now, and the uptime is 23 days so it's definitely some sort of network issue.
|
Posted by smithm34, 06-24-2007, 02:51 PM |
only 2 numbers
tech, 866-403-7638
sales, 866-398-7638
And no one picks up anywhere.
I think i'll go play some wow and try not to stress out about my 5000 msgs and emails and money im loosing right now.
|
Posted by Servers4me, 06-24-2007, 02:51 PM |
Everyone breath in and breath out. They have probably put there resources into fixing the problem.
But yes it is causing frustration as this isnt the first and I doubt it will be the last.
|
Posted by digdugdog, 06-24-2007, 02:51 PM |
some of my servers are starting to show life.
Looks like it was network, not power. Servers still have uptime.
Like, on one of my servers, I have public network, but not private network.
Last edited by digdugdog; 06-24-2007 at 02:55 PM.
|
Posted by prixone, 06-24-2007, 02:51 PM |
if they even cared about us they should have changed the phone message at least instead of monday to friday work time since they wont pickup their phones
|
Posted by zefefre, 06-24-2007, 02:52 PM |
my server is up again now.
|
Posted by RadixHosting, 06-24-2007, 02:52 PM |
The Planet used to have such issues which is why I moved to SL...
Anyways mine is up again too. Hope it stays like this.
|
Posted by rumahweb, 06-24-2007, 02:52 PM |
Network problem I guess. My servers is up now and there was no problem with uptime (still 126 days since last reboot)
|
Posted by 2Mhost, 06-24-2007, 02:52 PM |
up again, outage for me was 10 mins or so
|
Posted by NetLineHost, 06-24-2007, 02:53 PM |
Looks like all services are back to running?
|
Posted by donniesd, 06-24-2007, 02:54 PM |
Any one tally how long we were down?
|
Posted by Valera, 06-24-2007, 02:54 PM |
Back up for me. 26 min downtime according to Pingdom, that means no SLA credit, heh.
|
Posted by Veus, 06-24-2007, 02:54 PM |
208.101.14.* is still down for me.
|
Posted by smithm34, 06-24-2007, 02:55 PM |
Looks like no.
|
Posted by Increhost, 06-24-2007, 02:55 PM |
not at all, their site is down, and my server too
|
Posted by 3x-a-D3-u5, 06-24-2007, 02:55 PM |
Well im still down... ;-(
|
Posted by zymic, 06-24-2007, 02:55 PM |
backup for me now, phew
|
Posted by CozmicShredder, 06-24-2007, 02:56 PM |
Doh all our servers are down as well!!!!
|
Posted by smithm34, 06-24-2007, 02:57 PM |
Anyone know the exact time of outage ?
|
Posted by coight, 06-24-2007, 02:57 PM |
We are still down, have a bunch in 208.101.X down still. No info from them via phone (voicemail)
|
Posted by joshiee, 06-24-2007, 02:57 PM |
we're back up 208.101.60.x
|
Posted by Servax, 06-24-2007, 02:57 PM |
Two servers up here, one down still.
|
Posted by RadixHosting, 06-24-2007, 02:58 PM |
Get some Prozac
|
Posted by Increhost, 06-24-2007, 02:58 PM |
what do you mean ? you don´t pay ?
how many minutes is the limit ?
|
Posted by Loktari, 06-24-2007, 02:58 PM |
Some are up, some are down... private network is more down than up.
|
Posted by 3x-a-D3-u5, 06-24-2007, 02:59 PM |
Well 208.101.45.* still out.. (must the VERY last server in the rack....)
|
Posted by (Stephen), 06-24-2007, 02:59 PM |
We had downtime from 1:06PM until 1:56PM
|
Posted by rv_irl, 06-24-2007, 03:00 PM |
My one server that was done, is now up again. But as soon as that went up, a different server went down.
Really not happy about this..
Tried to cheat us out of it too. All monitoring systems showed we qualified for SLA credit, they refused.. We had to compromise and accept something less..
|
Posted by HE/LW-Sam, 06-24-2007, 03:01 PM |
May be some one stepped on power again
They are really getting common now
|
Posted by RadixHosting, 06-24-2007, 03:01 PM |
I still can't access their site properly. Do you mind pasting their SLA table?
|
Posted by digdugdog, 06-24-2007, 03:01 PM |
customer portal is back for me, it's showing everything as ok, though, a few servers still unreachable.
|
Posted by 3x-a-D3-u5, 06-24-2007, 03:01 PM |
LOL
Really now, is that the first thing that comes to your mind?
|
Posted by joshiee, 06-24-2007, 03:02 PM |
server cant access dns resolvers AHG
|
Posted by RadixHosting, 06-24-2007, 03:03 PM |
I'm afraid so...
|
Posted by hytek, 06-24-2007, 03:03 PM |
Public Network, Private Network, Customer Portal, and Infrastructure SLA listed below:
Uptime Guarantee SLA Credit
99.9% Guaranteed
99.8% 10%
99.7% 20%
99.6% 30%
99.5% 40%
99.4% 50%
99.3% 60%
99.2% 70%
99.1% 80%
99.0% 90%
Less than 99.0% 100%
|
Posted by rv_irl, 06-24-2007, 03:04 PM |
23 minute downtime on one server... but it's up now..
Another server has 35 minute downtime and is still down..
|
Posted by Valera, 06-24-2007, 03:04 PM |
Well, SL guarantees 99.9% uptime.
30 days x 24 hours x 60 minutes = 43200 minutes * 0.1% = 43.2 min
So you've got to be down for over 40 min to be able to claim 10% off for this month.
I must admit I prefer not being down than racking up SLA credit though. It's peak time now too.
|
Posted by kafloofen, 06-24-2007, 03:04 PM |
one hour downtime here
|
Posted by smithm34, 06-24-2007, 03:04 PM |
Can you give me the link to the portal digdugdog ?
|
Posted by Ks Jeppe, 06-24-2007, 03:05 PM |
The portal shows all public networks are failed, but my server works fine, and connecting to it works as well... It's in the new area though, so might just be the old ones as TonyB pointed out..
|
Posted by prixone, 06-24-2007, 03:05 PM |
good calcs... up there
inst that 1hour and 14 minutes for 31 days
|
Posted by QualityHost, 06-24-2007, 03:06 PM |
If this was FITX, most people would be screaming up their $@#%$& by now ..... LOL
I do hope SL can fix this repeated downtime issue ASAP.
|
Posted by coight, 06-24-2007, 03:06 PM |
DNS is down as mentioned earlier. We still have a handful of servers that are NOT working.
|
Posted by joshiee, 06-24-2007, 03:07 PM |
ok i just changed the resolvers in /etc/resolv.conf to 4.2.2.2 and 4.2.2.3
the only dns servers i know by heart. haha
|
Posted by Increhost, 06-24-2007, 03:08 PM |
softlayer.com is up, my server still down !!!!
so only 10% discount ? it´s a joke
|
Posted by kafloofen, 06-24-2007, 03:08 PM |
Date: 06-24-2007
Start time (CDT): 13:00
Services Affected: Public Network
Device: SR01
Location: dal01
Duration: Emerging Issue
Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly
Sincerely,
SoftLayer Emergency Response Team
|
Posted by digdugdog, 06-24-2007, 03:08 PM |
Start time (CDT): 13:00
Services Affected: Public Network
Device: SR01
Location: dal01
Duration: Emerging Issue
Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly
|
Posted by sigmaweb, 06-24-2007, 03:09 PM |
Where exactly in the customer portal can be proven the exact downtime?
|
Posted by kafloofen, 06-24-2007, 03:09 PM |
Date: 06-24-2007
Start time (CDT): 13:00
Services Affected: Public Network
Device: SR01
Location: dal01
Duration: Emerging Issue
Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly
Sincerely,
SoftLayer Emergency Response Team
|
Posted by jackonline, 06-24-2007, 03:10 PM |
yep my VPS http://www.domainsdot.net and all websites is down too
|
Posted by smithm34, 06-24-2007, 03:10 PM |
Yea its just SR01 / SR02
Umm it appears to be comming back up though
|
Posted by hosteur, 06-24-2007, 03:11 PM |
SoftLayer.com is back online, now!
-----------------------------------------
Date: 06-24-2007
Start time (CDT): 13:00
Services Affected: Public Network
Device: SR01
Location: dal01
Duration: Emerging Issue
Description: Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly
Sincerely,
SoftLayer Emergency Response Team
https://status.softlayer.com
--------------------------------------------------------
From the portal
|
Posted by HE/LW-Sam, 06-24-2007, 03:11 PM |
The main site is up for me now....seems like everything shall be normal soon.
|
Posted by Valera, 06-24-2007, 03:12 PM |
Well, the "guaranteed" is next to 99.9%, that means they got to pay if your uptime is any lower than 99.9%. If they pay only if uptime is 99.8% or lower, that means they are actually guaranteeing 99.8%.
They use various strategies to avoid paying as much SLA credit as they're supposed to. So keep careful logs, persist, and let them know that you'll be making the matter public on WHT where they advertise, if they don't acknowlege reliable reports that you supply from third party monitoring.
|
Posted by Crucial Web Host, 06-24-2007, 03:12 PM |
As bad as two network outages in as many months are...
SoftLayer is STILL by far better than ThePlanet.
All our servers are up and running. Only lost one vlan in this downtime.
|
Posted by RadixHosting, 06-24-2007, 03:12 PM |
The funny part is: About 1 hour ago I replied the following to a sales ticket: "Our servers are hosted on the SoftLayer public network, which is extremely redundant and reliable."
Well actually that's not funny at all, I'm losing potentional customers...
|
Posted by SoftDux, 06-24-2007, 03:13 PM |
I can access their site, is anyone else still having problems?
|
Posted by 0utlier, 06-24-2007, 03:14 PM |
My servers at 66.228.121.x are still down
|
Posted by prixone, 06-24-2007, 03:15 PM |
all fine here, i am checking now for how long we being offline to know if we fit in the SLA...
|
Posted by Loktari, 06-24-2007, 03:15 PM |
Yes, some servers are still down and the private network doesn't work.
All in all: it's down.
Bah!
|
Posted by prixone, 06-24-2007, 03:18 PM |
by what i see we will get refund only at 99.8%
softlayer.com/sla.html
|
Posted by coight, 06-24-2007, 03:18 PM |
Yes 1 server now
|
Posted by Servax, 06-24-2007, 03:20 PM |
An update to it:
Date: 06-24-2007
Start time (CDT): 13:00
Services Affected: Public Network
Device: SR01
Location: dal01
Duration: Emerging Issue
Description: 2:15PM: All service has been restored to normal. Engineers are onsite and still working. A formal notice will be available within 4 hours.
Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly
Sincerely,
SoftLayer Emergency Response Team
https://status.softlayer.com
Funny how one of my servers are still down though.
|
Posted by Kasey, 06-24-2007, 03:21 PM |
Same here... only lost one of my three during this whole event, and it's still down.
|
Posted by 3x-a-D3-u5, 06-24-2007, 03:21 PM |
Apparently These are still offline:
66.228.121.x
208.101.45.x
|
Posted by thedavid, 06-24-2007, 03:21 PM |
Looks like a power issue:
root@civateto2 [~]# uptime
15:18:40 up 6 min, 1 user, load average: 8.03, 5.49, 2.32
root@obayifo [~]# uptime
15:25:14 up 10 min, 1 user, load average: 11.43, 6.23, 2.81
|
Posted by kmike, 06-24-2007, 03:22 PM |
Two of our servers were rebooted, and the private network is still down.
And what's more, just a few minutes before the outage, one of the servers had the hard disk failure in its RAID. I wonder how much time will pass till the support will be able to look into it now.
|
Posted by smithm34, 06-24-2007, 03:22 PM |
1 of my machines still down.
Wanted to check power status;
Power strip control is not available for this server at this time.
|
Posted by Veus, 06-24-2007, 03:22 PM |
and 208.101.14.x is still down
|
Posted by jNive, 06-24-2007, 03:26 PM |
if the private network is down then that would still be downtime as i believe its included in the SLA isnt it
|
Posted by Ks Jeppe, 06-24-2007, 03:28 PM |
From the client portal
|
Posted by Valera, 06-24-2007, 03:28 PM |
Well this is another subtle lie, as "99.9% guaranteed" by definition means "no less than 99.9% uptime guaranteed" and then in reality avoidance of compensation between 99.9% and 99.8% uptime. But mainly this is to throw 10% off the next SLA tiers.
I've had 3h 22m downtime during this one. Interesting thing to note is that both issues are on SR01.
|
Posted by prixone, 06-24-2007, 03:35 PM |
SO CONFUSED with all this time passed.
my bandwidth graphs stopped at 12:00 ... and since i am still with no vpn access i cant really check from inside one of my servers.
|
Posted by digdugdog, 06-24-2007, 03:38 PM |
looks like all mine are back. 1.5 hours downtime.
|
Posted by MrLister, 06-24-2007, 03:41 PM |
power issue in sr01
|
Posted by kishornsk, 06-24-2007, 03:41 PM |
The SL server are now back up. Still no update from them what caused the issue.
|
Posted by steven-v, 06-24-2007, 03:43 PM |
Nothing for me, must be isolated issue... My servers are up.
|
Posted by MrLister, 06-24-2007, 03:45 PM |
only some are back up. servers in sr01 are experiencing power failure (IMPI indicated power status if off) and network issues
|
Posted by ImageLeet, 06-24-2007, 03:52 PM |
Softlayer.com was down for me but our servers were up
|
Posted by jasonhk, 06-24-2007, 03:53 PM |
208.101.45.x is UP...
|
Posted by RadixHosting, 06-24-2007, 03:54 PM |
2500 Amps? Don't they mean milliampere?
Edit: Nevermind
Last edited by RadixHosting; 06-24-2007 at 04:04 PM.
|
Posted by MrLister, 06-24-2007, 03:56 PM |
load balancer still down but all the servers up
|
Posted by Loktari, 06-24-2007, 03:56 PM |
Everything is back up, but some servers have lost power. I was almost beginning to worry: it's not true SL style downtime unless there's power loss involved!
|
Posted by kafloofen, 06-24-2007, 04:02 PM |
my server was down 1.5 hours, am I eligible for SLA credit?
How do I claim SLA?
|
Posted by HD Fanatic, 06-24-2007, 04:05 PM |
Good thing my server is in sr04. I do hope they get their act together and fix this asap.
|
Posted by kishornsk, 06-24-2007, 04:06 PM |
Finally they gave the update:
======================
Emergency Notification Center
Click to Open / Close
Known Events
https://manage.softlayer.com/img/space.gifhttps://manage.softlayer.com/img/space.gif
Date: 06-24-2007 Start time (CDT): 13:00 Services Affected: Public Network Device: SR01 Location: dal01 Duration: Emerging Issue Description: 2:30PM: All service is normal. Due to the high volume of tickets and calls, delays may occur. If your server appears offline, reboot your server or make certain all services are running as normal. The emergency response team is onsite for a post motem analysis and assistance going forward.
2:15PM: All service has been restored to normal. Engineers are onsite and still working. A formal notice will be available within 4 hours.
Engineers are currently working to resolve connectivity issues for all servers located in SR01. An update will be available shortly
Sincerely,
SoftLayer Emergency Response Team
https://status.softlayer.com
|
Posted by RadixHosting, 06-24-2007, 04:09 PM |
Post a support ticket? Response time might be higher than usual though.
|
Posted by MrLister, 06-24-2007, 04:13 PM |
Why would he start posting tickets about SLA now and wasting their time when people still have some of their servers down?
|
Posted by thedavid, 06-24-2007, 04:14 PM |
SLA tickets go to sales, not support. And it's his right as a customer to communicate with the company he's purchasing servers from, period.
|
Posted by smithm34, 06-24-2007, 04:18 PM |
You cant, you dont, you wont. Not Long enough all mine seem to be 100%
|
Posted by WHRKit, 06-24-2007, 04:58 PM |
Still down here. The "recommended" reboot from their emergency center notice did not do anything either. At least they responded to my ticket, but we'll see how fast they fix the problems ....
Christoph
|
Posted by resellertr, 06-24-2007, 04:59 PM |
I found our server was on Power Off condition. I Power On'ed server.
|
Posted by digdugdog, 06-24-2007, 05:04 PM |
I believe so. it would bring your uptime down to 99.8%, which may result in a 10% credit. You go through the ticket system, but I think you have to be able to prove your case.
You SHOULD try it. It'll give them more of a reason to improve their infrastructure.
|
Posted by Loktari, 06-24-2007, 06:00 PM |
I agree. It's not out of spite or greed, but a form of mutually beneficial feedback. That's the price for putting up such an SLA. If they don't want such a financial hit after every outage, all they have to do is to get rid of the SLA.
It has to be said: we have some servers with other companies too and a few even offer a 100% SLA. We've never once had to even consider making a claim.
|
Posted by digdugdog, 06-24-2007, 06:08 PM |
I'm not sure this event is over yet. Looks like the private network is down again for me.
|
Posted by Loktari, 06-24-2007, 06:12 PM |
DNS and NAS are both down... I'm hoping the private net doesn't go down, because that would suck (fingers crossed!)
|
Posted by digdugdog, 06-24-2007, 06:19 PM |
Well, it looks like the Private network just came back. It was down for 20 minutes for me. Servers were up, but couldn't connect to the DB server.
|
Posted by Loktari, 06-24-2007, 06:22 PM |
Has anyone had this type of downtime at other providers? I really like the overall setup and attitude at SL and things are great whenever there aren't problems, but every time there is this type of downtime, I can't help feeling stupid for not leaving to a better place.
|
Posted by digdugdog, 06-24-2007, 06:59 PM |
Ugh. The private network being down is killing me. Luckly, it's part of the SLA. Going on over 2 hours of downtime.
|
Posted by jNive, 06-24-2007, 07:02 PM |
yup :-) sent in a ticket about it for good measure. My server is up but cant access it via private network which is also guaranteed to 99.9% so - ah well :-)
|
Posted by dex101, 06-25-2007, 08:18 AM |
Excellent timing! I just moved from LT to SL. Had no downtime with LT in the past *year*.
|
Posted by digdugdog, 06-25-2007, 03:21 PM |
Phew. going on over 24 hours of private network downtime now. I can't believe it!
If I could find a place win the same range as softlayer with a private network, I'd certainly consider it!
|
Posted by sirius, 06-26-2007, 03:20 PM |
This is a forum to discuss outages.
It is for customers of the provider in question only.
Any questions - contact the Helpdesk - http://www.webhostingtalk.com/helpdesk
Last edited by sirius; 06-26-2007 at 05:27 PM.
Reason: fixed spellin' error
|
Posted by kafloofen, 06-26-2007, 11:55 PM |
SL staff don't care. They didn't even bother to answer the questions put up on their forum about the outage and what they plan to do to avoid the recurrence of such event.
Two power outages in 3 months. Go figure.
|
Posted by nettigritty, 06-29-2007, 02:50 AM |
how much downtime has that been?
|
Posted by HD Fanatic, 06-29-2007, 10:45 AM |
https://forums.softlayer.com/showthread.php?t=1716
There was good reason for the delay.
|
Posted by QualityHost, 06-29-2007, 11:03 AM |
Actually, thats not true. SL CEO (Lance) posted a very detailed reply about what happened and what they are doing to prevent this from happening again.
I will not post that reply here (maybe they dont want to). If someone from the SL staff reads this topic, maybe they will post it.
The forums link above will not work for everyone and is for SL customers only.
SL have been great to work with and outages like the ones that happened are a true example of "Murphy's Law". I really do hope they wont happen again.
|
Posted by Loktari, 06-29-2007, 11:05 AM |
I believe the reply wasn't known about or created when the poster made the comment. Nonetheless, such a reply is well received and well appreciated. Now if there is no further downtime (which I hope), then we may forget about these regrettable episodes...
|
|
Add to Favourites
Print this Article |