Update at 10:05:13(BST): Power has now been restored and all services should be functioning as normal.
Update at 09:57:34(BST): prohosts12 and 14 have now been restored to service. The SMTP service has also been restored. These were not directly affected by the power failure so we have been able to restore them before that is resolved. Engineers continue to work on the power failure.
Update at 09:24:02(BST): The engineers have confirmed that this is a power issue and that a faulty piece of equipment is causing one power supply to trip as soon as it is connected. They are now narrowing down the exact piece of equipment so that we can remove it.
Update at 08:43:53(BST): During these SMTP issues customers are still able to log in to their webmail at http://webmail.yourdomain (where yourdomain is your domain name) and send emails.
Update at 08:26:56(BST): Our engineers are still investigating into the issues at present but it appears that our SMTP service is also affected by these issues, customers will notice mail is failing to send and the server appears to be timing out or asking for log on credentials. Do not enter details again at this point but leave it for the time being. Once we have the issue resolved simply restart you mail client and the mail should then send fine.
We are currently experiencing network issues that is causing the below servers to be slow or unresponsive.
Prohost12.34sp.com
Prohost14.34sp.com
Server16.xenserve.com
Server18.xenserve.com
SMTP Array
Our engineers are investigating into this at this moment and hope to have this resolved shortly.
Please accept out apologies for any inconvenience caused and our assurances we are doing all we can to get this resolved as swiftly as possible.
31st May 2012, at 8:02AM
31st May 2012, at 9:05AM
Update at 20:37:47(BST): All smtp servers are now back online , there should be no email loss due to this issue it will just have been queued on the authentication server and will still be delivered.
We will be bringing a few more servers online this upcoming week on different locations on our network so that should something like this occur again it will not affect this.
26th May 2012, at 3:18PM
26th May 2012, at 7:37PM
Update at 01:40:44(BST): The issue has now been resolved with this server.VPS22,23 and 25 were all back on the network between 1.10 and 1.25AM. We apologise for the extra time in getting these last few services online, due to some final switch configuration issues.
Update at 01:09:21(BST): Reseller 21 is now back online.
Update at 00:06:35(BST): The switch was replaced successfully and access restored as of 11.05PM. Since then reseller21, VPS22,23 and 25 have had difficulties re-establishing connections to the network. We continue to work on these last few systems.
Update at 22:49:48(BST): The replacement switch configuration is now complete and our engineer is now back on site replacing the faulty switch with the replacement.
Update at 21:34:49(BST): Please note that our email support system is a server affected so we are unable to reply to support tickets until the switch is replaced.
Update at 21:22:40(BST): Our engineer has indicated he expects the resolution to take 90 minutes to replace and reconfigure the switching equipment.
Update at 21:08:31(BST): Our engineer has confirmed that one of our core switches has failed. This has led to the network disconnection of the aforementioned servers and a number of dedicated client servers. Our engineer is now obtaining a replacement switch to replace the failed unit with. As we carry spares this should be a relatively quick process.
Update at 20:50:01(BST): We have an engineer on site now checking the affected piece of equipment.
We are investigating the unavailability of a switching system in Manchester. This is affecting VPS servers 22, 23, 25, reseller server21 and a couple of dedicated clients.
25th May 2012, at 8:31PM
26th May 2012, at 12:40AM
Update at 20:29:21(BST): The issue has now been resolved with this server.We're experiencing some network issues at the moment. We're locating the issue and we'll have our services back to normal as soon as possible.
25th May 2012, at 10:30AM
25th May 2012, at 7:29PM
Update at 10:42:34(BST): The issue has now been resolved with this server.
Engineers resolved this issue yesterday afternoon. Apologies for any inconvenience caused.
Engineers are currently running a repair on the database. Apologies for any inconvenience caused.
23rd May 2012, at 3:47PM
24th May 2012, at 9:42AM
Update at 17:59:17(BST): The issue has now been resolved with this server.
The server is now back on-line. Apologies for any inconvenience caused.
Engineers have had to perform an emergency reboot as this server had stopped responding. Apologies for any inconvenience caused.
20th May 2012, at 5:49PM
20th May 2012, at 4:59PM
Update at 10:42:57(BST): Update at 10:09:53(BST):
As a result of the weekend spam attack, we are still aware of a 30 minute delay on sent emails. This is being processed as fast as possible. We thank you for your patience and assure you we are doing all we can to prevent this in future.
Update at 17:15:15(BST):
Outgoing email is now flowing normally again. We are aware that some emails sent on Friday are awaiting delivery. We are currently working on cleaning the remainder of spam and delivering those at present. Apologies for any inconvenience caused.
Unfortunately a customer account has been compromised. Large volumes of spam has been sent as a result and this is causing delays. Apologies for any inconvenience caused.
19th May 2012, at 2:32PM
24th May 2012, at 9:42AM
Update at 12:21:23(BST): This issue has been resolved and our site is accessible as normal.
15th May 2012, at 11:59AM
15th May 2012, at 11:21AM
Update at 12:20:50(BST): These servers are now accessible again.
15th May 2012, at 11:53AM
15th May 2012, at 11:20AM
Update at 10:18:36(BST): Email services are now running normally.
Update at 19:02:15(BST): Work continued to tweak and optimize email services through the afternoon and early evening. As of 6.50pm or so, email services should be largely fine for most users.
While you may see a small delay as backlogged email is processed, no email should be lost.
If you see authentication errors please try restarting your computer and/or mail client to rule out caching issues.
Update at 16:43:55(BST):
We are still seeing an increased level of connections to our email servers as delayed email continues to arrive. Customers should no longer be having any difficulty in connecting to webmail or using their mail clients with our mail services.
Update at 14:45:57(BST):
Delayed email from earlier in the day is now being delivered and when this is complete we will have the email service restored to full functionality.
Update at 13:17:45(BST):
We are still making improvements to the authentication database. Email is working again but may be slow to authenticate.
Update at 11:36:49(BST):
We are currently running some optimisations to improve the speed of authentications. You may not be able to connect to email during this time and webmail may mention a database issues.
We thank you for your continued patience.
Update at 10:13:18(BST):
Our engineers are currently investigating the cause of the periodic slowness in logins. We thank you for your patience in this matter. Restarting your email program can fix the issue.
Update at 15:40:07(BST):
Our engineers are aware this issue re appeared for the last 5 minutes. We are now monitoring the mail system until further notice.
Update at 10:55:02(BST): .
This issue has now been resolved. Apologies for any inconvenience caused. We thank you for your patience.
Our engineers are currently looking into reported issues with logging into email. This is affecting webmail and mail clients. Apologies for any inconvenience caused.
14th May 2012, at 10:17AM
16th May 2012, at 9:18AM