34SP.com System Status History

Business5 (business5.34sp.com)

resolved

Description

Update at 19:54:06(GMT): The issue has now been resolved with this server.

Update at 19:46:42(GMT): The machine has now been powercycled.

This server has become unreachable and we are presently investigating this fault.

Start Time

7th January 2011, at 7:28PM

Resolution Time

7th January 2011, at 7:54PM

Server10 (server10.xenserve.com)

resolved

Description

Update at 23:25:43(GMT): The issue has now been resolved with this server.We are presently investigating a fault affecting WWW/SQL/Mail services on this server.

Start Time

6th January 2011, at 11:23PM

Resolution Time

6th January 2011, at 11:25PM

Server1 Apache Down (server1.xenserve.com)

resolved

Description

Update at 18:49:45(GMT): We are now confidant that this issue is resolved.



Update at 17:41:18(GMT): Reboot done, problem resolved. We will be contacting the user responsible.


Update at 17:28:32(GMT): We are enacting an emergency reboot of this machine. This will take between 10 to 15 minutes.

We appreciate your patience in this matter.


We currently have an issue with the Apache web service on server1.

We are working to resolve this as soon as possible. Other services should be unaffected.

Start Time

29th December 2010, at 5:06PM

Resolution Time

29th December 2010, at 6:49PM

Rosie Domains Hacked (rosie.34sp.com)

resolved

Description

Update at 19:38:15(GMT): Update at 16:48:20(GMT): We have now restored what files we can. Those customers without paid-for backup services may find that the files restored are older than expected and should restore the current version from their own local copy as soon as they possible.

If you appear to still be affected (i.e. no index files at all) then please contact support by e-mail to support@34sp.com to arrange for a manual restoration (where possible) of your index files.

All customers should be advised that we are doing all that we can to avoid this happening again in the future.



Update at 15:23:34(GMT): We have removed the malicious files and are in the process of restoring what we can from our backups. Customers with their own local backups are advised not to upload these at this time, as me we may inadvertently over-write these files.

Please wait for further notice via this page.


Customers with Personal hosting type accounts on the server Rosie, must be advised that we have had a breach of security that has resorted in the index pages of all domains to be replaced.

So far this appears to be the only damage done. We're working to restore as many of the defaced index files as possible.

This will not be an instant fix, therefore please refrain from contacting support directly at this time. We are aware of the problem and are working as fast as possible to restore your websites.

Updates will be posted to this status page as we work upon the issue.

Start Time

28th December 2010, at 2:56PM

Resolution Time

7th January 2011, at 7:38PM

SMTP4 issues (smtp4.34sp.com)

resolved

Description

Update at 15:25:53(GMT): The issue has now been resolved with this server.



Update at 13:28:12(GMT): We have isolated the cause of the problem and mail is now flowing again from SMTP4.

Please note that there is a backlog of queued e-mail to process, which will take several hours.


There is a delay on one of our mail servers and the engineers are working on fixing this at the moment. Mail sent may get queued until this issue is fixed.
We apologise for the inconvenience caused.

Start Time

27th December 2010, at 11:49AM

Resolution Time

27th December 2010, at 3:25PM

Business5 Down (business5.34sp.com)

resolved

Description

Update at 11:09:35(GMT): We're confident that the issue is resolved, however are unable to determine the exact cause of the issue - the system appears to be running without issue.



Update at 09:18:40(GMT): The machine is now back up, we're investigating into the cause. We will continue to monitor this machine for any lingering issues for a short while.


Business5 is not responding, we're looking into the cause and hope to have it resolved as soon as possible.

Start Time

23rd December 2010, at 9:04AM

Resolution Time

23rd December 2010, at 11:09AM

server3.xenserve.com unavailable (server3.xenserve.com)

resolved

Description

Update at 14:03:33(GMT): The issue with this server has been resolved.

The server3.xenserve.com reseller server is currently unavailable. We are investigating this at the moment and will post updates as soon as we have them.

Start Time

21st December 2010, at 1:40PM

Resolution Time

21st December 2010, at 2:03PM

Network Issues (N/A)

resolved

Description

Update at 14:33:32(GMT): We have taken a few extra steps to alleviate the strain placed on our edge network devices during burst periods. Much, much more planned for the new year, too.



Update at 15:54:24(GMT): We experienced a large chunk of traffic into our network (likely DDoS traffic) at a very high packet rate.

We're currently working on identifying the target/culprit.


Our engineers are working on the current network issues. Apologies for any inconvenience caused.

Start Time

20th December 2010, at 3:21PM

Resolution Time

21st December 2010, at 2:33PM

Xenserve6 (xenserve6)

resolved

Description

Update at 09:18:29(GMT): The issue has now been resolved with this server.Server is now back online.




This server is currently offline, we are currently looking into this issue.

Start Time

18th December 2010, at 7:16AM

Resolution Time

18th December 2010, at 9:18AM

Server1 (server1.xenserve.com)

resolved

Description

Update at 23:35:58(GMT): The issue has now been resolved with this server.Update at 22:00:38(GMT): The server failed to recover after a power cycle. An engineer has been alerted and will be on site at the data centre within an hour or so to investigate manually.

Update at 21:33:25(GMT): The server has been power cycled as of 21.33.

We are presently investigating a fault with this system.

Start Time

14th December 2010, at 9:19PM

Resolution Time

14th December 2010, at 11:35PM