34SP.com System Status History

Description

Update at 19:13:47(GMT): We are comfortable that this server is now running smoothly again.

---

Update at 15:57:24(GMT): Server3 is now back up and running once again. We will keep an eye on the machine for a short while.

The current understanding is that there was a massive surge in memory/swap usage that caused the system to lock-up.

---

Currently, server3/xenserve3 is down unexpectedly.

At present we are waiting for it to perform file system sanity checks and hope to see all services restored soon.

We thank you for your patience in this matter.

Start Time

10th January 2011, at 3:44PM

Description

Update at 01:51:26(GMT): The issues with LINX appear to have stabilised.

---

At present the LINX peering backbone are having 'issues'.

Whilst 34SP.com do not peer with LINX directly, almost all of our transit providers do.

If you believe you are having issues accessing 34SP.com hosted services, please ensure that other services are not also affected before contacting 34SP.com Technical Support, as this may well be out of our hands.

If you are indeed experiencing issues as a result of the on-going troubles at LINX, please contact your Internet Service Provider (BT, Virgin Media, etc.)

We will post updates as soon as they are available.

Start Time

8th January 2011, at 9:18PM

Description

Update at 21:14:12(GMT): This period has now lapsed.

---

Phone support is unavailable today, January 8th, due to staff illness. Live Chat and email support remain unaffected.

Start Time

8th January 2011, at 10:03AM

Description

Update at 19:54:06(GMT): The issue has now been resolved with this server.

Update at 19:46:42(GMT): The machine has now been powercycled.

This server has become unreachable and we are presently investigating this fault.

Start Time

7th January 2011, at 7:28PM

Description

Update at 23:25:43(GMT): The issue has now been resolved with this server.We are presently investigating a fault affecting WWW/SQL/Mail services on this server.

Start Time

6th January 2011, at 11:23PM

Description

Update at 18:49:45(GMT): We are now confidant that this issue is resolved.

---

Update at 17:41:18(GMT): Reboot done, problem resolved. We will be contacting the user responsible.

---

Update at 17:28:32(GMT): We are enacting an emergency reboot of this machine. This will take between 10 to 15 minutes.

We appreciate your patience in this matter.

---

We currently have an issue with the Apache web service on server1.

We are working to resolve this as soon as possible. Other services should be unaffected.

Start Time

29th December 2010, at 5:06PM

Description

Update at 19:38:15(GMT): Update at 16:48:20(GMT): We have now restored what files we can. Those customers without paid-for backup services may find that the files restored are older than expected and should restore the current version from their own local copy as soon as they possible.

If you appear to still be affected (i.e. no index files at all) then please contact support by e-mail to support@34sp.com to arrange for a manual restoration (where possible) of your index files.

All customers should be advised that we are doing all that we can to avoid this happening again in the future.

---

Update at 15:23:34(GMT): We have removed the malicious files and are in the process of restoring what we can from our backups. Customers with their own local backups are advised not to upload these at this time, as me we may inadvertently over-write these files.

Please wait for further notice via this page.

---

Customers with Personal hosting type accounts on the server Rosie, must be advised that we have had a breach of security that has resorted in the index pages of all domains to be replaced.

So far this appears to be the only damage done. We're working to restore as many of the defaced index files as possible.

This will not be an instant fix, therefore please refrain from contacting support directly at this time. We are aware of the problem and are working as fast as possible to restore your websites.

Updates will be posted to this status page as we work upon the issue.

Start Time

28th December 2010, at 2:56PM

Description

Update at 15:25:53(GMT): The issue has now been resolved with this server.

---

Update at 13:28:12(GMT): We have isolated the cause of the problem and mail is now flowing again from SMTP4.

Please note that there is a backlog of queued e-mail to process, which will take several hours.

---

There is a delay on one of our mail servers and the engineers are working on fixing this at the moment. Mail sent may get queued until this issue is fixed.
We apologise for the inconvenience caused.

Start Time

27th December 2010, at 11:49AM

Description

Update at 11:09:35(GMT): We're confident that the issue is resolved, however are unable to determine the exact cause of the issue - the system appears to be running without issue.

---

Update at 09:18:40(GMT): The machine is now back up, we're investigating into the cause. We will continue to monitor this machine for any lingering issues for a short while.

---

Business5 is not responding, we're looking into the cause and hope to have it resolved as soon as possible.

Start Time

23rd December 2010, at 9:04AM

Description

Update at 14:03:33(GMT): The issue with this server has been resolved.

The server3.xenserve.com reseller server is currently unavailable. We are investigating this at the moment and will post updates as soon as we have them.

Start Time

21st December 2010, at 1:40PM