34SP.com System Status History

Description

Update at 21:35:39(BST): Update at 21:16:53(BST): All servers are now back online on VPS6.


Update at 19:59:01(BST): VPS6 was back up as of around 19.44. We are now restarting the VEs on the server.

We are presently rebooting this server and its services.

Start Time

29th June 2011, at 7:43PM

Description

Update at 20:51:04(BST): Xenserve4 has been performing a lot better recently since our recent changes, therefore we are resolving this status update.

Anyone still experiencing issues is encouraged to contact our support team.

---

Please accept our apologies for recent issues with service stability on server4. Our engineers are currently working to improve the stability and we hope to see notable changes by the end of today. We will update this status once we are satisfied this has stabilised. Should you have any concerns please login to https://www.34sp.com/login and click on 'Create Support Ticket' and let us know.

Start Time

29th June 2011, at 12:15PM

Description

Update at 21:40:52(BST): After 24hrs there have been no serious reported issues, migration complete!

---

Update at 12:00:17(BST): The migration has now completed, we are currently checking things over.

If anyone has any issues with sites please do let us know as soon as possible.

---

Update at 10:56:26(BST): Incoming email and website access is now being removed for syncing of databases to the new harware.

We expect to see 1-2hrs of downtime from this point.

---

Update at 10:30:40(BST): Incoming email services have now been disabled, all email will be queued at the sending end.

---

Update at 10:05:14(BST): The FTP service has now been disabled to make a resync of files.

---

The server3.xenserve.com is undergoing migration to new hardware today as per the email sent to all clients.

We will update this post with progress throughout the day.

Start Time

28th June 2011, at 7:42AM

Description

Update at 12:12:17(BST): The issue has now been resolved with this server.Update at 09:26:39(BST): Unfortunately we're having to put the site into a proper 'maintenance' mode whilst we work to resolve this.

---

We are currently having to perform emergency maintenance on our customer portal. This will cause a slow down in performance for customer logins and password resets.

Apologies for any inconvenience caused. We hope this maintenance will be complete in an hours time.
Hosting services and email are not affected.

Start Time

27th June 2011, at 9:23AM

Description

Update at 00:04:13(BST): The issue has now been resolved with this server.We are presently looking into a fault affecting VPS6.

Start Time

24th June 2011, at 11:13PM

Description

Update at 19:42:52(BST): Update at 19:17:40(BST): After a small discussion with the Engineer, we have ascertained that the machine was inappropriately left to prioritise booting from the network; preventing it from booting properly.

This is of course human error and of course has now been corrected for any such future occurrence.

Regarding the affecting issue of power fluctuations within this rack, we are still discussing this with our providers and hope to have a plan of action shortly. At this time the power is stable, but we shall of course continue to keep a close eye on this portion of our facility.

If you have any lingering issues with regards to today's outage, please do not hesitate to contact support@34sp.com, raising a ticket or in response to an existing ticket.

It goes without saying that 34SP.com apologises for the obvious inconvenience caused by today's outage and we will be doing all that we can to safeguard against such outages in the future again.

---

Update at 18:51:09(BST): Our apologies for the delay; apparently our provider's ETA wasn't particularly accurate.

We'll continue to chase for faster resolution.

---

Update at 18:01:01(BST): The Engineer is en-route as we speak and will hopefully have his hands on the machine in question within the next 30 minutes.

Update at 17:43:25(BST): So far, all attempts to rescue the machine remotely have not succeeded. We will be calling an Engineer to attend on-site as soon as possible.

We apologise for this outage and for the obvious convenience that this will be causing.

---

Unfortunately the host VPS 15 is down, we're working to resolve this as quickly as possible.

It appears that we have had power troubles within a rack in London earlier today which be the cause of this issue.

However at this time, VPS 15 is the only host currently affected.

We will be querying our suppliers as to whether the issue with the power was theirs or ours.

Start Time

19th June 2011, at 5:11PM

Description

Update at 16:57:12(BST): Closed.

Telephone support will only be available until 5.30pm today. Apologies for any inconvenience caused. Any issues should be emailed to support@34sp.com during this time.

Start Time

15th June 2011, at 3:48PM

Description

Update at 16:56:52(BST): The issue has now been resolved with this server.

Update at 14:47:51(BST): The IPs have all been switched over now, if anyone is experiencing any issues with the migrated sites then please do let us know as soon as possible.

---

Update at 13:44:37(BST): The switch of IPs to the newserver is now in progress

---

Update at 13:03:23(BST): All services are now offline for a final sync of files/databases/emails before the services are moved to a new server.

---

Update at 12:14:30(BST): incoming email has now been disabled on this server, all email should be queued at the sending server - no email should be lost, just delayed.

---

This server is currently being migrated to new hardware as per the email sent to all users.


At present the FTP service is offline while a sync of files is in place.

Start Time

15th June 2011, at 11:08AM

Description

Update at 18:16:12(BST): There has been no re-occurrence of this issue, therefore we are making this outage as resolved.

---

Update at 16:06:16(BST): This actually has turned-out to be abuse from an internal source. We have discovered that the traffic was originating from a hacked VPS.

We have now killed any offending processes and will be contacting the owner in due course.

---

We currently have quite a large amount of packets being targeted towards a machine within our network. We're working to resolve this as soon as possible.

Thankfully at present this is only from one source and as a result is not affecting all customers.

Start Time

13th June 2011, at 3:48PM

Description

Update at 08:34:29(BST): The works on the payment system have been completed successfully.

We are currently performing an upgrade on our payment systems so payments may be unavailable for the next 30 minutes.

Start Time

13th June 2011, at 8:01AM