34SP.com System Status History

Prohost1 (prohost1.34sp.com)

resolved

Description

Update at 19:43:47(GMT): The issue has now been resolved with this server.
This was a fault alert, services are, and have been running fine on this server

We are presently investigating the unavailability of this server.

Start Time

7th December 2010, at 7:22PM

Resolution Time

7th December 2010, at 7:43PM

Router Outage (N/A)

resolved

Description

Update at 00:45:20(GMT): The downed router has now been returned to service and all traffic routes should be returning to normal.



Update at 23:59:29(GMT): We have an Engineer en-route to our data centre to deal with the issue directly.

We hope to restore full service within the next hour or so.


Update at 22:56:41(GMT): We are currently dealing with a downed edge router in our London data centre.

As we have redundant routers in each data centre (as well as redundant, geographically-diverse links to the Internet) there is no sustained outage associated with this status post, given that all fail-over mechanisms have worked as designed.

However, some customers may find that websites and services could respond a little slower than usual due to sub-optimal routing paths that add some latency to their connections.

We're working to restore service to this router as soon as possible.

Start Time

6th December 2010, at 10:55PM

Resolution Time

7th December 2010, at 12:45AM

Xenserve4 Down (server4.xenserve.com)

resolved

Description

Update at 11:47:44(GMT): There's been a few service outages since the reboot, but this is related more to restarts due to high load (common after a complete outage - lots of page refreshes, etc.) and we're happy to now resolve this status message.

Any customers with any lingering issues are encouraged to contact our support team via e-mailing support@34sp.com.



Update at 10:21:48(GMT): The server is back up, we're investigating into what happened and will be running a check across all databases as a precautionary measure.


At present xenserve4 is down, we're looking into the matter and are hoping to resolve this as soon as possible.

We apologise for the obvious inconvenience that this may cause.

Start Time

6th December 2010, at 10:09AM

Resolution Time

6th December 2010, at 11:47AM

Emergency Network Maintenance (N/A)

resolved

Description

Update at 01:38:49(GMT): The issue has now been resolved with this server.



The service-interrupting work was completed around an hour ago, but we've been running as many tests and checks across the new configuration to ensure all is sane. At present the network seems to be running well again.

Looking forward, this maintenance will provide future-proofing to the network performance in Manchester, as it grows.

If anyone is experiencing any lingering issues, please contact support@34sp.com as soon as is possible.


Update at 00:10:55(GMT): This work will be beginning now.


Customers residing on servers in our Manchester data centre are to be advised that we are going to have to perform some maintenance on our network switches, owing to a heavy increase in traffic that has recently brought to light several short-comings of this network.

We need to make some changes to the cabling topology and switch configurations to correct this. It will unfortunately mean that we will have some intermittent service outages as network paths are re-calculated, to account for the changes.

The work will be commencing in approximately 45-60 minutes, with patches of disruption during a window of around 30 minutes.

We will update this page as and when new information becomes available - thank you for your patience.

Start Time

2nd December 2010, at 11:15PM

Resolution Time

3rd December 2010, at 1:38AM

server10.xenserve.com (server10.xenserve.com)

resolved

Description

Update at 22:49:35(GMT): The issue has now been resolved with this server.This should now all be completed and all services back online. Please do let us know if you have any issues with anything




The services are currently offline on the server10.xenserve.com server, this is to do some emergency modifications to the database system on this server.

The expected downtime of all services should be less than 30minutes.

Start Time

2nd December 2010, at 10:24PM

Resolution Time

2nd December 2010, at 10:49PM

VPS16 (vps16.34sp.com)

resolved

Description

Update at 01:08:16(GMT): The issue has now been resolved with this server.We are presently looking into a fault affecting this VPS server.

If you have an affected VPS please do not restart your VPS through our control panel at this time.

Start Time

1st December 2010, at 12:19AM

Resolution Time

1st December 2010, at 1:08AM

Prohost6 Failure (prohost6.34sp.com)

resolved

Description

Update at 23:08:25(GMT): This outage is now marked as resolved.


Update at 17:05:05(GMT): Prohost6 is now back up (again) and we will continue to monitor this machine closely.


Update at 16:24:44(GMT): The machine has gone down again, we're currently performing kernel & environment updates in an attempt to improve stability.


Update at 15:30:44(GMT): The machine is back up and running now. We're investigating into the cause of the outage.


We're investigating a total outage of Prohost6, this does not affect e-mail services (these are kept separately) but all websites and databases hosted upon Prohost6 are currently offline whilst we try to rectify the situation.

Start Time

26th November 2010, at 3:12PM

Resolution Time

2nd December 2010, at 11:08PM

prohost7.34sp.com Reboot (prohost7.34sp.com)

resolved

Description

Update at 20:22:01(GMT): The issue has now been resolved with this server.This work has now been carried out.




Prohost7 is having some security updates applied to it, it will be being rebooted very shortly.

The downtime should only be a few minutes.

Start Time

25th November 2010, at 7:51PM

Resolution Time

25th November 2010, at 8:22PM

Mail Delays (SMTP Service) (smtp.34sp.com/smtp.xenserve.com)

resolved

Description

Update at 15:01:12(GMT): For all e-mail that would be deliverable if not for the issues described below, this problem should now be resolved.

If your e-mail wasn't deliverable for some other reason, you should receive a bounce message as normal in due course, if not already.

Any customers that switched to a use a specific SMTP server to manually mitigate the issues are advised to ensure that they switch back to using smtp.34sp.com.



One of the many SMTP servers we operate had a large mail queue that was causing quite long delays in its outgoing mail queue.

This has now been resolved, it will take a short while for the queue to be processed, but all mail will eventually be delivered.

We apologise for the obvious inconvenience caused. Any customers sending large mailshots are asked to please wait a few hours before doing so, to avoid adding to the issue.

Start Time

23rd November 2010, at 2:05PM

Resolution Time

23rd November 2010, at 3:01PM

Server3 down (server3.xenserve.com)

resolved

Description

Update at 23:41:18(GMT): The issue has now been resolved with this server.Update at 23:09:50(GMT): Issues with the disks on server3 have surfaced. We are presently running a full disk/scan repair at this time.

We are presently looking into an issue affecting this server. All services are affected.

Start Time

18th November 2010, at 9:50PM

Resolution Time

18th November 2010, at 11:41PM