34SP.com System Status History

Description

Update at 16:33:11(BST): This migration is now being marked as finished, if however anyone is having any issues since the migration please do contact us and we will aid in looking into the problems for you.

---

Update at 16:22:18(BST): This migration has now been completed, we are doing some small amount of maintenance work, but do let us know if there are any issues on any sites.

---

Update at 15:16:28(BST): The main webservices will now be going offline for the final stage of this migration, we expect the downtime to be around 1-2hrs

---

Update at 14:43:38(BST): FTP services are now stopped for a initial sync of files.

---

Update at 14:19:14(BST): Mail services have been stopped on this server for the syncing of the mail

---

The deepthought.34sp.com domains are undergoing migration to a different server as per the email sent to all clients.

Try to avoid making any changes on any websites now to minimize loss of data when transferred to the new server.

We will update this post with progress throughout the day.

Start Time

2nd August 2011, at 8:07AM

Description

Update at 14:21:50(BST): We haven't seen a resurgence of this issue lately and no specific issue was identified since the last episode.

---

Update at 12:31:55(BST): Mostly back under control now. We're working on identifying the cause of the outage.

---

We're investigating the cause of the outage affecting xenserve16 at this point in time.

Start Time

30th July 2011, at 12:16PM

Description

Update at 19:16:42(BST): The issue has now been resolved with this server.Update at 19:11:13(BST): We identified an exploited user account that allowed a rogue process to cause excessive load. This has been eliminated and the server has been rebooted (19.07).

Update at 18:42:11(BST): We are presently investigating an issue of severe load on the bill.34sp.com server. Services are offline at this time.

Start Time

20th July 2011, at 6:39PM

Description

Update at 21:43:02(BST): The UPS backup for the primary core switch is preventing a remote reboot this evening. We'll leave the secondary switch running things (it's doing a fine job, being identical in configuration) and we should hopefully be able to resolve this completely at another point in the near future.

---

Update at 21:28:22(BST): Switchover OK. We'll monitor this for a short while before rebooting the primary switch.

---

Due to a bug in the firmware, we have unfortunately lost the management interface of our primary core switch in Manchester.

Whilst we've left it a few days without making any changes (everything else is working fine) we do need to reboot the switch to regain control of it.

The vendor has qualified the bug as credible and will be releasing a fix in a later update.

However, until then we must force fail-over to the secondary switch. This should not incur any loss of service, given that the configuration is naturally redundant in the case of a sudden failure.

Any customers that do experience significant trouble are encouraged to contact support@34sp.com at once.

Start Time

19th July 2011, at 9:01PM

Description

Update at 12:00:20(BST): No major problems reported after this migration from users so this status is closed - do however let us know if you do notice any issues.

---

Update at 12:31:17(BST): All sites should now be active again on the new hardware - let us know if there are any issues.

---

Update at 11:00:40(BST): Access to email and websites have now been disabled for the final sync operations, we expect the downtime from this point to be around 1-2hrs

---

Update at 10:27:10(BST): Incoming email services are now disabled.

---

Update at 10:13:10(BST): FTP service has now been disabled on this server for an resync of files.

---

The server5.xenserve.com is undergoing migration to new hardware today as per the email sent to all clients.

Try to avoid making any changes on any websites now to minimize loss of data when transferred to the new server.

We will update this post with progress throughout the day.

Start Time

19th July 2011, at 7:41AM

Description

Update at 22:36:19(BST): The issue has now been resolved with this server. This work has now been carried out.

---

Prohost12 is having some security updates applied to it, it will be rebooted very shortly.

The downtime should only be a few minutes.

Start Time

12th July 2011, at 10:29PM

Description

Update at 12:40:53(BST): The issue has now been resolved with this server.Our engineers are currently working to resolve the loss of all web services on prohost 12. This will mainly affect new professional account sign-ups. Please accept our apologies for any inconvenience caused.

We hope to have this back on -line as soon as possible.

Email is not affected by this issue.

Start Time

8th July 2011, at 11:28AM

Description

Update at 08:07:01(BST): The issue has now been resolved with this server.Engineers are currently investigating an issue with Atmail that is cuasing failed IMAP/POP3 logins for customers using our Spam Filtering service.

We are working to resolve this issue as quickly as possible.

Start Time

7th July 2011, at 7:56AM

Description

Update at 13:19:18(BST): The issue has now been resolved with this server.No major reported issues from migration - do let us know if you however do find any with any of your sites.

---

Update at 15:06:17(BST): Sites are now live on the new hardware, please let us know if you see any issues from this.

---

Update at 12:57:11(BST): Access to email and websites have now been disabled for the final sync operations, we expect the downtime from this point to be 1-2hrs.

---

Update at 12:07:26(BST): Incoming email has now been stopped and will be queued by the sender.

---

Update at 10:33:19(BST): The FTP service has now been disabled on the server to minimize any file changes being made while they are resynced to the new server.

---

The server9.xenserve.com is undergoing migration to new hardware today as per the email sent to all clients, please try to avoid making changes as they may be lost.

We will update this post with progress throughout the day.

Start Time

5th July 2011, at 8:05AM

Description

Update at 22:07:11(BST): Update at 21:39:39(BST): All servers should now be back online, let us know if there are any issues outstanding.

---

Update at 21:20:12(BST): VPS accounts on VPS8 are starting to come back online now.

---

We are presently rebooting this server and its services.

Start Time

29th June 2011, at 9:12PM