16 sep

[DE] Unexpected event on our Cloud platform in Germany [Update]

Time: September 16, 2015 10:30:00 (CEST)
Dear LeaseWeb customer,

[FINAL UPDATE SEPT 16th, 12:55 CEST]
LeaseWeb engineers and our storage supplier have performed additional checks and, although all services are back online, redundancy is not fully restored. Please be assured that we are focusing all our resources on this issue and we are determined to fully restore redundancy as soon as possible.

The current situation and the general stability of this platform do not meet our company standards and the reliability that you may expect from LeaseWeb. We had already planned to move to a new full SSD storage platform and the recent incidents have accelerated this process. Detailed plans for this migration are now being prepared and all customers on this platform will be emailed personally about its progress. Therefore this is the final update about this incident that we will post in the NOC.

[UPDATE SEPT 16th, 11:35 CEST] LeaseWeb engineers are continuously monitoring the platform and found that the load on the platform has normalized. If you still encounter issues with your instance at this moment, please contact [email protected] and we will give you the help you need. A final update can be expected within the next hour.

[UPDATE SEPT 16th, 11:05 CEST] Shortly after the unexpected event occurred, the Cloud platform established a fail-over to the standby system of the clustered environment. The platform is now recovering, but this process is causing high load on the nodes. Rest assured that LeaseWeb engineers are closely monitoring the availability of the platform. As soon as we have more information this NOC post will be updated.

[ORIGINAL MESSAGE]
Today at 10:30 CEST, we encountered an unexpected event on our Cloud platform in Germany, resulting in a disruption of your Virtual Server and/or Cloud Server instance(s) (both public and private).

LeaseWeb engineers found the apparent cause of this issue and are working on recovering the platform with the highest priority. As soon as we have more information, or an estimation when we expect the issues to be solved, we will update you again.