Category Archives: Leaseweb

Leaseweb storing? Actuele Leaseweb storingen en onderhoud

29 sep

[Global] Problems with our LeaseWeb Customer Portal & external phone system

Time: September 29, 2015 16:00:00 (CEST)
Dear LeaseWeb customer,

We are currently experiencing problems with our LeaseWeb Customer Portal and external phone system. As a result of that, the LeaseWeb Customer Portal is temporary unavailable and connection to LeaseWeb's phone numbers might not be correctly established.

This issue should not affect the availability of your services. The cause is currently under investigation, as soon as we have more information we will update you again.

18 sep

[NL] Unexpected event on one of our Public Cloud platforms

Time: September 18, 2015 09:35:00 (CEST)
Dear LeaseWeb customer,

Today at 09:35 CEST, we encountered an unexpected event on one of our Public Cloud platforms in Netherlands, which unintentionally stopped a part of the active instances. Public Cloud Servers in following network prefixes might have been affected:

62.212.93.0/24
82.192.68.0/24
85.17.113.0/24

LeaseWeb engineers found the apparent cause of this issue and already provided a solution for the major part of the affected instances. If your instance is still not available , please be advised to restart it through the LeaseWeb Customer Portal (https://secure.leaseweb.com).

If you need further assistance, please contact [email protected] and we will give you the help you need.

16 sep

[DE] Unexpected event on our Cloud platform in Germany [Update]

Time: September 16, 2015 10:30:00 (CEST)
Dear LeaseWeb customer,

[FINAL UPDATE SEPT 16th, 12:55 CEST]
LeaseWeb engineers and our storage supplier have performed additional checks and, although all services are back online, redundancy is not fully restored. Please be assured that we are focusing all our resources on this issue and we are determined to fully restore redundancy as soon as possible.

The current situation and the general stability of this platform do not meet our company standards and the reliability that you may expect from LeaseWeb. We had already planned to move to a new full SSD storage platform and the recent incidents have accelerated this process. Detailed plans for this migration are now being prepared and all customers on this platform will be emailed personally about its progress. Therefore this is the final update about this incident that we will post in the NOC.

[UPDATE SEPT 16th, 11:35 CEST] LeaseWeb engineers are continuously monitoring the platform and found that the load on the platform has normalized. If you still encounter issues with your instance at this moment, please contact [email protected] and we will give you the help you need. A final update can be expected within the next hour.

[UPDATE SEPT 16th, 11:05 CEST] Shortly after the unexpected event occurred, the Cloud platform established a fail-over to the standby system of the clustered environment. The platform is now recovering, but this process is causing high load on the nodes. Rest assured that LeaseWeb engineers are closely monitoring the availability of the platform. As soon as we have more information this NOC post will be updated.

[ORIGINAL MESSAGE]
Today at 10:30 CEST, we encountered an unexpected event on our Cloud platform in Germany, resulting in a disruption of your Virtual Server and/or Cloud Server instance(s) (both public and private).

LeaseWeb engineers found the apparent cause of this issue and are working on recovering the platform with the highest priority. As soon as we have more information, or an estimation when we expect the issues to be solved, we will update you again.

11 sep

[DE] Unexpected event on our Cloud platform in Germany

Time: September 11, 2015 11:40:00 (CEST)
Dear LeaseWeb customer,

Today at 11:40 CEST, we encountered an unexpected event on our Cloud platform in Germany, resulting in a disruption of your Public Virtual Server and Cloud Server instance(s). LeaseWeb engineers found the cause of this issue and are working on recovering the platform with the highest priority.

As soon as we have more information, or an estimation when we expect the issues to be solved, we will update you again.

10 sep

[NL, AMS-01] Connectivity issues in part of our Network

Time: September 10, 2015 22:05:00 (CEST)
Dear Leaseweb Customer,

Today, between approximately 22:05 and 22:20 you might have experienced interruptions or/and traffic drops due to a BGP session flap in our High Volume Network in AMS-01. We are currently working to ensure that connectivity is stable and all traffic is back to normal. The reason is under investigation and an update will be posted once more information is available.

The following network prefixes might have been affected:

37.48.98.0/23
37.48.100.0/23
89.144.18.0/24
95.211.94.0/23
95.211.168.0/21
95.211.184.0/21
95.211.192.0/21
95.211.224.0/21
95.211.240.0/22
103.41.176.0/23
104.200.78.0/24
179.43.174.128/26
185.17.184.0/23
185.17.186.0/23
191.101.16.0/24
193.151.91.0/24
212.7.198.0/24
212.114.56.0/23

2001:1af8:4020::/44

If you are still having issues, please open a ticket with [email protected]

10 sep

[DE, FRA-10] Connectivity issues in part of our Network

Time: September 10, 2015 16:00:00 (CEST)
Dear Leaseweb Customer,

Today, between approximately 15:55 and 16:05 CEST, you might have experienced connectivity issues or/and increased latency in part of our network due to a large DDoS attack in our FRA-10 datacenter. The attack has now been mitigated and traffic levels/connectivity is back to normal.

The following network prefixes might have been affected:

37.58.56.0/22
37.58.60.0/24
46.165.220.0/22
46.165.228.0/22
46.165.240.0/21
46.165.254.0/24
185.17.120.0/22
185.49.68.0/23

2A01:9260:100::/40
2A00:C98:2030::/44

If you are still experiencing issues with specific services, please create a ticket via [email protected].

01 sep

[NL] Unexpected event on our storage platform in the Netherlands [UPDATE]

Time: September 1, 2015 01:45:00 (CEST)
[UPDATE 01:45 CEST] The investigation is still ongoing and has pointed out the location of the issue. We have however not been able to locate the root cause of the issue yet. We continue to work with our supplier to solve this issue.

We encountered an unexpected event on our storage platform, resulting in a performance degradation of your Virtual Server. Together with the supplier, our engineers are investigating the cause of this issue.

Please be assured that we will do our utmost to keep the impact as low as possible, but despite our efforts you might experience performance issues, or your virtual machine might end up in read-only state. In the case that your virtual machine is in read only state you can restart your virtual machine and if needed run a fsck on the file system.

We will update you once we have more information.

Visit http://leasewebnoc.com/en/networkstatus/performance-degradation-virtual-server-in-the-netherlands to track updates and progress.

19 aug

[NL, AMS-01] DDoS connectivity issues in part of our premium network [Update]

Time: August 19, 2015 21:23:00 (CEST)
Dear LeaseWeb Customer,

Between 20:40 and 21:15 you might have experienced higher latency or packet loss to your services. This was caused by link congestion due to a large DDOS on a section of our network. Mitigation actions have been taken accordingly.
Affected ranges :

31.186.168.0/23
37.75.152.0/21
41.191.215.0/24
62.212.64.0/22
62.212.67.0/24
62.212.68.0/23
62.212.70.0/23
62.212.74.0/24
62.212.91.0/24
62.212.92.0/24
80.65.32.0/20
82.192.67.0/24
82.192.69.0/24
82.192.79.0/24
82.192.76.0/23
82.192.86.0/24
82.192.92.0/23
85.17.68.0/22
85.17.87.0/24
85.17.92.0/22
85.17.112.0/23
85.17.128.0/17
85.234.224.0/19
91.224.38.0/23
93.190.220.0/22
94.75.226.0/26
95.211.32.0/20
95.211.48.0/21
95.211.56.0/22
95.211.62.0/23
95.211.64.0/21
95.211.164.0/22
109.120.175.0/24
159.255.192.0/22
167.88.48.0/20
178.18.20.0/23
178.18.22.0/24
178.250.16.0/24
178.250.18.0/24
185.16.84.0/24
185.24.240.0/24
185.38.185.0/24
185.46.232.0/24
185.51.192.0/22
185.63.152.0/22
191.101.48.0/22
191.96.72.0/21
193.27.72.0/23
194.0.197.0/24
195.14.21.0/24
195.140.240.0/22
212.7.204.0/23
2001:1AF8:4100::/40
2a01:b2e0::/32
2001:1AF8:4200::/40
2A02:BC0::/32
2A03:7480::/44
2001:1AF8:4300::/40
2A02:40C0:1::/48

17 aug

[NL] Unexpected event our storage platform in the Netherlands

Time: August 17, 2015 05:00:00 (CEST)
Dear LeaseWeb customer,

We encountered an unexpected event on our storage platform, resulting in a performance degradation of your .Virtual server. Together with the supplier, our engineers are investigating the cause of this issue.

Please be assured that we will do our utmost to keep the impact as low as possible, but despite our efforts you might experience performance issues, or your virtual machine might end up in read-only state.

In the case that your virtual machine is in read only state you can restart your virtual machine and if needed run a fsck on the file system.

We will update you once we have more information.

16 aug

[DE] Connectivity issues in part of our network [Update]

Time: August 16, 2015 09:00:00 (CEST)
Dear LeaseWeb customer,

We encountered a network issue in part of our network in FRA-10 due to a problem in the network of one of our carriers. You might have experienced connectivity issues from 07:15 to 09:00 CEST. We have taken countermeasures and connectivity should be restored.

Please contact us at [email protected] if you still encounter issues.
We apologize for any inconvenience.