08 mrt

[US] Cloud issues [Update]

Time: March 8, 2014 09:00:00 (CET)
Dear LeaseWeb customer,

[UPDATE 08/03/2014 22:00 CET]
Dear LeaseWeb customer,

The platform is back online, and most of the Cloud Server instances are now running as well. We are working with a very small amount of customers on a few instances that are having issues resulting from the outage.
If you are one of these customers, you will receive an update via email. During the coming days we will be monitoring the platform closely, along with our storage vendor.
In case of any issues, if you have any questions, or have an instance that is not starting correctly, please open a ticket with our support department.

We apologise for any inconvenience caused by this incident.

Sincerely,

LeaseWeb
[END UPDATE]

[UPDATE 09.45 CET]

We have continued to work on the Cloud Server instances, and are now in the process of restarting them.
After this has been completed, we will re-enable control of your Cloud Server via the Self Service Center.

We apologise for any inconvenience caused by this incident.

Sincerely,

LeaseWeb

Dear LeaseWeb customer,

[UPDATE 06:45 CET]
We have continued to work on the Cloud Server instances and the storage validation has completed, When more info is available about the restart of your Cloud Server instances, we will update you with the latest info.
We apologise for any inconvenience caused by this incident.

Sincerely,

LeaseWeb

Dear LeaseWeb customer,

[UPDATE 20:55 CET]
All Virtual Server instances are now running, and controlling your instance via the Self Service Center is possible again. The LeaseWeb Cloud servers are not yet functioning correctly. We are now working along with our storage vendor to fix this, but expect this to take a number of hours. During this time our engineers are continuing to work on your instances to get them back online.

We apologize for any inconvenience caused by this incident.

Sincerely,

LeaseWeb

[UPDATE 18:22 CET]

We have restored all of the Virtual Server instances back to working order. We are still working on fixing the issues on the Cloud Server platform.
Due to these issues your Cloud Server might be unavailable. We are working on restoring these to working order as soon as possible.

Note that controlling your instance via the Self Service Center is not possible yet, while we are working on the platform.

We apologize for any inconvenience caused by this incident.

[UPDATE 16:45 CET]

Dear customer,

Dear LeaseWeb Customer,

The storage platform is back online. We are continuing our check on individual virtual server instances to ensure that they are all running properly. On the cloud server platform, we are still experiencing issues. We will continue to update you on the status until all instances are online.

We apologize for any inconvenience caused by this incident.

Sincerely,

LeaseWeb

[UPDATE]
The issues are storage related. You may not be able to view the status in the Self Service Center or restart your VPS.
Engineers are investigating the issue at this moment. We are doing our utmost to solve this issue as soon as possible. No estimate time given.

We are now experiencing issues with our Cloud platform in the US.
We are sorry for the inconvenience caused. Once we have more information we will update you.

06 mrt

[NL, AMS-01] Emergency network maintenance [Update]

Time: March 6, 2014 01:00:00 (CET)
Dear LeaseWeb Customer,

We are experiencing instability issues and will perform an emergency maintenance on a router servicing one the the network segments in Netherlands AMS-01 datacenter. As linecards will be rebooted, IP connectivity will be unavailable until the task is completed.

We will monitor our platform to ensure that everything is running properly after the maintenance.

@Update 02:15
Maintenance completed successfully. Platform is now stable.

Below you can find a detailed breakdown of the IP ranges impacted by this maintenance:
82.150.152.0/24
94.75.218.0/23
94.75.232.0/24
94.75.250.0/24
95.211.60.0/23
95.211.104.0/23
95.211.208.0/21
188.0.224.0/24
194.0.5.0/24
194.0.28.0/22
212.7.205.0/24
212.7.206.0/23
212.7.210.0/24
2001:1af8:4050::/44
2001:1af8:4070::/44
2001:678:2c::/48

For further information, please contact: [email protected].

05 mrt

[NL, AMS-01] Connectivity issues in part of our network [Update]

Time: March 4, 2014 14:53:00 (CET)
Dear Leaseweb Customer,

We experienced high latency and packet loss due to DDoS in part of our network in AMS-01.

The following network prefixes might have been affected:

94.75.192.0/18
95.211.0.0/19
62.212.75.0/24
82.192.87.0/24
2001:1AF8:4400::/40
5.61.248.0/24
37.1.144.0/24
46.182.176.0/22
77.81.240.0/21
87.236.96.0/21
90.156.224.0/20
94.124.56.0/21
145.255.128.0/21
193.107.18.0/24
212.7.193.128/25
212.7.192.128/25
2A01:9400:2::/48
2A02:CC8::/32
2A03:E280:0:1::/64

The incoming DDoS is now being filtered and traffic level/connectivity is back to normal.

If you notice any issues, please open a ticket via the LeaseWeb Self Service Center, or contact us directly at [email protected].

05 mrt

[NL, AMS-12] Connectivity issues in part of our network [Update]

Time: March 5, 2014 12:48:00 (CET)
Dear Leaseweb Customer,

We are experiencing connectivity issues in part of our network in AMS-12. The cause is currently being investigated.

The following network prefixes might have been affected:

85.17.32.0/19
85.17.96.0/20
2001:1AF8:2100::/40
46.17.0.0/21
46.102.240.0/21
62.84.240.0/22
77.235.32.0/19
83.223.32.0/20
91.195.118.0/23
93.188.64.0/21
109.70.0.0/21
128.140.216.0/22
193.43.92.0/24
193.242.108.0/24
195.200.82.0/23
195.242.98.0/23
2A02:2968:20::/48

[Update 17:20] The issue has now been resolved. The unavailability was caused by a network loop causing the router cpu to spike. The loop was found and subsequently closed.

If you notice any issues, please open a ticket via the LeaseWeb Self Service Center, or contact us directly at [email protected].

03 mrt

[NL, AMS-12] Connectivity issues in part of our network

Time: March 3, 2014 14:52:00 (CET)
Dear LeaseWeb Customer,

You might have experienced high latency and packet loss due to a DDoS attack in our network at AMS-012. We managed to filter the attack and currently connectivity has been restored.

The following network prefixes might have been affected:
46.17.0.0/21
46.102.240.0/21
62.84.240.0/22
77.235.32.0/19
83.223.32.0/20
85.17.32.0/19
85.17.96.0/20
91.195.118.0/23
93.188.64.0/21
109.70.0.0/21
128.140.216.0/22
193.43.92.0/24
193.242.108.0/24
195.200.82.0/23
195.242.98.0/23

2001:1AF8:2100::/40
2A02:2968:20::/48

If you still notice any issues, please open a ticket via the LeaseWeb Self Service Center, or contact us directly at [email protected].

27 feb

[NL, AMS-01] Connectivity issues in part of our network [Update]

Time: February 24, 2014 23:30:00 (CET)
Dear Leaseweb Customer,

We experienced high latency and packet loss due to DDoS in part of our network in AMS-01.

The following network prefixes might have been affected:

5.79.64.0/20
37.48.64.0/20
2001:1AF8:4700::/40

The incoming DDoS is now being filtered and traffic level/connectivity is back to normal.

If you notice any issues, please open a ticket via the LeaseWeb Self Service Center, or contact us directly at [email protected].

27 feb

[NL, AMS-01] Connectivity issues in part of our network [Update]

Time: February 25, 2014 01:26:00 (CET)
Dear Leaseweb Customer,

We experienced high latency and packet loss due to DDoS in part of our network in AMS-01.

The following network prefixes might have been affected:

85.17.76.0/22
85.17.80.0/22
85.17.4.0/24
95.211.162.0/23
95.211.102.0/23
2001:1AF8:4040::/44
80.253.248.0/22
91.220.176.192/27
178.22.122.0/24
213.142.136.0/21
213.142.144.0/22
217.19.1.0/24

The incoming DDoS is now being filtered and traffic level/connectivity is back to normal.

If you notice any issues, please open a ticket via the LeaseWeb Self Service Center, or contact us directly at [email protected].

27 feb

[NL, AMS-01] Connectivity issues in part of our network [Update]

Time: February 24, 2014 23:30:00 (CET)
Dear Leaseweb Customer,

We experienced high latency and packet loss due to DDoS in part of our network in AMS-01.

The following network prefixes might have been affected:

5.79.64.0/20
37.48.64.0/20
2001:1AF8:4700::/40

The incoming DDoS is now being filtered and traffic level/connectivity is back to normal.

If you notice any issues, please open a ticket via the LeaseWeb Self Service Center, or contact us directly at [email protected].

27 feb

[US, WDC-01] Connectivity issues

Time: February 27, 2014 09:50:00 (EDT)
Dear Sir,

For 10 minutes we experienced black holing of traffic on sessions with one of our service providers.
Your services were impacted for this duration for requests transiting this links. Issue has been solved.

Affected ip ranges

91.242.214.0/23
108.59.0.0/20
162.210.192.0/21
162.219.212.0/22
185.28.70.0/24
192.96.200.0/21
198.7.56.0/21
199.115.112.0/21
199.58.84.0/22
207.244.64.0/18
208.64.45.0/24
209.58.128.0/18
209.192.128.0/17
212.7.200.0/24
2604:9A00:2100::/40

26 feb

[NL, AMS-01] Connectivity issues in part of our network

Time: February 26, 2014 16:22:00 (CET)
Dear LeaseWeb Customer,

You might have experienced high latency and packet loss due to a DDoS attack in our Premium Network at AMS-01. One of our routers lost routing protocol sessions. As this is a redundant setup, the other router took over the traffic.

The following network prefixes might have been affected:
5.61.248.0/24
37.1.144.0/24
46.182.176.0/22
62.212.75.0/24
77.81.240.0/21
87.236.96.0/21
82.192.87.0/24
90.156.224.0/20
94.75.192.0/18
94.124.56.0/21
95.211.0.0/19
145.255.128.0/21
193.107.18.0/24
212.7.193.128/25
212.7.192.128/25

2001:1AF8:4400::/40
2A01:9400:2::/48
2A02:CC8::/32
2A03:E280:0:1::/64

If you still notice any issues, please open a ticket via the LeaseWeb Self Service Center, or contact us directly at [email protected].