10 apr

[NL, AMS-01] Connectivity issues in part of our High Volume Network

Time: March 21, 2015 17:30:00 (CET)
Dear Leaseweb Customer,

Today between 17:15 and 17:30 CET you might have experienced interruptions or/and traffic drops due to interface flapping on a router in our High Volume Network in AMS-01. The traffic is back to normal and connectivity is stable the last 50 minutes. The reason is under investigation and an update will be posted once more information is available.

The following network prefixes might have been affected:

5.79.80.0/21
46.243.0.0/22
46.243.4.0/23
62.212.72.0/23
62.212.82.0/23
62.212.85.0/24
62.212.88.0/23
82.192.78.0/24
82.192.80.0/23
82.192.84.0/23
82.192.90.0/23
82.192.94.0/23
83.149.70.0/23
83.149.124.0/22
85.17.24.0/21
85.17.72.0/23
85.17.90.0/24
85.17.132.0/24
85.17.136.0/24
85.17.147.0/24
85.17.172.0/24
85.17.190.0/23
95.211.88.0/22
95.211.128.0/22
95.211.132.0/23
95.211.136.0/21
95.211.144.0/20
95.211.200.0/21
146.185.0.0/23
179.43.173.128/25
190.105.0.0/24
212.7.204.192/26
212.7.206.128/27
212.7.212.0/23
216.59.55.0/24
216.59.59.0/24
216.59.60.0/24

2001:1af8:4010::/44
2001:1AF8:4600::/40

If you are still having issues, please open a ticket with [email protected]

10 apr

[Global, NL] Connectivity issues in part of our network [Update]

Time: March 25, 2015 19:00:00 (CET)
Dear Leaseweb Customer,

[UPDATE 21:15]

Currently we are removing traffic from our Level 3 links and we re-routing it via other upstream providers. Connectivity should be fully restored within the next few minutes. We will keep monitoring the situation to ensure network reachability .

====================================

One of our main upstream providers (Level 3) is experiencing a major network issue. This is causing connectivity problems for our customers. Services may be unreachable from specific locations. We are currently working on finding a possible workaround to minimize the impact for our customers.

Updates will be provided through this NOC posting.

10 apr

[NL, AMS-01, AMS-11, AMS-12] Power disturbance datacenter facilities [Update]

Time: March 27, 2015 09:20:00 (CET)
Dear LeaseWeb customer,

[FINAL UPDATE 15h45 CET] In close collaboration with the utility power provider, we successfully switched back from our diesel back-up to the power grid. All our datacenter facilities, AMS-01, AMS-11 and AMS-12, are now restored to normal operations.

We will closely monitor our systems to ensure the availability of your service. If you need further information, please open a ticket via the LeaseWeb Self Service Center, or contact us at [email protected].

[UPDATE 15h15 CET] The earlier announced switch at 15h00 CET is slightly delayed to ~15h15 CET. A new update will be posted before 15h45 CET.

[UPDATE 14h10 CET] In close collaboration with the power grid operator, mains power is considered stable again. While we don't expect any noticeable impact, please be informed that at 15h00 CET we will switch back from diesel back up to the regular power grid. A new update will be posted before 15h15 CET.

[UPDATE 12h30 CET] LeaseWeb’s datacenter facilities are all running stable on diesel back up. This alternative energy source is largely sufficient. Next update will be when a significant change to the situation occurs.
LeaseWeb engineers are available to your service in the affected datacenter. You might experience longer response times on your request.

[UPDATE 11h10 CET] External utility power provider report that it is expected to resolve the situation before 16h00 CET. Unless the situation clears, aforementioned datacenters will remain running on diesel back up. LeaseWeb engineers are available to your service in the affected datacenter. You might experience longer response times on your request.

Today, 9h20 CET an external utility power disturbance initiated backup power start up in our AMS-01, AMS-11, AMS-12 datacenter facility. Customer loads have been transferred from utility power to diesel back up.

LeaseWeb engineers are proactively scanning any exceptional situation in our services. Due to this event you might experience longer response times from our Support desk.

Due to this power outage, we are also experiencing issues with our external phone system. As a result of that, the connection to LeaseWeb's phone numbers might not be correctly established.

Next update will be when a significant change to the situation occurs.

LeaseWeb Operations

27 mrt

[NL, AMS-01, AMS-11, AMS-12] Power disturbance datacenter facilities

Time: March 27, 2015 09:20:00 (CET)
Dear LeaseWeb customer,

Today, 9:20 CET an external utility power disturbance initiated backup power start up in our AMS-01, AMS-11, AMS-12 datacenter facility. Customer loads have been transferred from utility power to diesel back up.

LeaseWeb engineers are proactively scanning any exceptional situation in our services. Due to this event you might experience longer response times from our Support desk.

Due to this power outage, we are also experiencing issues with our external phone system. As a result of that, the connection to LeaseWeb's phone numbers might not be correctly established.

Next update will be when a significant change to the situation occurs.

LeaseWeb Operations

25 mrt

[Global, NL] Connectivity issues in part of our network [Update]

Time: March 25, 2015 19:00:00 (CET)
Dear Leaseweb Customer,

[UPDATE 21:15]

Currently we are removing traffic from our Level 3 links and we re-routing it via other upstream providers. Connectivity should be fully restored within the next few minutes. We will keep monitoring the situation to ensure network reachability .

====================================

One of our main upstream providers (Level 3) is experiencing a major network issue. This is causing connectivity problems for our customers. Services may be unreachable from specific locations. We are currently working on finding a possible workaround to minimize the impact for our customers.

Updates will be provided through this NOC posting.

21 mrt

[NL, AMS-01] Connectivity issues in part of our High Volume Network

Time: March 21, 2015 17:30:00 (CET)
Dear Leaseweb Customer,

Today between 17:15 and 17:30 CET you might have experienced interruptions or/and traffic drops due to interface flapping on a router in our High Volume Network in AMS-01. The traffic is back to normal and connectivity is stable the last 50 minutes. The reason is under investigation and an update will be posted once more information is available.

The following network prefixes might have been affected:

5.79.80.0/21
46.243.0.0/22
46.243.4.0/23
62.212.72.0/23
62.212.82.0/23
62.212.85.0/24
62.212.88.0/23
82.192.78.0/24
82.192.80.0/23
82.192.84.0/23
82.192.90.0/23
82.192.94.0/23
83.149.70.0/23
83.149.124.0/22
85.17.24.0/21
85.17.72.0/23
85.17.90.0/24
85.17.132.0/24
85.17.136.0/24
85.17.147.0/24
85.17.172.0/24
85.17.190.0/23
95.211.88.0/22
95.211.128.0/22
95.211.132.0/23
95.211.136.0/21
95.211.144.0/20
95.211.200.0/21
146.185.0.0/23
179.43.173.128/25
190.105.0.0/24
212.7.204.192/26
212.7.206.128/27
212.7.212.0/23
216.59.55.0/24
216.59.59.0/24
216.59.60.0/24

2001:1af8:4010::/44
2001:1AF8:4600::/40

If you are still having issues, please open a ticket with [email protected]

20 mrt

[NL, AMS-01] Connectivity issues in part of our High Volume Network

Time: March 20, 2015 11:30:00 (CET)
Dear Leaseweb Customer,

Between 11:20 and 11:40 you might have experienced high latency and/or packet loss due to a DDoS attack on part of our network in AMS-01. The attack has now been filtered and connectivity has been restored. The following prefixes might have been affected:

85.17.4.0/24
85.17.76.0/22
85.17.80.0/22
95.211.102.0/23
95.211.162.0/23
80.253.248.0/22
213.142.132.0/22
213.142.136.0/21
213.142.144.0/22

2001:1AF8:4040::/44
2A04:1880:1111::/48

If you are still having issues, please open a ticket with [email protected]

10 mrt

[NL] Connectivity issues to specific destinations

Time: March 10, 2015 13:30:00 (CET)
Dear Leaseweb Customer,

Between 12:20 and 13:25 your services might have been unreachable from specific destinations.
Due to multiple waves being impacted by a major fiber cut, a routing loop occurred within our network and traffic was blackholed.
Issue has identified and permanently fixed.
Part of the connections outgoing via DE-CIX have been affected.
All services in Netherlands might have been affected for traffic to specific destinations.

08 mrt

[Global] Leaseweb Self Service Center is not available [Update]

Time: February 26, 2015 09:00:00 (CET)
Dear LeaseWeb customer,

[UPDATE 10:15 CET] The issue is resolved at 10:00 CET and the LeaseWeb Self Service Center is available again. Although the service is back online, we started an internal investigation to get to the root cause of this incident in order to prevent it from happening again.

[UPDATE 9:45 CET] We identified the root cause of this issue and our engineers are working hard to implement a solution as soon as possible. This NOC message will be updated again, as soon we know more.

Due to an unexpected event, the LeaseWeb Self Service Center is not available at the moment. We are currently investigating the cause of this issue and will update you once we have more information.

Please be assured that we will do our utmost to keep the downtime as short as possible.

We apologize for any inconvenience this may cause.

08 mrt

[NL, DE] LeaseWeb Webmail service not available [Update]

Time: February 27, 2015 09:15:00 (CET)
Dear LeaseWeb customer,

[UPDATE 10:45 CET] The issue has been resolved at 10:00 CET and the LeaseWeb Webmail service is available again.

Due to an unexpected event, the LeaseWeb Webmail service (https://webmail.leaseweb.com) of our shared email platform is not available at the moment. We are currently investigating the cause of this issue and will update you once we have more information.

Please be assured that we will do our utmost to keep the downtime as short as possible.

We apologize for any inconvenience this may cause.