29 jun

[RESOLVED] [NL, AMS-01] Potential impact on connectivity

Time: June 28, 2021 18:57 UTC

[UPDATE, June 28, 2021 22:49 CEST (UTC+02:00)
The connectivity issue has been resolved and you should no longer face any packet loss. We thank you for your patience and understanding.
[ORIGINAL MESSAGE, June 28, 2021 20:57 CEST (UTC+02:00)] 
We are currently facing connectivity issue in parts of our network. Therefore, you may experience some temporary packet loss between the following data centers:
AMS-01- FRA-10, AMS-01 – FRA-12, AMS-01 – FRA-13, AMS-01 – LON-10
Our engineers are already re-routing the affected traffic to other links to ensure continued connectivity. We will keep you updated. 
28 jun

[NL, AMS-01] Potential impact on connectivity

Time: June 28, 2021 18:57 UTC

Dear customers,

We are facing with a connectivity issue in our backbone.

You may experience short-time packet loss between:
AMS-01- FRA-10, AMS-01 – FRA-12, AMS-01 – FRA-13, AMS-01 – LON-10 locations.

Our engineers are re-routing the possible affected traffic to other links.

We will keep you updated.

29 mrt

[NL, AMS-01] High latency and packet loss

Time: March 27, 2021 03:55 UTC

We have experienced connectivity issues on one of our border routers in the AMS-01 data center due to a partial failure on one of it’s line cards. The failure occurred today, the 27th of March at 02:57 UTC time, the router platform automatically shutdown the affected ports around a minute later.

You might have experienced temporary packet loss to some destinations during that time till traffic converged to alternate ports. No impact should be experienced at this current moment. We will continue to investigate and take the necessary corrective actions, without further impact on your services.

We sincerely apologize for the inconvenience.

27 mrt

Brief connectivity issues in AMS-01

Time: March 27, 2021 03:55 UTC

Dear Customer,
We have experienced connectivity issues on one of our border routers in the AMS-01 data center due to a partial failure on one of it’s line cards. The failure occurred today, the 27th of March at 02:57 UTC time, the router platform automatically shutdown the affected ports around a minute later.
You might have experienced temporary packet loss to some destinations during that time till traffic converged to alternate ports. No impact should be experienced at this current moment. We will continue to investigate and take the necessary corrective actions, without further impact on your services.
We sincerely apologize for the inconvenience.
15 mrt

[RESOLVED] [DE,FRA-10] High latency and packet loss

Time: March 14, 2021 13:00 UTC

UPDATE, March 15, 2021, 02:01 CET (UTC+01:00):

The faulty line card has been replaced at 00:52 CET (UTC+01:00) and the services were restored at 02:00 CET (UTC+01:00). You might experienced high latency and packet loss during this time. One of the ISP Xtra Telecom is still facing issues and the team is working to restore service. Leaseweb should not be effected any further.

If you experienced any issues beyond this point please let us know and we will have our team investigate it.

——————————————————————————————————————–

We are experiencing high latency and packet loss due to operations issue with a node for DE-CIX FRA. The issue started on Sunday, March 14, 2021 at 15:00 CET ( UTC+01:00).
The team is still investigating the root cause for the control plane issues and if they are related to the hardware.

Affected entities : Germany

Devices: edge02.dx12.fra.de-cix.net

14 mrt

[DE,FRA-10] High latency and packet loss

Time: March 14, 2021 13:00 UTC

We are experiencing high latency and packet loss due to operations issue with a node for DE-CIX FRA. The issue started at 15:00 CET ( UTC+01:00).The team is still  investigating the root cause for the control plane issues and if they are related to the hardware.

We will update you again once we have more information.
Affected entities : Germany
Devices: edge02.dx12.fra.de-cix.net

Latest update
The effected  ISP include Vodafone, EUnetworks , GTT to name a few.

Currently the DECIX team is replacing a faulty line card. We will update the once the issue is resolved and the services are back.

14 mrt

NOSD High latency and packet loss

Time: March 14, 2021 13:00 UTC

Dear Customers

We are experiencing high latency and packet loss due to operations issue with a node for DE-CIX FRA. The issue started at 1500hrs CET.

DECIX is currently investigating the cause of this issue. We will update you again once we have more information.

NEED HELP?
You can track the updates from the Customer Portal. You can visit our Knowledge Base or contact us directly at [email protected]. We are always happy to help.

 
07 mrt

[NL, AMS-01] Connectivity issues in part of our network

Time: March 7, 2021 16:50 UTC

We are currently experiencing connectivity issues in part of our network in our AMS-01 data center.

We are currently investigating the cause of this issue. Please be assured that we will do our best to keep the impact as minimal as possible.

We will update you again once we have more information.

NEED HELP?

You can visit our Knowledge Base or contact us directly. We are always happy to help.
01 mrt

[Resolved] [DE, FRA-10] Connectivity issues in part of our network

Time: February 26, 2021 20:10 UTC

We experienced an incident affecting one of our dark fibers connecting FRA-10 to a backbone site. The failure occurred today, Friday the 26th of February at 19:21 UTC after which traffic was re-routed around the failure.  You could have experienced brief packet loss to/from some destinations during that time until reconvergence was completed.

26 feb

[DE, FRA-10] Connectivity issues in part of our network

Time: February 26, 2021 20:10 UTC

We experienced an incident affecting one of our dark fibers connecting FRA-10 to a backbone site. The failure occurred today, Friday the 26th of February at 19:21 UTC after which traffic was re-routed around the failure.

You could have experienced brief packet loss to/from some destinations during that time until reconvergence was completed.