16 nov

[20111116] EvoSwitch hall 2 router outage [Update]

Time: November 16th 2011 10:15:00(CEST)
Dear Customer,



At the moment we experience some troubles in (part of) our network.



We are doing our utmost to solve this issue a.s.a.p.

As soon as we have more information available, we will publish it here.



Please be patient while we are working on this problem.



Regards,

LeaseWeb BV



Affected IP ranges are:



95.211.40.0/21

95.211.58.0/23

95.211.62.0/23

95.211.64.0/21

62.212.67.0/24

62.212.74.0/24

62.212.91.0/24

82.192.86.0/24

82.192.71.0/24

85.17.134.0/24

85.17.151.0/24

85.17.199.0/24

85.17.202.0/23

85.17.204.0/23

85.17.206.0/24

85.17.219.0/24

85.17.226.0/24

85.17.229.0/24

85.17.231.0/24

85.17.232.0/24

85.17.235.0/24

85.17.236.0/23

85.17.238.0/24

85.17.242.0/23



[UPDATE 10:25] The issue was caused by a faulty linecard, we have replaced the linecard and all connectivity has been restored. During the outage the standby router was handling traffic, however during switchover there was some packet loss envolved.

15 nov

EVOswitch High Volume Network issue

Time: November 7th 2011 15:37:00(CEST)
Expected Downtime: Unknown

Location: Evoswitch

Affected IP ranges:

network 62.212.84.0 mask 255.255.255.0

network 85.17.84.0 mask 255.255.255.0

network 94.75.216.0 mask 255.255.254.0

network 94.75.220.0 mask 255.255.252.0

network 94.75.229.0 mask 255.255.255.0

network 94.75.234.0 mask 255.255.255.0

network 94.75.240.0 mask 255.255.255.0

network 94.75.253.0 mask 255.255.255.0

network 95.211.92.0 mask 255.255.254.0

network 212.7.192.0 mask 255.255.252.0



Reason: Under investigation

*******************************



Dear Customer,



At the moment we experience some troubles on our High Volume router 3 at Evoswitch data-centre.



The router is back up again, as soon as we have more information available, we will publish it here.



Please be patient while we are working on this problem.



Regards,

LeaseWeb BV

15 nov

[20111110] Frankfurt network issues [Update]

Time: November 10th 2011 13:18:00(CEST)
Expected Downtime: 5 minutes

Location: Frankfurt, Germany

Reason: Hardware failure

*******************************



Dear Customer,



We just experienced some troubles in the German part of our network, datacenter Frankfurt. The cause of this is that a linecard of a XMR have failed.



At the moment everything is recovered and back up. A new linecard will be inserted soon. a maintenance will be scheduled for this.



Regards,

LeaseWeb Germany GmbH



[Update 16:15] The hardware Replacement has arrived. We will re-route the traffic away from the Linecard for replacing



[Update 17:50] Replacement and re-routing was successfull





Erwartete Ausfallzeit: 5min

Ort: Frankfurt, Deutschland

Grund: Hardware Fehler

*******************************



Sehr verehrte Kunden,



soeben kam es zu einem kurzen Ausfall von teilen unseres Netzwerk.

Der Grund war der Ausfall einer Linecard eines Routers.



Zur Zeit ist alles wieder im normalen Betrieb, die defekte Linecard wird ausgetauscht sobald der Ersatz des Herstellers eingetroffen.



Mit freundlichen Gruessen



LeaseWeb Germany GmbH



[Update 16:15] Die Ersatzlinecard ist angekommen. Wir routen nun den Datenverkehr um und tauschen die Hardware



[Update 17:50] Austusch und umrouten wwurde erfolgreich abgeschlossen

15 nov

[20111107] Global routing issues [Update]

Time: November 7th 2011 15:33:00(CEST)
Dear Customer,

At the moment we are experiencing connectivity degradation around the globe.

Probably these issues are caused by router software crashes with several carriers. Our own network equipment is not affected.

As soon as we have an update about this situation, we will update the NOC posting.

Regards,

LeaseWeb BV

[UPDATE 16:30] All connectivity has been restored, the issue was caused by a software bug in Juniper router software.

15 nov

Ddos Attack onShared Firewall Evoswitch [Update]

Time: November 7th 2011 09:27:00(CEST)
Update 3. 07/114/2011 11:02

Dear Customers,

We have resolved the issue and traffic is back to normal on the shared-firewall.

Again we are sorry for the inconvenience caused.

Regards,

LeaseWeb BV

Update 2. 07-11-2011 10:50

Dear Customers,

We are still having problems resolving the issue and we are trouble shooting the issue and will send update a.s.a.p.

We are sorry for any inconvenience caused.

Regards,

LeaseWeb BV

Update 1. 07-11-2011 10:10:

Firewall is back on-line, we have reduced the attack down to 1 vlan, which we have took off-line and are working to fix the issue

Expected Downtime: / Unknown

Location: Evoswitch

Affected IP ranges:

ip address 85.17.142.252 255.255.255.0

ip address 85.17.163.188 255.255.255.192

ip address 85.17.215.60 255.255.255.192

ip address 85.17.227.252 255.255.255.0

ip address 85.17.250.172 255.255.255.240

ip address 85.17.185.252 255.255.255.192

ip address 62.212.70.252 255.255.255.0

ip address 62.212.64.252 255.255.255.0

ip address 85.17.129.4 255.255.255.248

Reason: dDOS

*******************************

Dear Customer,

At the moment we experience some troubles in our Evoswitch network.

We are doing our utmost to solve this issue a.s.a.p.

As soon as we have more information available, we will publish it here.

Please be patient while we are working on this problem.

Regards,

LeaseWeb BV

11 nov

[20111118] Powerloft fiber maintenance

Startdate: November 18th 2011 03:00:00(CEST)
Enddate: November 18th 2011 08:00:00(CEST)

Dear customer,



One of our dark fiber suppliers at location Powerloft in Manassas, VA. has announced a maintenance on several dark fiber paths. During this maintenance we will reroute traffic to different links.



No customer impact is expected, however you may see short latency increase or small packet loss.



The timezone for given timeframe is CET.



LeaseWeb – NOC

10 nov

[20111110] Frankfurt network issues [Update]

Time: November 10th 2011 13:18:00(CEST)
Expected Downtime: 5 minutes

Location: Frankfurt, Germany

Reason: Hardware failure

*******************************



Dear Customer,



We just experienced some troubles in the German part of our network, datacenter Frankfurt. The cause of this is that a linecard of a XMR have failed.



At the moment everything is recovered and back up. A new linecard will be inserted soon. a maintenance will be scheduled for this.



Regards,

LeaseWeb Germany GmbH



[Update 16:15] The hardware Replacement has arrived. We will re-route the traffic away from the Linecard for replacing



Erwartete Ausfallzeit: 5min

Ort: Frankfurt, Deutschland

Grund: Hardware Fehler

*******************************



Sehr verehrte Kunden,



soeben kam es zu einem kurzen Ausfall von teilen unseres Netzwerk.

Der Grund war der Ausfall einer Linecard eines Routers.



Zur Zeit ist alles wieder im normalen Betrieb, die defekte Linecard wird ausgetauscht sobald der Ersatz des Herstellers eingetroffen.



Mit freundlichen Gruessen



LeaseWeb Germany GmbH



[Update 16:15] Die Ersatzlinecard ist angekommen. Wir routen nun den Datenverkehr um und tauschen die Hardware

10 nov

[20111110] Frankfurt network issues

Time: November 10th 2011 13:18:00(CEST)
Expected Downtime: 5 minutes

Location: Frankfurt, Germany

Reason: Hardware failure

*******************************



Dear Customer,



We just experienced some troubles in the German part of our network, datacenter Frankfurt. The cause of this is that a linecard of a XMR have failed.



At the moment everything is recovered and back up. A new linecard will be inserted soon. a maintenance will be scheduled for this.



Regards,

LeaseWeb Germany GmbH





Erwartete Ausfallzeit: 5min

Ort: Frankfurt, Deutschland

Grund: Hardware Fehler

*******************************



Sehr verehrte Kunden,



soeben kam es zu einem kurzen Ausfall von teilen unseres Netzwerk.

Der Grund war der Ausfall einer Linecard eines Routers.



Zur Zeit ist alles wieder im normalen Betrieb, die defekte Linecard wird ausgetauscht sobald der Ersatz des Herstellers eingetroffen.



Mit freundlichen Gruessen



LeaseWeb Germany GmbH



10 nov

[20111117] Peering and high volume routers upgrade

Startdate: November 17th 2011 06:00:00(CEST)
Enddate: November 17th 2011 07:00:00(CEST)

Dear customer,



During this maintenance window we will upgrade the software on our high volume routers at Evoswitch in Haarlem. The maintenance will take place between 6:00 and 7:00 CET (UTC+1) on the 17th of November 2011. You may see up to 15-20 minutes downtime.



Within the same maintenance window we will also upgrade the software of our peering router in Frankfurt, Germany. There should be no serious impact, however it is possible you may notice temporarily higher latency or small packet loss when traffic is shifted towards alternate paths.



Affected IP ranges for high volume routers upgrade:

46.243.0.0/22

62.212.82.0/24

62.212.85.0/24

62.212.88.0/23

82.192.84.0/24

82.192.94.0/23

83.149.70.0/23

83.149.124.0/22

85.17.24.0/21

88.208.52.0/24

88.208.57.0/24

88.208.58.0/23

95.211.136.0/21

95.211.144.0/20

212.7.212.0/23

2001:1AF8:4000::/40





Kind regards,



Leaseweb NOC

10 nov

[20111115] EvoSwitch Router component replacement [Update]

Startdate: November 15th 2011 06:00:00(CEST)
Enddate: November 15th 2011 07:00:00(CEST)

Dear customer,



We will replace a hardware component of the high volume router that had issues on the 7th (http://leasewebnoc.com/status.php?i=698) of november. We will perform this replacement to maintain overall connectivity performance. With this maintenance the router will be reloaded and customers will notice downtime.



The following ranges are impacted:

– 94.75.220.0/22

– 94.75.216.0/23

– 94.75.229.0/24

– 94.75.240.0/24

– 94.75.253.0/24

– 94.75.234.0/24

– 62.212.84.0/24

– 95.211.92.0/23

– 85.17.84.0/24

– 212.7.192.0/22

– 2001:1AF8:4030::/44

– 2A01:9400:3::/48



The maintenance will take place on 15th of november between 06:00 CET and 07:00 CET (UTC +1)



Kind regards,



LeaseWeb NOC