16 jul

High Volume Router Issues [Update]

Time: July 16th 2012 14:31:00
Dear Customers,

We are having some high volume router issues in our Haarlem Data Center on the following ranges:

62.212.72.0/23
62.212.82.0/24
62.212.85.0/24
62.212.88.0/23
82.192.94.0/23
82.192.84.0/23
83.149.70.0/23
85.17.24.0/21
83.149.124.0/22
95.211.136.0/21
95.211.144.0/20

We will update this page when more information is available.

[Update 14:41]
The initial cause of the problem was the routing process on the active routing engine.
The process became unresponsive and got killed by the Juniper operating system.
A newly spawned routing process also encountered issues.
We then decided to do a routing engine switchover.
This initially seemed to resolve the issue, but we are finding there are still routing issues.
An update will follow soon.

[Update 14:49]
We are unable to fix the routing process issues on the second routing engine.
The primary routing engine will now be rebooted, once that is back online we will issue another switchover of active routing engine.

[Update 15:04]
We were unable to restore operations on either of the routing engine.
We have decided to initiate a hard reboot of all hardware in the chassis.

16 jul

High Volume Router Issues [Update]

Time: July 16th 2012 14:31:00
Dear Customers,

We are having some high volume router issues in our Haarlem Data Center on the following ranges:

62.212.72.0/23
62.212.82.0/24
62.212.85.0/24
62.212.88.0/23
82.192.94.0/23
82.192.84.0/23
83.149.70.0/23
85.17.24.0/21
83.149.124.0/22
95.211.136.0/21
95.211.144.0/20

We will update this page when more information is available.

[Update 14:41]
The initial cause of the problem was the routing process on the active routing engine.
The process became unresponsive and got killed by the Juniper operating system.
A newly spawned routing process also encountered issues.
We then decided to do a routing engine switchover.
This initially seemed to resolve the issue, but we are finding there are still routing issues.
An update will follow soon.

[Update 14:49]
We are unable to fix the routing process issues on the second routing engine.
The primary routing engine will now be rebooted, once that is back online we will issue another switchover of active routing engine.

12 jul

Issues with part of Express Cloud [Update]

Time: July 11th 2012 22:22:00
Dear Customer,
We are currently experiencing issues with small part of our Express Cloud storage platform.
If your server became unreachable within last 5 minutes, it means that probably you are affected by this.
We are now working on solving this issue.
You will be notified shortly about status of this issue.

Kind regards,
LeaseWeb – NOC

[UPDATE 22:46]
Affected storage server is back online, however there is still problem with increased disk latency, and this issues is now under investigation, so your VPS (if it is affected by this problem) may experience slow performance right now.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-11 22:57]

We are now replacing network cable and switchport in affected storage system.
We will update you shortly if problem is solved by this change.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-11 23:27]

Unfortunately replacing network cable and switchport didn't solve this problem.
We are going to replace network card now to allow further investigation.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-12 0:09]

Replacing network card didn't solve this problem, so now we are performing detailed system diagnosis to verify if this is hardware related problem.
All affected VPS'es are unreachable right now.
Please be patient while we are working on this issue.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-12 0:47]

Hardware components will be relpaced very soon. Right now part of affected VPS'es is online, but with very low performance. After hardware is replaced, we expect performance to be back to normal level.
Thank you for your patience while we work on this issue.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-12 0:58]

Performance of this storage server is better now and affected VPS'es should be back online. It's not yet optimal, but allows to keep customer VPS'es online and reachable.
At this moment we are still fixing some VPS'es that require manual intervention, so if you experience any issues with your server, please contact [email protected]

Thank you for your patience.

Kind regards,
LeaseWeb – NOC

12 jul

Issues with part of Express Cloud [Update]

Time: July 11th 2012 22:22:00
Dear Customer,
We are currently experiencing issues with small part of our Express Cloud storage platform.
If your server became unreachable within last 5 minutes, it means that probably you are affected by this.
We are now working on solving this issue.
You will be notified shortly about status of this issue.

Kind regards,
LeaseWeb – NOC

[UPDATE 22:46]
Affected storage server is back online, however there is still problem with increased disk latency, and this issues is now under investigation, so your VPS (if it is affected by this problem) may experience slow performance right now.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-11 22:57]

We are now replacing network cable and switchport in affected storage system.
We will update you shortly if problem is solved by this change.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-11 23:27]

Unfortunately replacing network cable and switchport didn't solve this problem.
We are going to replace network card now to allow further investigation.

Kind regards,
LeaseWeb – NOC

11 jul

Issues with part of Express Cloud [Update]

Time: July 11th 2012 22:22:00
Dear Customer,
We are currently experiencing issues with small part of our Express Cloud storage platform.
If your server became unreachable within last 5 minutes, it means that probably you are affected by this.
We are now working on solving this issue.
You will be notified shortly about status of this issue.

Kind regards,
LeaseWeb – NOC

[UPDATE 22:46]
Affected storage server is back online, however there is still problem with increased disk latency, and this issues is now under investigation, so your VPS (if it is affected by this problem) may experience slow performance right now.

Kind regards,
LeaseWeb – NOC

[UPDATE 2012-07-11 22:57]

We are now replacing network cable and switchport in affected storage system.
We will update you shortly if problem is solved by this change.

Kind regards,
LeaseWeb – NOC

09 jul

High Volume Network issues in part of our Data centre in Haarlem [Update]

Time: July 9th 2012 14:43:00
Dear Sir/Madam,

We are experiencing issues on part of our high volume network in the Netherlands.
We are doing our best to remedy the problem asap.

Affected IPv4 ranges:
95.211.168.0/21
95.211.94.0/23
95.211.184.0/21
95.211.192.0/21

Updates will follow.

Kind regards,

Leaseweb NOC

Update: 09-07-2012 14:45 – Engineer is replacing a broken line-card

Update: 09-07-2012 14:52 – Line-card has been replaced and all uplinks are working again.

Sorry for any inconvenience caused.

Kind regards,

Leaseweb NOC

09 jul

High Volum Network issues in part of our Data center in Haarlem [Update]

Time: July 9th 2012 14:43:00
Dear Sir/Madam,

We are experiencing issues on part of our high volume network in the Netherlands.
We are doing our best to remedy the problem asap.

Affected IP ranges:
95.211.168.0/21
95.211.94.0/23
95.211.184.0/21
95.211.192.0/21

Updates will follow.

Kind regards,

Leaseweb NOC

Update: 09-07-2012 14:45 – Engineer is replacing a broken line-card

Update: 09-07-2012 14:52 – Line-card has been replaced and all uplinks are working again.

Sorry for any inconvenience caused.

Kind regards,

Leaseweb NOC

08 jul

Issues with part of Premium Cloud [Update]

Time: July 8th 2012 10:07:00
Dear customer,

Currently LeaseWeb is working on fixing issues on the Premium Cloud platform, related to storage network. The impact of the issue is limited to part of the Premium Cloud instances

Kind Regards,

LeaseWeb – NOC

[UPDATE 8-07-2012 10:32]

Problems have been solved. Customers who had problems rebooting their VPS should be able to reboot their VPS again. If you still encounter problems please send an email to [email protected] so we can help you solve them.

Kind Regards,

LeaseWeb – NOC

05 jul

[Leaseweb – Germany] | Databurg distribtion router issue

Time: July 5th 2012 13:29:00
Please be informed that one of our distribution router in Databurg is currently having issues, that results in high latency, or loss of connection.

We are doing our utmost to bring back the service as soon as possible.

Affected IP subnets:
– 37.1.216.0/21
– 37.58.48.0/20
– 46.166.151.0/24
– 46.166.152.0/21
– 217.20.126.0/23
– 217.20.120.0/22
– 217.20.112.0/21
– 176.65.160.0/21
– 178.162.128.0/17
– 188.72.192.0/18
– 91.191.160.0/21
– 89.149.192.0/18
– 84.16.224.0/19
– 78.159.96.0/19
– 95.168.160.0/19
– 212.95.32.0/19
– 77.223.144.0/23
– 217.73.56.0/21
– 46.166.152.0/21

We do apologize for any inconvenience caused.

Kind regards,

LeaseWeb – NOC

05 jul

[20120717] EvoSwitch high volume router maintenance

Startdate: July 17th 2012 05:00:00 (CEST)
Enddate: July 17th 2012 08:00:00 (CEST)

Dear Customer,

As part of our commitment to continually improve the level of service you receive from LeaseWeb we are undertaking this maintenance.

During this maintenance we will upgrade the software on one of our high volume core routers in EvoSwitch. We've experienced issues before when doing this upgrade, therefore we have planned a maintenance window of 3 hours. During this maintenance we have our vendor standby to assist us.

Affected IP ranges:
85.17.24.0/21
82.192.94.0/23
83.149.124.0/22
62.212.85.0/24
82.192.84.0/23
83.149.70.0/23
95.211.136.0/21
212.7.212.0/23
62.212.82.0/24
62.212.88.0/23
95.211.144.0/20
88.208.57.0/24
46.243.0.0/22
88.208.50.0/23
216.59.55.0/24
88.208.44.0/23
88.208.43.0/24
88.208.52.0/22
88.208.58.0/23
216.59.60.0/24
46.243.4.0/23

2001:1af8:4010::/44

Kind regards,

LeaseWeb – NOC