05 jul

[Leaseweb – Germany] | Databurg distribtion router down [Update]

Time: July 5th 2012 03:20:00
Dear Customer,

***Update-04:20 05-07-2012:
All services are back online. We had routing issues on one of our router, that get isolated from the network, but the issues has been resolved permanently.

Please be informed that one of our distribution router in Databurg is currently having issues, that results in high latency, or loss of connection.

We are doing our utmost to bring back the service as soon as possible.

Affected IP subnets:
– 37.1.216.0/21
– 37.58.48.0/20
– 46.166.151.0/24
– 46.166.152.0/21
– 217.20.126.0/23
– 217.20.120.0/22
– 217.20.112.0/21
– 176.65.160.0/21
– 178.162.128.0/17
– 188.72.192.0/18
– 91.191.160.0/21
– 89.149.192.0/18
– 84.16.224.0/19
– 78.159.96.0/19
– 95.168.160.0/19
– 212.95.32.0/19
– 77.223.144.0/23
– 217.73.56.0/21
– 46.166.152.0/21

We do apologize for any inconvenience caused.

Kind regards,

LeaseWeb – NOC

05 jul

[Leaseweb – Germany] | Databurg distribtion router down

Time: July 5th 2012 03:20:00
Dear Customer,

Please be informed that one of our distribution router in Databurg is currently having issues, that results in high latency, or loss of connection.

We are doing our utmost to bring back the service as soon as possible.

Affected IP subnets:
– 37.1.216.0/21
– 37.58.48.0/20
– 46.166.151.0/24
– 46.166.152.0/21
– 217.20.126.0/23
– 217.20.120.0/22
– 217.20.112.0/21
– 176.65.160.0/21
– 178.162.128.0/17
– 188.72.192.0/18
– 91.191.160.0/21
– 89.149.192.0/18
– 84.16.224.0/19
– 78.159.96.0/19
– 95.168.160.0/19
– 212.95.32.0/19
– 77.223.144.0/23
– 217.73.56.0/21
– 46.166.152.0/21

We do apologize for any inconvenience caused.

Kind regards,

LeaseWeb – NOC

03 jul

Manassas, VA core router maintenance

Startdate: July 10th 2012 13:00:00 (CEST)
Enddate: July 10th 2012 14:00:00 (CEST)

Dear customer,

We will perform a maintenance of one of our core routers of our American network located in Manassas, VA. We will replace a supervisor module which we suspect to cause slow download/upload speeds in some cases.
All traffic will be rerouted towards other routers which have enough capacity and no impact is expected.

The maintenance will take place on July 10 between 11:00 and 12:00 UTC, which is in other time zones:
– 07:00 – 08:00 AM EDT
– 13:00 – 14:00 CEST

Kind regards,
LeaseWeb NOC

03 jul

Network issues on hight volume router Netherlands, EvoSwitch DC [Update]

Time: July 3rd 2012 12:56:00
Dear Sir/Madam,

We are experiencing issues on a high volume router in the Netherlands, EvoSwitch datacenter. An engineer is checking on the issue at the moment.

IPv4 Prefixes affected:
82.192.78.0/24
85.17.72.0/23
85.17.90.0/24
85.17.132.0/24
85.17.136.0/24
85.17.147.0/24
85.17.172.0/24
85.17.190.0/23
95.211.88.0/22

Updates will follow.

Kind regards,

Leaseweb NOC

01 jul

Issues with Express Cloud [Update]

Time: July 1st 2012 12:44:00
Dear customer,

Currently LeaseWeb is working on fixing issues on the Express Cloud platform, caused by the 'leap second bug' that is impacting various platforms world-wide.
The impact of the issue is limited to part of the Express Cloud instances. The following services might not function correctly:
– Stopping, starting and rebooting of instances via the SSC
– Editing firewall rules and switching the firewall on/off
Currently we are working on fixing these issues. We might need to restart a small amount of instances during the maintenance.
We do apologize for any inconvenience caused.
Kind regards,

LeaseWeb – NOC

UPDATE 20120701 13:30

We have restarted a number of management processes. We are now monitoring our systems, and waiting for a number of queued tasks to finish, and for the system to stabilize further. As the accumulated number of queued tasks is quite high, the impacted functionality is not fully available yet. We have not needed to restart any customer instances.

UPDATE 20120701 15:35

The platform is still stabilizing. Due to the large number of concurrent jobs running in the system, we have had to restart a small amount of instances (currently less than 10) to help bring the system back in sync. The platform is now functioning for part of the customer base, but operations on instances via the SSC can take a while to complete. We continue to work to get all services back online as soon as possible.

Kind regards,

LeaseWeb – NOC

UPDATE 20120701 16:30

The platform has stabilized, and all SSC features are working again. Due to increased activity on the platform, it might take a little longer for some actions to complete. Total impact on customer instances has been limited to roughly 10 restarted instances. In case of any issues, please contact us via the support system. We again apologize for the inconvenience.

Kind regards,

LeaseWeb – NOC

01 jul

Issues with Express Cloud [Update]

Time: July 1st 2012 12:44:00
Dear customer,

Currently LeaseWeb is working on fixing issues on the Express Cloud platform, caused by the 'leap second bug' that is impacting various platforms world-wide.
The impact of the issue is limited to part of the Express Cloud instances. The following services might not function correctly:
– Stopping, starting and rebooting of instances via the SSC
– Editing firewall rules and switching the firewall on/off
Currently we are working on fixing these issues. We might need to restart a small amount of instances during the maintenance.
We do apologize for any inconvenience caused.
Kind regards,

LeaseWeb – NOC

UPDATE 20120701 13:30

We have restarted a number of management processes. We are now monitoring our systems, and waiting for a number of queued tasks to finish, and for the system to stabilize further. As the accumulated number of queued tasks is quite high, the impacted functionality is not fully available yet. We have not needed to restart any customer instances.

UPDATE 20120701 15:35

The platform is still stabilizing. Due to the large number of concurrent jobs running in the system, we have had to restart a small amount of instances (currently less than 10) to help bring the system back in sync. The platform is now functioning for part of the customer base, but operations on instances via the SSC can take a while to complete. We continue to work to get all services back online as soon as possible.

Kind regards,

LeaseWeb – NOC

01 jul

Issues with Express Cloud [Update]

Time: July 1st 2012 12:44:00
Dear customer,

Currently LeaseWeb is working on fixing issues on the Express Cloud platform, caused by the 'leap second bug' that is impacting various platforms world-wide.
The impact of the issue is limited to part of the Express Cloud instances. The following services might not function correctly:
– Stopping, starting and rebooting of instances via the SSC
– Editing firewall rules and switching the firewall on/off
Currently we are working on fixing these issues. We might need to restart a small amount of instances during the maintenance.
We do apologize for any inconvenience caused.
Kind regards,

LeaseWeb – NOC

UPDATE 20120701 13:30

We have restarted a number of management processes. We are now monitoring our systems, and waiting for a number of queued tasks to finish, and for the system to stabilize further. As the accumulated number of queued tasks is quite high, the impacted functionality is not fully available yet. We have not needed to restart any customer instances.

01 jul

Issues with Express Cloud

Time: July 1st 2012 12:44:00
Dear customer,

Currently LeaseWeb is working on fixing issues on the Express Cloud platform, caused by the 'leap second bug' that is impacting various platforms world-wide.
The impact of the issue is limited to part of the Express Cloud instances. The following services might not function correctly:
– Stopping, starting and rebooting of instances via the SSC
– Editing firewall rules and switching the firewall on/off
Currently we are working on fixing these issues. We might need to restart a small amount of instances during the maintenance.
We do apologize for any inconvenience caused.
Kind regards,

LeaseWeb – NOC

27 jun

Telecom Italia capacity issues [Update]

Time: June 27th 2012 18:00:00
Dear Customer,

We see issues in Telecom Italia backbone between the Netherlands and Italy. Those links carry most of the traffic between our datacenters in the Netherlands and Telecom Italia domestic customers. You can see higher latency, packet loss and in some cases loss of connectivity.
We are working closely with Telecom Italia to help them solving the problems in their backbone. They don't have any ETA yet for this issue. We will post updates here once we have them.

Kind regards,
LeaseWeb NOC.

[UPDATE 21:00]
It seems Telecom Italia engineers have solved their backbone problems. Please open a ticket at [email protected] should you have any more issues.