22 nov

[US] Mandatory U.S. server relocation maintenance update [Update]

Startdate: December 17th 2012 23:00:00 (CET)
Enddate: December 20th 2012 07:00:00 (CET)

Dear LeaseWeb customer,

To ensure we can provide you with the highest quality infrastructure and services, we recently announced the migration of all U.S. racks and servers to a new state-of-the-art facility within our U.S. datacenter in Virginia (please go to <a href="http://leasewebnoc.com/en/maintenance/us-important-maintenance-announcement">HERE</a> for the full announcement). During this relocation, we will perform the following activities:
• Disconnect all racks from power sources and network uplinks
• Move complete racks from their current location to their new location
• Reconnect the racks to new power and network infrastructure
• Bring all servers back online

The relocation will take place between 17 – 20 December 2012, from 11:00 P.M. – 7:00 A.M. EST.
Below you will find the schedule for the relocation, based on IP ranges. We kindly request all customers to turn off their affected servers before the relocation.

<u>17 – 18 December (11:00 PM 7:00 AM)</u>

108.59.0.0 – 108.59.0.255
108.59.1.0 – 108.59.1.63
108.59.1.128 – 108.59.1.159
108.59.1.176 – 108.59.1.255
108.59.10.0 – 108.59.10.63
108.59.10.112 – 108.59.10.127
108.59.12.128 – 108.59.12.255
108.59.2.192 – 108.59.2.255
108.59.2.32 – 108.59.2.127
108.59.3.0 – 108.59.3.127
108.59.3.192 – 108.59.3.223
108.59.4.0 – 108.59.4.31
108.59.4.64 – 108.59.4.127
108.59.5.0 – 108.59.5.255
108.59.6.128 – 108.59.6.159
108.59.6.192 – 108.59.6.255
108.59.6.64 – 108.59.6.95
108.59.7.240 – 108.59.7.255
108.59.8.128 – 108.59.8.191
108.59.9.0 – 108.59.9.159
108.59.9.224 – 108.59.9.255
198.7.56.0 – 198.7.56.63
198.7.60.64 – 198.7.60.159
199.115.112.192 – 199.115.112.255
199.115.112.64 – 199.115.112.127
199.115.113.160 – 199.115.113.191
199.115.114.160 – 199.115.114.255
199.115.115.128 – 199.115.115.255
199.115.116.0 – 199.115.116.31
199.115.118.0 – 199.115.118.63
199.115.118.128 – 199.115.118.159
199.115.119.128 – 199.115.119.191
199.115.119.64 – 199.115.119.95
199.58.84.64 – 199.58.84.127
199.58.85.0 – 199.58.85.31
199.58.86.192 – 199.58.86.255
199.58.87.0 – 199.58.87.63
199.58.87.160 – 199.58.87.255

<u>18 – 19 December (11:00 PM 7:00 AM)</u>

108.59.1.64 – 108.59.1.95
108.59.10.128 – 108.59.10.255
108.59.10.64 – 108.59.10.103
108.59.11.192 – 108.59.11.255
108.59.11.64 – 108.59.11.127
108.59.13.0 – 108.59.13.63
108.59.13.192 – 108.59.13.255
108.59.14.64 – 108.59.14.255
108.59.2.0 – 108.59.2.31
108.59.2.128 – 108.59.2.191
108.59.3.128 – 108.59.3.191
108.59.3.224 – 108.59.3.255
108.59.4.160 – 108.59.4.223
108.59.4.32 – 108.59.4.63
108.59.7.32 – 108.59.7.223
108.59.8.192 – 108.59.8.255
108.59.8.64 – 108.59.8.127
108.59.9.160 – 108.59.9.223
198.7.56.192 – 198.7.56.207
198.7.60.0 – 198.7.60.31
198.7.60.192 – 198.7.60.255
198.7.60.48 – 198.7.60.63
198.7.61.0 – 198.7.61.63
199.115.112.32 – 199.115.112.47
199.115.113.128 – 199.115.113.159
199.115.113.64 – 199.115.113.95
199.115.114.0 – 199.115.114.31
199.115.114.128 – 199.115.114.143
199.115.115.0 – 199.115.115.63
199.115.116.192 – 199.115.116.255
199.115.116.32 – 199.115.116.127
199.115.117.0 – 199.115.117.63
199.115.117.128 – 199.115.117.191
199.115.118.160 – 199.115.118.191
199.115.118.80 – 199.115.118.83
199.115.119.0 – 199.115.119.63
199.115.119.224 – 199.115.119.255
199.115.119.96 – 199.115.119.127
199.58.85.32 – 199.58.85.127
199.58.87.64 – 199.58.87.159

<u>20 – 21 December (11:00 PM 7:00 AM)</u>

108.59.1.96 – 108.59.1.127
108.59.11.0 – 108.59.11.63
108.59.11.128 – 108.59.11.191
108.59.12.0 – 108.59.12.127
108.59.13.64 – 108.59.13.191
108.59.14.0 – 108.59.14.63
108.59.4.128 – 108.59.4.159
108.59.6.0 – 108.59.6.63
108.59.6.160 – 108.59.6.191
108.59.6.96 – 108.59.6.127
108.59.7.0 – 108.59.7.31
108.59.8.0 – 108.59.8.63
198.7.56.128 – 198.7.56.191
198.7.56.224 – 198.7.56.255
199.115.112.0 – 199.115.112.31
199.115.112.128 – 199.115.112.191
199.115.113.0 – 199.115.113.63
199.115.113.192 – 199.115.113.255
199.115.113.96 – 199.115.113.127
199.115.114.32 – 199.115.114.127
199.115.115.64 – 199.115.115.127
199.115.116.128 – 199.115.116.191
199.115.117.192 – 199.115.117.255
199.115.117.64 – 199.115.117.127
199.115.118.192 – 199.115.118.255
199.115.118.64 – 199.115.118.79
199.115.118.96 – 199.115.118.127
199.115.119.192 – 199.115.119.223
199.58.84.0 – 199.58.84.63
199.58.84.128 – 199.58.84.255
199.58.85.128 – 199.58.85.255
199.58.86.0 – 199.58.86.127

<b>Expected downtime</b>
While we will minimize any downtime as much as possible, we expect affected servers to be offline for about 30 – 60 minutes.

<b>After the maintenance</b>
After a server has been relocated, on-site engineers will check if it restarted correctly. An End-of-Maintenance Notification will be sent once a server is back online.

<b>Please contact LeaseWeb support in case of any issues</b>
LeaseWeb will of course perform the relocation with the greatest care. However, should you receive an End-of-Maintenance Notification while your server is not yet online, please notify LeaseWeb Support by replying to the notification. Alternatively, you can email any issues to [email protected].

We apologize for any inconvenience caused and thank you for your understanding.

15 nov

[Leaseweb – Evoswitch] | Issues with the High Volume Network [Update]

Time: November 14th 2012 23:07:00
Dear Sir/Madam,

We are currently having issues with out High Volume Network in Evoswitch. You might experience higher delay, or connectivity issues.
We are investigating and we will update this posting.

Affected ranges
62.212.72.0/23
62.212.82.0/23
62.212.85.0/24
62.212.88.0/23
82.192.78.0/24
82.192.84.0/23
82.192.94.0/23
83.149.70.0/23
83.149.124.0/22
85.17.24.0/21
85.17.72.0/23
85.17.90.0/24
85.17.132.0/24
85.17.136.0/24
85.17.147.0/24
85.17.172.0/24
85.17.190.0/23
95.211.88.0/22
95.211.136.0/21
95.211.144.0/20
95.211.200.0/22

[Update@11:25]
We believe traffic has been restored and issue has stopped.
We are still investigating.

[Update@11:45]
We think we have found the cause of the issues.
One of the internet exchanges we connect to has experienced issues with a linecard we are connected to.
It seems our core-router connected to that blade received an extremely large amount of packets per second during short period.This in turn led to high CPU load which caused other BGP sessions to become unstable.

The internet exchange has reported that their equipment seems stable again, and they are working with their vendor's support to investigate.

We will also continue to investigate, and monitor the situation.
For now the Leaseweb network seems  stable, if you do still experience issues, please contact our support dept.

07 nov

Leaseweb NL Schuberg Philis router 1 down [Update]

Time: November 7th 2012 11:14:00
Dear Sir/Madam,

We are experiencing a power issue/hardware crash on our router 1 in Schuberg Philis datacenter.
As it is a redundant setup, router 2 has taken over.
All services with correctly configured redundant uplinks are online.

@Update 11:25
Router is now back online and connectivity should have been restored.
The cause of the issue was a software bug.
We will schedule a maintenance in the near future to upgrade the software to latest version.

Update at 13:11
Currently we are having a network issue. An engineer is working on this. Please stand by for updates.

Update at 13:15
The issue is resolved and was caused by a loop on the network. During the outage we noticed some irregularities which during troubleshooting afterwards caused the loop.

31 okt

[US] Important maintenance announcement

Startdate: December 10th 2012 00:00:00 (CEST)
Enddate: December 20th 2012 23:59:00 (CEST)

Dear customer,

As part of our commitment to continually improve the level of service LeaseWeb provides, you are receiving the following announcement to inform you about the upcoming maintenance in December 2012.

WHAT CAN I EXPECT?
Between December 10th and December 20th 2012, LeaseWeb will relocate all racks and servers to a new state-of-the-art facility within our US datacenter in Northern Virginia. To do so, we will disconnect all power and rack connectivity and move complete racks to their new location. This will impact your service for a short period.

During the relocation LeaseWeb engineers will shut down all servers, relocate the entire set-up and power up the servers in their new location. It is advised to shut down your server before the maintenance will start.

WHY ARE YOU PERFORMING THIS MAINTENANCE?
We are committed to provide our customers with the best service they expect. To support our continuous growth and guarantee to improve our service levels, we will relocate all racks to a new location within the US datacenter.

WHEN EXACTLY WILL MY SERVICE BE IMPACTED?
All customers will receive updated information within two weeks on when their service will be impacted. The expected downtime will be two hours. We will do our absolute best to minimize downtime. LeaseWeb engineers will be available during and after the maintenance in case of any issues.

31 okt

[Leaseweb USA] Regarding to hurricane Sandy [Update]

Time: October 29th 2012 19:54:00
Customers with services in our USA datacenter near Washington DC we would like to inform.

In preparation for hurricane Sandy, standard emergency procedures are in place and the team is on standby 24/7 to respond to any support requests. In the event of any issues, updates will continue on this page throughout.

[UPDATE 31-10-2012 15:45]
During and after hurricane Sandy all systems operated without interruption and no incidents were reported. Of course, should you encounter any issues, please do not hesitate to contact us.

30 okt

[Leaseweb USA] Regarding to hurricane Sandy

Time: October 29th 2012 19:54:00
Customers with services in our USA datacenter near Washington DC we would like to inform.

In preparation for hurricane Sandy, standard emergency procedures are in place and the team is on standby 24/7 to respond to any support requests. In the event of any issues, updates will continue on this page throughout.

17 okt

Leaseweb NL – High volume router maintenance [Update]

Startdate: October 17th 2012 06:00:00 (CEST)
Enddate: October 17th 2012 09:00:00 (CEST)

Dear Customer,

As part of our commitment to continually improve the level of service you receive from LeaseWeb we are undertaking the following maintenance.

The reason for this maintenance is because of issues we encountered on this mornings maintenance, we concluded that the issues was not related to a defected blade but the router chassis itself, this mornings maintenance ref.: * EMERGENCY* EvoSwitch high volume router maintenance".

During this maintenance we will change the complete chassis on one of our high volume routers in EvoSwitch.
We have planned a maintenance window of 2 hours.

Affected IP ranges:

* 95.211.168.0/21
* 95.211.94.0/23
* 95.211.184.0/21
* 95.211.192.0/21

* 2001:1AF8:4070::/44

Update: 17-10-2012 06:20 CET
We will bring the router down within the 30 minutes and start the chassis swap.

Update: 17-10-2012 07:20 CET
Maintenance is finished and went as planned.
All links are online, should you experience any problems, please contact use at [email protected]

17 okt

Leaseweb NL – High volume router maintenance [Update]

Startdate: October 17th 2012 06:00:00 (CEST)
Enddate: October 17th 2012 09:00:00 (CEST)

Dear Customer,

As part of our commitment to continually improve the level of service you receive from LeaseWeb we are undertaking the following maintenance.

The reason for this maintenance is because of issues we encountered on this mornings maintenance, we concluded that the issues was not related to a defected blade but the router chassis itself, this mornings maintenance ref.: * EMERGENCY* EvoSwitch high volume router maintenance".

During this maintenance we will change the complete chassis on one of our high volume routers in EvoSwitch.
We have planned a maintenance window of 2 hours.

Affected IP ranges:

* 95.211.168.0/21
* 95.211.94.0/23
* 95.211.184.0/21
* 95.211.192.0/21

* 2001:1AF8:4070::/44

Update: 17-10-2012 06:20 CET
We will bring the router down within the 30 minutes and start the chassis swap.

17 okt

Maintenance Webhosting platform [Update]

Startdate: October 15th 2012 12:00:00 (CEST)
Enddate: October 15th 2012 12:05:00 (CEST)

————————–UPDATE 16-10-2012 17.30————————————-

The previously encountered issues are resolved. We will proceed with the network
reconfiguration. The new planned date-time is: 18th of October, at 3:00 PM CET.

————————–UPDATE 15-10-2012 13:40————————————-

During last minute testing we discovered a issue with the change. Therefore we did not proceed.

We're fixing the issue and will keep you updated.

————————–UPDATE 15-10-2012 13:40————————————-

To deliver the new webhosting cluster, we will need to move the IP addresses to the new load balancers.
This will result in a downtime of approximately 5 minutes for the websites on one of the following IP addresses:
95.211.13.67
95.211.13.68
95.211.13.69
95.211.13.70
This will be done on the 15th of October, at 12:00 PM CET.

17 okt

* EMERGENCY* EvoSwitch high volume router maintenance [Update]

Startdate: October 11th 2012 06:00:00 (CEST)
Enddate: October 11th 2012 09:00:00 (CEST)

Dear Customer,

As part of our commitment to continually improve the level of service you receive from LeaseWeb we are undertaking this maintenance.

During this maintenance we will upgrade the software on one of our high volume routers in EvoSwitch.
We will also replace a suspected linecard as advised by our vendor.
We have planned a maintenance window of 2 hours.

Affected IP ranges:

* 95.211.168.0/21
* 95.211.94.0/23
* 95.211.184.0/21
* 95.211.192.0/21

* 2001:1AF8:4070::/44

Update: 06:45

We will perform the upgrade start now

Update: 08:00
The maintenance window is now closed.
The planned activities did not go according to the plan, we will plan another maintenance a.s.a.p. to change the hardware needed.
All links are online, should you experience any problems, please contact use at [email protected]