07 nov

HDCS Router upgrade part 2 [Update]

Startdate: October 28th 2011 12:00:00(CEST)
Enddate: October 28th 2011 12:30:00(CEST)

Dear customer,



We will perform a software upgrade on one (1) standard (primary) HSRP router in the LOFT (US) datacenter. Since we use HSRP to provide redundancy on the standard network there is no impact, however during the swap from standby to active you can notice some packet-loss. If you have a private rack please make sure that redundancy is working correctly.



The affected ranges are below:

Standard network

– 108.59.0.0/24

– 108.59.1.0/24

– 108.59.2.0/24

– 108.59.5.0/24

– 108.59.6.0/23

– 108.59.15.0/24

– 108.59.12.0/24



The maintenance will take place on the 28th of october between 12:00 CEST, 6:00 AM EDT (Manassas, Virginia) and 12:30 CEST, 6:30 AM EDT (Manassas, Virginia) time.





Kind regards,



LeaseWeb NOC



[UPDATE @ 12:30]

The upgrade is completed and everything went as it should. If you encounter issues, please contact technical support.

07 nov

Easynet Router upgrade [Update]

Startdate: November 2nd 2011 06:00:00(CEST)
Enddate: November 2nd 2011 06:30:00(CEST)

Dear customer,

We will perform a software upgrade on one (1) standard (primary) HSRP router in the Easynet datacenter. Since we use HSRP to provide redundancy on the standard network there is no impact, however during the swap from standby to active you can notice some packet-loss. If you have a private rack please make sure that redundancy is working correctly.

The affected ranges are below:

Standard network, number one

– 85.17.32.0/19

– 85.17.96.0/20

– 85.17.112.0/21

– 85.17.96.0/19

– 77.235.32.0/19

– 193.242.108.0/24

– 193.43.92.0/24

– 195.242.98.0/23

– 91.195.118.0/23

– 195.200.82.0/23

– 94.100.112.0/20

– 83.223.32.0/20

– 89.104.168.0/24

– 109.70.0.0/21

– 212.32.225.0/24

– 212.32.226.0/24

– 46.102.224.0/21

– 46.102.240.0/21

– 46.17.0.0/21

– 128.140.216.0/22

The maintenance will take place on the second (2) of November between 06:00 and 07:00 CEST.

Kind regards,

LeaseWeb NOC

[UPDATE]

Maintenance have been rescheduled and will take place on the second of november

[UPDATE @ 06:20]

Upgrade went successful and without issues. If you encounter issues after the upgrade, please contact support.

07 nov

emergency maintenance Firewall replacement [Update]

Startdate: November 2nd 2011 12:30:00(CEST)
Enddate: November 2nd 2011 13:00:00(CEST)

Dear customer,



One of our shared firewalls has failed. As they are in a redundant setup there is no impact to customers. In order to make the platform redundant again we need to replace the failed firewall.



We do not expect any impact during the swap. If you see any issues please contact us at [email protected].



Ranges on the firewall:

85.17.197.192/26

82.192.86.64/26

85.17.235.160/27

95.211.59.0/26



Kind regards,



Leaseweb – NOC



[12:49] The faulty firewall has been replace and the platform is redundant again.

07 nov

EvoSwitch Core router linecard insertion

Startdate: October 26th 2011 09:00:00(CEST)
Enddate: October 26th 2011 10:00:00(CEST)

Dear Customer,



During this maintenance slot we will insert new linecards into the core router at EvoSwitch. The router and linecards support OIR (Online Insertion and Removal) there should be no impact.



Kind regards,



Leaseweb NOC

07 nov

EvoSwitch Router upgrade part 3 [Update]

Startdate: October 27th 2011 06:00:00(CEST)
Enddate: October 27th 2011 07:00:00(CEST)

Dear customer,



We will perform a software upgrade on four (4) standard (primary) HSRP routers in the Evoswitch datacenter. Since we use HSRP to provide redundancy on the standard network there is no impact, however during the swap from standby to active you can notice some packet-loss. If you have a private rack please make sure that redundancy is working correctly.



The affected ranges are below:

Standard network, number one

95.211.48.0/21

95.211.56.0/23

62.212.88.0/23

85.17.68.0/22

85.17.135.0/24

85.17.181.0/24



Standard network, number two

95.211.40.0/21

95.211.58.0/23

95.211.62.0/23

95.211.64.0/21

62.212.67.0/24

62.212.74.0/24

62.212.91.0/24

82.192.86.0/24

82.192.71.0/24

85.17.134.0/24

85.17.151.0/24

85.17.199.0/24

85.17.202.0/23

85.17.204.0/23

85.17.206.0/24

85.17.219.0/24

85.17.226.0/24

85.17.229.0/24

85.17.231.0/24

85.17.232.0/24

85.17.235.0/24

85.17.236.0/23

85.17.238.0/24

85.17.242.0/23

31.186.168.0/23



Standard network, number three

– 94.75.194.0/24

– 94.75.195.0/24

– 94.75.196.0/24

– 94.75.197.0/24

– 94.75.200.0/21

– 94.75.208.0/21

– 94.75.224.0/23

– 94.75.228.0/24

– 94.75.233.0/24

– 94.75.240.0/20

– 95.211.0.0/19

– 212.7.192.128/25

– 212.7.193.128/25

– 212.7.208.0/24

– 94.124.56.0/21

– 62.212.75.0/24

– 87.236.96.0/21

– 90.156.224.0/20

– 82.192.87.0/24

– 82.192.88.0/24

– 46.182.176.0/22

– 193.107.18.0/24

– 46.166.148.0/23

– 46.166.150.0/24



Standard network, number four

– 95.211.72.0/21

– 95.211.108.0/22

– 95.211.112.0/20

– 212.7.200.0/22

– 95.211.134.0/23

– 95.211.106.0/23

– 82.192.74.0/23

– 82.192.92.0/23

– 95.211.160.0/23

– 82.192.66.0/24

– 31.186.170.0/24

– 83.149.102.0/23

– 188.95.136.0/22

– 94.177.98.0/23

– 92.114.86.0/23

– 82.192.90.0/24

– 212.7.214.0/24

– 46.226.192.0/22



The maintenance will take place on the 27th of October between 06:00 and 07:00 CEST.





Kind regards,



LeaseWeb NOC



{UPDATE @ 06:40]

Maintenance is completed and went without issues. If you encounter issues, please contact technical support at [email protected] for this.

07 nov

HDCS Router upgrade

Startdate: October 18th 2011 12:00:00(CEST)
Enddate: October 18th 2011 12:30:00(CEST)

Dear Customer,



We will perform a software upgrade on one of the standby routers in the LOFT (HDCS) datacenter in Manassas. Since we use HSRP to provide redundancy there should be no impact because of this.



The following ranges are impacted:

– 108.59.0.0/24

– 108.59.1.0/23

– 108.59.3.0/24

– 108.59.4.0/25

– 108.59.5.0/24

– 108.59.6.0/23

– 108.59.12.0/24

– 108.59.15.0/24



The maintenance will take place on 18 october between 12:00 CEST, 6:00 AM EDT (Manassas, Virginia) and 12:30 CEST, 6:30 AM EDT (Manassas, Virginia) time.



Kind regards,



LeaseWeb NOC



[UPDATE @ 12:30]

The upgrade went successful and every connection have been restored

07 nov

EvoSwitch Router upgrade part 2 [Update]

Startdate: October 25th 2011 06:00:00(CEST)
Enddate: October 25th 2011 07:00:00(CEST)

Dear Customer,



We will perform a software upgrade on two (2) standard (primary) HSRP- and six (6) high volume routers in the Evoswitch datacenter. Since we use HSRP to provide redundancy on the standard network there is no impact, however during the swap from standby to active you can notice some packet-loss. If you have a private rack please make sure that redundancy is working correctly. With the high volume network you will notice an interruption during the reload of the router.



The affected ranges are below:

Standard network, number one

– 94.75.194.0/24

– 94.75.195.0/24

– 94.75.196.0/24

– 85.17.128.0/17

– 82.192.79.0/24

– 95.211.62.0/23

– 95.211.32.0/21

– 62.212.64.0/20

– 95.211.48.0/21

– 95.211.56.0/22

– 85.17.68.0/22

– 95.211.64.0/21

– 82.192.68.0/22

– 85.17.87.0/24

– 85.17.88.0/23

– 85.17.92.0/22

– 82.192.86.0/24

– 80.65.32.0/20

– 82.192.71.0/24

– 195.140.240.0/22

– 62.221.192.0/18

– 94.75.194.0/24

– 94.75.195.0/24

– 94.75.196.0/24

– 178.18.20.0/22

– 94.126.32.0/21

– 91.215.156.0/24

– 31.186.168.0/23

– 193.27.72.0/23

– 93.190.220.0/24

– 91.224.38.0/23

– 212.7.204.0/23

– 95.211.40.0/21

– 62.212.78.0/23

– 159.255.192.0/22



Standard network, number two

– 95.211.128.0/22

– 95.211.132.0/23

– 82.192.91.0/24



High volume, number one

– sh 85.17.190.0/23

– 85.17.132.0/24

– 85.17.136.0/24

– 85.17.147.0/24

– 85.17.90.0/24

– 95.211.88.0/23

– 95.211.90.0/24

– 85.17.72.0/23

– 82.192.78.0/24

– 62.212.71.0/24

– 85.17.172.0/24



High volume, number two

– 94.75.220.0/22

– 94.75.216.0/23

– 94.75.229.0/24

– 94.75.240.0/24

– 94.75.253.0/24

– 94.75.234.0/24

– 62.212.84.0/24

– 95.211.92.0/23

– 85.17.84.0/24

– 212.7.192.0/22



High volume, number three

– 85.17.80.0/22

– 85.17.76.0/22

– 85.17.4.0/24

– 213.142.144.0/22

– 213.142.136.0/21

– 217.19.1.0/24

– 91.215.158.0/23

– 178.22.122.0/24

– 80.253.248.0/22



High volume, number four

– 94.75.218.0/23

– 94.75.232.0/24

– 94.75.250.0/24

– 95.211.105.0/24

– 95.211.60.0/23

– 212.7.206.0/23

– 212.7.210.0/24

– 46.182.120.0/22

– 46.182.124.0/22

– 31.31.32.0/22

– 31.31.36.0/22



High volume, number five

– 94.75.236.0/23

– 95.211.80.0/21

– 95.211.96.0/22

– 95.211.100.0/23

– 85.17.74.0/23

– 109.69.56.0/22

– 212.7.196.0/22

– 212.7.209.0/24

– 46.243.6.0/23



High volume, number six

– 85.17.24.0/21

– 82.192.94.0/23

– 62.212.85.0/24

– 82.192.84.0/24

– 83.149.70.0/23

– 62.212.72.0/23

– 62.212.88.0/23

– 95.211.137.0/23

– 212.7.212.0/24



The maintenance will take place on the 25th of October between 06:00 and 07:00 CEST.





Kind regards,



LeaseWeb NOC



[UPDATE @ 07:00]

The maintenance is done and went without unexpected issues. If you encounter any issues, please contact support trough [email protected]



[UPDATE @ 07:15]

While checking it appears that there are issues with high volume router two (2). This appears to be caused by one of the uplinks. We have now shut this and will replace the interface.



{UPDATE @ 08:23]

There are still issues with the high volume router two (2). Therefore an emergency reload was required.



[UPDATE @ 9:30]

The issues have been resolved. If you notice issues. Contact us trough phone or email as soon as possible.



[UPDATE @ 10:22]

Additional information: The issues with the second high volume router (2) were caused by a software bug. We are looking into the issue what have triggered this. A new maintenance will be scheduled for this once the cause have been found.

07 nov

EvoSwitch Router upgrade

Startdate: October 18th 2011 06:00:00(CEST)
Enddate: October 18th 2011 07:00:00(CEST)

Dear Customer,



We will perform a software upgrade on two of the standby routers in the Evoswitch datacenter. Since we use HSRP to provide redundancy there should be no impact because of this. If you have a private rack please make sure that redundancy is working correctly.



The following ranges are impacted for the first router:

95.211.48.0/21

95.211.56.0/23

62.212.88.0/23

85.17.68.0/22

85.17.135.0/24

85.17.181.0/24

178.18.21.0/23

178.18.22.0/24

193.27.73.252

193.27.72.0/23



The following for the second router:

91.215.156.0/24

31.186.168.0/23

62.212.67.0/24

62.212.74.0/24

62.212.91.0/24

82.192.86.0/24

82.192.71.0/24

85.17.134.0/24

85.17.151.0/24

85.17.199.0/24

85.17.202.0/23

85.17.204.0/23

85.17.206.0/24

85.17.219.0/24

85.17.226.0/24

85.17.229.0/24

85.17.231.0/24

85.17.232.0/24

85.17.235.0/24

85.17.236.0/23

85.17.238.0/24

85.17.242.0/23

93.190.220.0/24

94.75.226.0/24

94.75.239.0/24

95.211.40.0/21

95.211.58.0/23

95.211.62.0/23

95.211.64.0/21



The maintenance will take place on 18 october between 06:00 CEST and 07:00 CEST (UTC +2)



Kind regards,



LeaseWeb NOC



[UPDATE @ 06:15]

The upgrade of both routers is done and was a success. For both routers the interface status and standby status for HSRP have been verified. These were the same as before and OK.

31 okt

Express cloud platform [Update]

Time: October 28th 2011 15:15:00(CEST)
Dear Customer,

At the moment we experience troubles with our express cloud platform. The SSC reboot function is not working at the moment due to this.

We are doing our utmost to solve this issue as soon as possible.

As soon as we have more information available, we will publish it here.

The affected prefix:

85.17.151.0 /24

95.211.75.0 /27

85.17.236.0 /24

85.17.255.0 /24

85.17.206.0 /24

85.17.180.0 /24

95.211.62.0 /23

95.211.40.0 /23

95.211.43.0 /24

82.192.86.0 /26

Please be patient while we are working on this problem.

Regards,

LeaseWeb BV

[UPDATE @ 15:30]

Everything has been restored and is online. If you have issues, please turn on your VPS trough SSC and if that doesn’t works, please contact support

[UPDATE @ 16:00]

Due to large bootstorm from our customers, it can take a while before your server is powered-on. Also customers that were not affected by this outage might experience lower performance until situation is stabilized.

Please don’t try to power-on/power-off your VPS continuously, as it only delays boot time.

[UPDATE]

All problems are resolved since Friday night. If you still experience problems first try to reboot your VPS. If this is doesn’t solve your problem please send an email to [email protected] so we can help you solving any problems caused by this outage.

28 okt

Express cloud platform [Update]

Time: October 28th 2011 15:15:00(CEST)
Dear Customer,

At the moment we experience troubles with our express cloud platform. The SSC reboot function is not working at the moment due to this.

We are doing our utmost to solve this issue as soon as possible.

As soon as we have more information available, we will publish it here.

The affected prefix:

85.17.151.0 /24

95.211.75.0 /27

85.17.236.0 /24

85.17.255.0 /24

85.17.206.0 /24

85.17.180.0 /24

95.211.62.0 /23

95.211.40.0 /23

95.211.43.0 /24

82.192.86.0 /26

Please be patient while we are working on this problem.

Regards,

LeaseWeb BV

[UPDATE @ 15:30]

Everything has been restored and is online. If you have issues, please turn on your VPS trough SSC and if that doesn’t works, please contact support

[UPDATE @ 16:00]

Due to large bootstorm from our customers, it can take a while before your server is powered-on. Also customers that were not affected by this outage might experience lower performance until situation is stabilized.

Please don’t try to power-on/power-off your VPS continuously, as it only delays boot time.