03 jan

[TC2] Relocation shared racks

Startdate: January 12th 2009 00:00:00(CEST)
Enddate: January 31st 2009 23:59:00(CEST)

Dear customer,

in January we will relocate all shared racks from TeleCity2 to EvoSwitch. During this relocation, which take place from 00h00 to 06h00 customers will experience downtime. We will do our utmost best to minimize downtime for all customers.

Relocation will start at 12 January 2009 and will end on February 1st.

Customers who will be relocated will receive an exact date on which the relocation will take place. Customers with own servers are allowed to relocate the servers themselves.


Kind regards,

LeaseWeb B.V.

18 dec

[EVO-Colo] Emergency reboot router [Update]

Startdate: December 18th 2008 03:10:00(CEST)
Enddate: December 18th 2008 03:15:00(CEST)

Dear Customers,

Due to a vlan database corruption on one of our routers, we need to do a emergency reboot and reload the router with a new IOS.
A reboot is necessary to resolve the issue.
All customers with redundant uplinks will experience no downtime.
We will keep you updated.


Kind regards,

LeaseWeb – NOC

[UPDATE 03:45]
The reload did not result in the desired effect.
We will replace the supervisor card with a different model.

[UPDATE 05.00]
Supervisor blade has been replaced and all connections are restored.

18 dec

[EVO-Colo] Emergency reboot router [Update]

Startdate: December 18th 2008 03:10:00(CEST)
Enddate: December 18th 2008 03:15:00(CEST)

Dear Customers,

Due to a vlan database corruption on one of our routers, we need to do a emergency reboot and reload the router with a new IOS.
A reboot is necessary to resolve the issue.
All customers with redundant uplinks will experience no downtime.
We will keep you updated.


Kind regards,

LeaseWeb – NOC

[UPDATE 03:45]
The reload did not result in the desired effect.
We will replace the supervisor card with a different model.

15 dec

Emergency maintenance [Update]

Startdate: December 15th 2008 20:00:00(CEST)
Enddate: December 15th 2008 22:30:00(CEST)

Dear customers,

We have scheduled an emergency maintenance window for several of our shared webservers.

This maintenance will affect the following servers:
– www3
– www8

Our apologies for any inconvenience this might cause.

Best regards,

LeaseWeb B.V.

[Update]
Maintenance has been completed

11 dec

Connection to LINX [Update]

Time: December 11th 2008 15:55:00(CEST)
Expected Downtime: Unknown
Reason: Supplier maintenance
*******************************

Dear Customer,

At the moment we experience some troubles in (part of) our network.

Our wavelength to London is currently down.
Because of this connectivity to LINX is also down.

Our wavelenght provider is currently upgrading their equipment, this upgrade was supposed to have no impact.
We have asked our supplier to restore connectivity ASAP and halt all upgrade tasks for the time being.

Please be patient while we are working on this problem.

Regards,
LeaseWeb BV

[UPDATE 16:32]
The wavelength service has been restored.
We will update agian when we are sure the link is stable.

[UPDATE 16:54]
The service is stable again.
Upgrade maintenance has been postponed until our supplier can guarantee further work will not impact our current services.

11 dec

Connection to LINX [Update]

Time: December 11th 2008 15:55:00(CEST)
Expected Downtime: Unknown
Reason: Supplier maintenance
*******************************

Dear Customer,

At the moment we experience some troubles in (part of) our network.

Our wavelength to London is currently down.
Because of this connectivity to LINX is also down.

Our wavelenght provider is currently upgrading their equipment, this upgrade was supposed to have no impact.
We have asked our supplier to restore connectivity ASAP and halt all upgrade tasks for the time being.

Please be patient while we are working on this problem.

Regards,
LeaseWeb BV

[UPDATE 16:32]
The wavelength service has been restored.
We will update agian when we are sure the link is stable.

08 dec

One AMS-IX 10GE down [Update]

Time: December 8th 2008 15:55:00(CEST)
One AMS-IX 10GE port at Nikhef down
*******************************

Dear Customer,

In preparing to upgrade our AMS-IX NIKHEF port from 20 to 40Gbps, a NIKHEF engineer disconnected the wrong cable.
One of the two 10GE interaces is down.
Because of this there was less connectivity to peers from that router.
The cable has been reconnected, and capacity restored.

Regards,
LeaseWeb BV

08 dec

Backup routers IOS upgrade [Update]

Startdate: December 8th 2008 05:00:00(CEST)
Enddate: December 8th 2008 06:00:00(CEST)

Dear Customers,

We have scheduled a few software updates on our backup routers. As they are backup routers there will be no impact to customers. Customers with private racks and which are not using both uplinks have been contacted so they can resolve this.

Kind regards,

LeaseWeb – NOC

[UPDATE 06:00]
All routers are updated. Maintenance has been completed

04 dec

SBP core switch down. [Update]

Time: December 3rd 2008 18:20:00(CEST)
Expected Downtime: Unknown
Location: Schuberg Philis
Affected IP ranges: 83.149.64.0/19
Reason: Under investigation
*******************************

Dear Customer,

At the moment we experience some troubles in (part of) our network.

We are doing our utmost to solve this issue a.s.a.p.
As soon as we have more information available, we will publish it here.

Please be patient while we are working on this problem.

An network engineer is in the neighbourhood, he will be on site in 5 minutes.


Regards,
LeaseWeb BV

[UPDATE 19:11]
The core switch had a faulty supervisor. The engineer onsite has replaced it and is in the process of getting the switch back online.

[UPDATE 19:28]
The spare supervisor is also crashing. The engineer onsite is now testing the linecards to pinpoint the cause.

[UPDATE 20:05]
Both coreswitches refuse to come online.
Two engineers are underway with more spare parts.

[UPDATE 20:25]
We’ve managed to get one coreswitch back online.
However some racks are still down, we’re continuing to fix these issues.

[UPDATE 21:25]
Most racks are back online.
Some cabling to the secondary coreswitch is not working correctly, we are now have 4 engineers on location, they are working to get all racks online ASAP.

[UPDATE 22:50]
Both coreswitches are online again.
some customers might notice a short interruption once they switch back to the primary coreswitch.

[UPDATE 02:30]
All our checks show all customers are online again.
If you do still have problems please contact support.

04 dec

SBP core switch down. [Update]

Time: December 3rd 2008 18:20:00(CEST)
Expected Downtime: Unknown
Location: Schuberg Philis
Affected IP ranges: 83.149.64.0/19
Reason: Under investigation
*******************************

Dear Customer,

At the moment we experience some troubles in (part of) our network.

We are doing our utmost to solve this issue a.s.a.p.
As soon as we have more information available, we will publish it here.

Please be patient while we are working on this problem.

An network engineer is in the neighbourhood, he will be on site in 5 minutes.


Regards,
LeaseWeb BV

[UPDATE 19:11]
The core switch had a faulty supervisor. The engineer onsite has replaced it and is in the process of getting the switch back online.

[UPDATE 19:28]
The spare supervisor is also crashing. The engineer onsite is now testing the linecards to pinpoint the cause.

[UPDATE 20:05]
Both coreswitches refuse to come online.
Two engineers are underway with more spare parts.

[UPDATE 20:25]
We’ve managed to get one coreswitch back online.
However some racks are still down, we’re continuing to fix these issues.

[UPDATE 21:25]
Most racks are back online.
Some cabling to the secondary coreswitch is not working correctly, we are now have 4 engineers on location, they are working to get all racks online ASAP.

[UPDATE 22:50]
Both coreswitches are online again.
some customers might notice a short interruption once they switch back to the primary coreswitch.