[SOLVED] Problem with one of our core routers

++++++++  05/04/2017 9:26 AM  CEST ++++++

We are currently experiencing issues with one of our core routers. We're looking into the problem right now and keep you updated via this post. 

++++++++  05/04/2017 9:45 AM CEST  ++++++

 The network has been restored around 9:30 CEST. Looks like it had something to do with a power dip that froze one of our core routers. We will do a post-mortem later today. We're terribly sorry for the inconvenience this might have caused.

 ++++++++  05/04/2017 5:30 PM CEST  ++++++

This morning we were notified about loss of connectivity by our in- and external monitoring.
We immediately escalated this to the highest priority and our engineers began to investigate. Here's what has happened.

At 08.55 CEST one of the components in one of our core routers crashed, losing all connectivity with our transit providers and peers. Failover to our other site immediately started, and finished at 09.05. Depending on your location and other factors this might have also impacted you when connecting to our other site.

At 09.15 the crashing router was restarted, causing traffic to shift back. This finished at 09.30.

After thorough inspection of the router we believe this crash was caused by a bug in the firmware, which only happens in very specific circumstances.
We regret what happened, so we will update the firmware shortly in a to be announced maintenance window, and take further steps to reduce the impact of incidents like this.

Have more questions? Submit a request


Article is closed for comments.