8th May 2020

Compute Nodes Network switch issue

We've identified an issue with a top-of-rack network switch in our Buffalo NY location.

This is caused an outage a few days ago and a replacement was ordered, however, the replacement has been held up by a courier issue due to COVID-19.

We're attempting to use a software patch to keep the current infrastructure working.

The patching will cause short-outages, and after there may be intermittent performance issues until the replacement switch arrives.

09:12 BST - The switch is now stable again, upon investigation, it appears the on-board flash memory which stores the firmware is failing, we've switched to the backup flash but performance does not seem correct, we will monitor this and await delivery of the replacement part.

10:26 BST 09/05/2020 - Replacement switch provisioned and services migrated.