Notice history

Feb 2024

Network Issue - West Midlands DC2
  • Resolved
    Resolved

    This incident is now resolved and the wavelengths in question have been reintroduced to our network.

  • Monitoring
    Update

    Service has remained stable for some time. Initial investigations indicate an issue with 2 wavelengths from Wolverhampton to London, causing a number of protocols to flap, interrupting traffic. We took action to disable those wavelengths which stabilised traffic. We will be reintroducing those wavelengths during a planned window late one evening to be able to monitor traffic as they're reintroduced.

  • Monitoring
    Monitoring

    After around 5 minutes of service interruption in total, we are seeing services return to normal. Please raise a ticket if you're experiencing any issues.

  • Identified
    Identified

    We are still seeing services flap, this has been raised to director-level with the upstream provider.

    They have confirmed they're currently investigating the root cause of the incident.

  • Investigating
    Investigating

    We're currently investigating an issue with packet loss in one of our data centres. At the moment, this appears to be isolated to an issue with an upstream provider and not on our network. We'll keep this incident updated throughout.

    This will cause issues with some VPS services, as well as some customer dedicated servers and colocation.

Jan 2024

Network Issues - Stellium
  • Resolved
    Resolved

    We've seen no further drops - this incident has been resolved.

  • Monitoring
    Update

    To summerise, a change was done on one of the core backbone links at Stellium, there was an issue with this, and the change was rolled back. The change has since been reimplemented successfully.

    This is related to the installation of a new 100Gb wavelength between London and Newcastle.

    We'll keep this incident open overnight, and will confirm closure tomorrow morning - however it seems like the issue should not re-occur.

  • Monitoring
    Monitoring

    We've spoken to the carrier we use for our circuits back to London and they're currently aware of an issue on their network. However, service resumed after around 10 minutes of disruption. We're currently speaking to their engineers to find out what's happened.

  • Investigating
    Investigating

    We are currently experiencing a network issue affecting our PoP at Stellium in Newcastle, due to an issue with backhaul to London. Our team is actively investigating the situation, and further updates will follow as we work to resolve the issue with them.

    Details:

    Location: Stellium Data Centre, Newcastle
    Issue: Network disruption
    Cause: Backhaul connectivity issue

    Please be aware that during this time, services at this site may have intermittent connectivity problems. We apologise for any inconvenience and appreciate your patience as we work to fix the issue.

    Thank you for your understanding.

Dec 2023 to Feb 2024