FyfeWeb - Notice history

All systems operational

Notice history

Oct 2024

Essential Maintenance: Core Router Upgrade in DC1, West Midlands
Scheduled for October 22, 2024 at 10:00 PM – October 23, 2024 at 1:00 AM about 3 hours
  • Update
    October 22, 2024 at 10:00 PM
    Planned
    October 22, 2024 at 10:00 PM

    During this maintenance window, we will be performing both software and hardware upgrades to router core1-dc1, located in DC1, West Midlands.

    This maintenance requires a full power down of the device in order to install new control boards and redundant routing engines.

    Customers in this facility, which includes cPanel Web Hosting and some dedicated servers and colocation, will not experience any loss of service due to the resilient nature of our core network - but services should be considered "at-risk" during this period.

    If you have any questions, please don't hesitate to get in touch.

  • Planned
    October 08, 2024 at 3:32 PM
    Planned
    October 08, 2024 at 3:32 PM

    Update 08/10/2024:

    We have implemented an additional dark fibre connection between two of our core routers, therefore this maintenance event should be non-service impacting.

    However, the network in this facility should still be considered "at risk" during this period.

Sep 2024

No notices reported this month

Aug 2024

Network Maintenance: Reliance House
  • Completed
    August 30, 2024 at 5:00 AM
    Completed
    August 30, 2024 at 5:00 AM
    Maintenance has completed successfully
  • In progress
    August 30, 2024 at 4:00 AM
    In progress
    August 30, 2024 at 4:00 AM
    Maintenance is now in progress
  • Planned
    August 30, 2024 at 4:00 AM
    Planned
    August 30, 2024 at 4:00 AM

    In response to a minor network issue experienced late last week, we are undertaking some essential maintenance on one of our core devices in Reliance House, Newcastle.

    At 5AM (UK time) on Friday 30th August 2024, customers situated in Reliance House (Newcastle DC1) will notice a very brief period of network downtime of approximately 10 minutes (within the scheduled time) whilst we re-configure a core network device. The actual duration of downtime is expected to be much less.

    This maintenance is essential in order to proactively prevent further issues of this nature from re-occurring.

Connectivity issues at Reliance House, Newcastle.
  • Resolved
    Resolved

    We have completed the replacement and normal service has since resumed.

    Apologies for any inconvenience caused this evening.

  • Monitoring
    Monitoring

    We have identified a faulty optic within the FPC of the device, instead of swapping the whole device we're going to swap the optic and monitor from there.

  • Identified
    Update

    We are continuing to work on a fix for this incident - we're on-site and building a replacement device, there will be another brief 5 min drop when we replace the device.

  • Identified
    Identified

    We have seen a repeat of this incident - we are going to replace this device now. Only directly connected customers to this device will be impacted at the moment.

  • Resolved
    Resolved

    We haven't seen any further issues since one of our core routers rebooted unexpectedly.

    We believe the issue was related to a bug within the software running on the device, triggering an unexpected reboot.

    We will be performing further emergency maintenance in the coming days in order to ensure stability across services connected to this device.

  • Monitoring
    Monitoring

    It appears that an unexpected reboot of a core device is the cause of approximately 5 mins of downtime.

    We’re monitoring this closely and will plan maintenance imminently to ensure that further issues are prevented.

  • Investigating
    Investigating

    We are aware of a incident affecting connectivity in our Newcastle Reliance House Facility.

CP01 - cPanel Server - LiteSpeed Web Server Outage
  • Resolved
    Resolved

    This incident has been resolved. We found there was a LiteSpeed update that failed to apply automatically, causing the web server process to become "stuck" - it has now been successfully updated, so we're closing this issue off.

  • Identified
    Identified

    We have switched the web server to Apache whilst we figure out the root cause of the issue. Websites are back online, but may run slower than usual.

  • Investigating
    Investigating

    We have detected an issue with one of our cPanel servers, CP01. We're currently looking into the root cause of the issue. During this time, some customer websites may be offline.

Aug 2024 to Oct 2024

Next