FyfeWeb - Notice history

Notice history

Aug 2024

Connectivity issues at Reliance House, Newcastle.
  • Resolved
    Resolved

    We have completed the replacement and normal service has since resumed.

    Apologies for any inconvenience caused this evening.

  • Monitoring
    Monitoring

    We have identified a faulty optic within the FPC of the device, instead of swapping the whole device we're going to swap the optic and monitor from there.

  • Update
    Update

    We are continuing to work on a fix for this incident - we're on-site and building a replacement device, there will be another brief 5 min drop when we replace the device.

  • Identified
    Identified

    We have seen a repeat of this incident - we are going to replace this device now. Only directly connected customers to this device will be impacted at the moment.

  • Resolved
    Resolved

    We haven't seen any further issues since one of our core routers rebooted unexpectedly.

    We believe the issue was related to a bug within the software running on the device, triggering an unexpected reboot.

    We will be performing further emergency maintenance in the coming days in order to ensure stability across services connected to this device.

  • Monitoring
    Monitoring

    It appears that an unexpected reboot of a core device is the cause of approximately 5 mins of downtime.

    We’re monitoring this closely and will plan maintenance imminently to ensure that further issues are prevented.

  • Investigating
    Investigating

    We are aware of a incident affecting connectivity in our Newcastle Reliance House Facility.

Jul 2024

Plesk Hosting Migrations
  • Completed
    July 31, 2024 at 5:00 PM
    Completed
    July 31, 2024 at 5:00 PM
    Maintenance has completed successfully
  • In progress
    July 30, 2024 at 5:00 PM
    In progress
    July 30, 2024 at 5:00 PM
    Maintenance is now in progress
  • Planned
    July 30, 2024 at 5:00 PM
    Planned
    July 30, 2024 at 5:00 PM

    Over the next few days, we will be migrating customers from some of our Plesk servers to our new whitelabel Plesk reseller hosting platform.

    Customers on our existing CentOS Plesk servers will be moved to various new servers running CloudLinux, which delivers the very best security, reliability and performance. The new servers also feature newer hardware, such as newer CPUs, better SSDs and the latest generation memory.

    The new servers will be located on our websiteserver.uk domain as opposed to our own, which is great for resellers of the service.

    We will reach out to affected customers via email with the new server IP addresses, and new nameservers if they wish to use those, as well as a time we'll be carrying out the migration work.

    Customers should not need to do anything during and after the migration if you use our existing Plesk nameservers, your website will seamlessly point to the new servers without requiring any action.

Network Edge - Rack Move - Equinix LD8, London
  • Completed
    July 14, 2024 at 2:56 AM
    Completed
    July 14, 2024 at 2:56 AM

    All services are back up and running.

  • Update
    July 14, 2024 at 1:50 AM
    In progress
    July 14, 2024 at 1:50 AM

    Our cross connects have been re-patched and the ports are now online. We're still finishing some final works, however the data centres are now back online. Thank you for your patience so far.

  • Update
    July 14, 2024 at 1:33 AM
    In progress
    July 14, 2024 at 1:33 AM

    We have now moved the equipment to the new rack. Devices are booting up, and we will begin to re-patch our cross connects.

  • Update
    July 14, 2024 at 12:04 AM
    In progress
    July 14, 2024 at 12:04 AM

    We are beginning to move the equipment within this rack. Service disruption will occur imminently.

  • In progress
    July 14, 2024 at 12:00 AM
    In progress
    July 14, 2024 at 12:00 AM
    Maintenance is now in progress
  • Update
    July 14, 2024 at 12:00 AM
    Planned
    July 14, 2024 at 12:00 AM

    At FyfeWeb, we're always looking at ways in which we can improve our services and network infrastructure. That's why on Sunday 14th July at around 1 AM, we'll be moving into a brand new cabinet in Equinix LD8. The reasons for the move are to improve service availability, add additional redundancy into the network and also have higher power density within this particular data centre for future upgrades we have planned.

    This is a very rare event, the last time we moved some of our edge network infrastructure was in 2020, around four years ago now (interestingly enough, also in June!) so we're not expecting anything like this to happen in the near future anyway.

    This will cause service disruption in the following data centres for around one hour, which is why we're doing the work after midnight:

    • Equinix LD8, London

    • Stellium, Newcastle upon Tyne

    • Reliance House, Newcastle upon Tyne

    We'll be working late into the night to ensure all work gets completed as quickly as possible, and to ensure minimum disruption to your services.

    This work will predominantly effect customer dedicated servers and colocation services. Our VPS and cPanel hosting will not be affected.

    We're also giving over one months notice to ensure you're aware of the scope of work being carried out. Please do get in touch if you have any further questions.

    Kind regards,

    Jaden

  • Planned
    June 26, 2024 at 11:20 AM
    Planned
    June 26, 2024 at 11:20 AM

    Due to engineer availability at Equinix, we have had to postpone this maintenance and change it to Sunday 14th July at around 1 AM.

    We apologise for any inconvenience caused by this.

    Please contact us should you have any further questions.

Jun 2024

Network Interruption - West Midlands DC1
  • Resolved
    Resolved

    Services have remained stable since the previous update.

    Separate to this incident, this router is due to be upgraded with newer routing-engines. This work will now be prioritised and will be scheduled as a new maintenance window, to be announced in due course.

  • Update
    Update

    Root Cause Analysis

    We identified an issue with the primary routing-engine in core1-dc1, the core router in DC1.

    We have manually switched mastership to the backup routing-engine without graceful-switchover which has caused all protocols to flap and re-converge on this router.

    Services have now recovered and the router is stable, however if you are still experiencing issues please get in touch.

  • Monitoring
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Update
    Update

    We are still investigating the incident - the issue appears to be related to connectivity with an upstream provider within this facility from our core router. We are currently in contact with the provider in question. There is no ETA at this time, but we're trying to get this resovled as quickly as possible.

  • Investigating
    Investigating

    We are currently investigating a network issue in our West Midlands data centre - this is causing issues with some managed dedicated servers, colocation and cPanel Web Hosting.

Jun 2024 to Aug 2024

Next