System operational
Maintenance
Partial decomission and migration of RT-QFX10K-FKT

Starting early August, we'll begin with the migration of RT-QFX10K-FKT(QFX10008) at Equinix FR7.

The migration will happen in multiple stages; We'll migrate transit and peering ports over the course of a few weeks.

RT-PTX10K-FKT3 will be the replacement for RT-QFX10K-FKT.

FKT3 is our new PoP at Equinix FR5.

FR5 features better a lower ambient temperature and easier shipment/delivery handling.

We'll also deploy a new core router stack at Equinix FR5. Both RT-PTX10K-FKT3(Equinix FR5) and RT-QFX10K-FKT2(Equinix FR8) will be connected to this new stack.

This will increase the redundancy for almost all customers since L3 interfaces and BGP sessions will be terminated on rt-qfx5k-fkt3.

We will no longer terminate new customer BGP sessions on our edge routers.

We will notify all customers affected by the migration at least two weeks in advance.

Partial decomission and migration FR7 PoP

Starting August 31st, 2025, we will begin the decommissioning of our Equinix FR7 PoP. The migration is expected to be completed by the end of the year.

FR7 is currently limited in terms of available power, and ongoing rack availability has become a challenge. In contrast, FR5 offers a lower ambient temperature and significantly improved logistics for equipment deliveries.

Equinix increases prices across all services by 5% annually. Until now, we have absorbed these increases and not passed them on to our customers. However, due to the current power constraints at FR7, a price adjustment is expected by the end of this year.

To ensure long-term service stability and continued growth, we’ve made the decision to move operations to Equinix FR5.

We understand that this change may come unexpectedly for some customers. Customers using L3-only services, including colocation customers using BGP only, will be migrated to Equinix FR5 (FKT3) by September 2025.

The following racks will be migrated as part of this process:

  • Rack 0328

  • Rack 1602

  • Rack 0702

We will notify all customers affected by the migration at least two weeks in advance.

Past Incidents

19th October 2024

No incidents reported

18th October 2024

No incidents reported

17th October 2024

No incidents reported

16th October 2024

No incidents reported

15th October 2024

No incidents reported

14th October 2024

Outage, unknown

We are aware of an outage at Equinix FR7, technicians are checking

  • rt-qfx10k-fkt is up since 12:48, 14.10.2024.

    The device was connected to the same power circuit. Equinix plugged in all four power cords back in June, but the technician didn't notice that the device was connected to the same power circuit.

    We requested Equinix to plug the rt-qfx10k-fkt in to both power feeds. Power is now evenly being spread between both circuits.

    The high temperature alerts started at 11:25 CEST on 14.10.2024, indicating that there was a mechanical disturbance.

    This has been confirmed by Equinix:

    The IBX has experienced a Mechanical Disturbance and IBX personnel are currently investigating the issue. Service Offering: FR7 - Mechanical - Cooling Zone Affected Assets: 01:2:Z13:Z13, 01:2:Z16:Z16, 0G:3:Z17:Z17, 0G:3:Z17:Z19, 0G:3:Z18:Z18 Asset Condition: Failed to operate Current system redundancy: TBD Situation status: Under investigation Resources on site/pending: N/A Generator fuel run time (hrs): TBD Current colo humidity RH status: TBD Current colo temperature status: Temperature increasing, outside SLA

    This increase in temperature caused all devices to spin up their fans to 100% and tripped the breaker on the circuit where rt-qfx10k-fkt was connected.

    This cooling issue is not the first one we've seen. The first major incident was back in February. However, this is the first time we actually had an impact on our services.

  • It seems like this incident might be related to Equinix.

    Shortly before the outage, we received a lot of temperature warning alerts and we were about to open a ticket with Equinix.

    We are still waiting for them to check if this incident is related.

  • 13th October 2024

    No incidents reported