rt-qfx10k-fkt is up since 12:48, 14.10.2024.
The device was connected to the same power circuit. Equinix plugged in all four power cords back in June, but the technician didn't notice that the device
was connected to the same power circuit.
We requested Equinix to plug the rt-qfx10k-fkt in to both power feeds. Power is now evenly being spread between both circuits.
The high temperature alerts started at 11:25 CEST on 14.10.2024, indicating that there was a mechanical disturbance.
This has been confirmed by Equinix:
The IBX has experienced a Mechanical Disturbance and IBX personnel are currently investigating the issue.
Service Offering: FR7 - Mechanical - Cooling Zone
Affected Assets: 01:2:Z13:Z13, 01:2:Z16:Z16, 0G:3:Z17:Z17, 0G:3:Z17:Z19, 0G:3:Z18:Z18
Asset Condition: Failed to operate
Current system redundancy: TBD
Situation status: Under investigation
Resources on site/pending: N/A
Generator fuel run time (hrs): TBD
Current colo humidity RH status: TBD
Current colo temperature status: Temperature increasing, outside SLA
This increase in temperature caused all devices to spin up their fans to 100% and tripped the breaker on the circuit where rt-qfx10k-fkt was connected.
This cooling issue is not the first one we've seen. The first major incident was back in February. However, this is the first time we actually had an impact on our services.