机箱风扇 FRU 故障:由于集群间 LIF 流量过大,多个风扇发生故障
适用场景
- ONTAP 9
- FAS 26xx系列
- FAS 27xx系列
问题描述
- HA 对中的一个节点报告读取温度传感器的问题,该问题已自动得到纠正:
[node1: env_mgr: monitor.fan.warning:notice]: multiple fans have failed. Replace it to avoid overheating
[node1: env_mgr: monitor.temp.unreadable:error]: The controller temperature (Module B Expander Temp) is not readable.
[node1: env_mgr: monitor.temp.unreadable:error]: The controller temperature (Module A Expander Temp) is not readable.
[node1: env_mgr: monitor.temp.unreadable:error]: The controller temperature (Midplane 4 Temp) is not readable.
[node1: env_mgr: monitor.temp.unreadable:error]: The controller temperature (Midplane 3 Temp) is not readable.
[node1: env_mgr: monitor.temp.unreadable:error]: The controller temperature (Midplane 2 Temp) is not readable.
[node1: env_mgr: monitor.temp.unreadable:error]: The controller temperature (Midplane 1 Temp) is not readable.
[node1: env_mgr: monitor.temp.unreadable:error]: The controller temperature (Ambient Temp) is not readable.
[node1: env_mgr: callhome.c.fan.fru.fault:error]: Call home for CHASSIS FAN FRU FAILED: Multiple fans have failed
[node1: env_mgr: monitor.fan.ok:notice]: All fans are OK.
[node1: env_mgr: monitor.chassisTemperature.ok:notice]: Chassis temperature is ok.
[node1: monitor: monitor.globalStatus.ok:notice]: The system's global status is normal.
- 受影响节点上的某些温度传感器不可用,而伙伴节点则将其报告为正常。
cluster1::> system node run -node * -command environment status
2 entries were acted on.
Node: node1
Shelf temperatures by element:
[10] 28 C (82 F) Normal temperature range
[11] Unavailable
[12] Unavailable
[13] 29 C (84 F) Normal temperature range
Node: node2
Shelf temperatures by element:
[10] 33 C (91 F) Normal temperature range
[11] 48 C (118 F) Normal temperature range
[12] 26 C (78 F) Normal temperature range
[13] 34 C (93 F) Normal temperature range
- 当问题仍然存在但仅来自一个节点时,FRU 状态会显示为降级:
cluster1::> system controller fru show
Node FRU Name Subsystem Status
------------------ ---------------------------- ------------------ -----------
node1 PSU1 FRU Environment degraded
node1 PSU2 FRU Environment degraded
node2 PSU1 FRU Environment ok
node2 PSU2 FRU Environment ok
- 受影响节点的 BMC 频繁重启并在 SP 事件日志中报告以下内容:
Record 1250: Sat Jan 28 10:04:27.990616 2023 [BMC.critical]: Rebooting SP due to loss of ACP comms
Record 1251: Sun Jan 01 00:00:23.962645 2017 [IPMI.notice]: 00fd | c0 | OEM: ffff70005100 | ManufId: 150300 | BMC Reset Internally
- 问题发生期间对端口 e0M 进行的数据包跟踪分析显示来自集群间逻辑接口 (IC LIF) 的传入流量很高。