FabricPool 对象存储不可用,因为 StorageGRID 返回 HTTP 503
适用场景
- StorageGRID
- ONTAP 9
- StorageGRID 对象存储已配置为 FabricPool 的云层
问题描述
storage aggregate object-store showcommand 表示对象发生unavailable的原因Service unavailable
::> storage aggregate object-store show -instance
Aggregate Name: <AGGREGATE>
ONTAP Name for this Object Store Config: <OBJECT_STORE_NAME>
UUID of the Bin: <UUID>
Bin Number: <NUMBER>
Availability of the Object Store: unavailable
Reason why Object Store is Unavailable: Service unavailable
..
bycast.log的存储节点显示 StorageGRID 返回HTTP response 503/Service Unavailable到HEAD来自 ONTAP 的请求
NOTICE 1017 HFCS: Connection 1642485000071011/<STORAGEGRID_IP>:41438 (---------): Accepted HTTPS session, starting handshake
NOTICE 1032 HFCS: Connection 1642485000071011/<STORAGEGRID_IP>:41438 (---------): Completed HTTPS handshake, starting HTSM
NOTICE 1122 HFCS: Connection 1642485000071011/<STORAGEGRID_IP>:41438 (---------): Started HTSM process {2748379911@12451996}!
NOTICE 1125 HFCS: Connection 1642485000071011/<STORAGEGRID_IP>:41438 (---------): Starting async operations
WARNING 0863 HTSM: Connection 1642485000071011/<STORAGEGRID_IP> HEAD /<ONTAP_CLUSTER>/ (child: -/-, -K-----): X-Forwarded-For: '<IP>', Sending HTTP response 503/Service Unavailable - <none>
NOTICE 0595 HTSM: Connection 1642485000071011/<STORAGEGRID_IP> HEAD /<ONTAP_CLUSTER>/ (child: -/-, -KF--pP): Shutting down (from {2748379911@12451996})
NOTICE 0638 HTSM: Connection 1642485000071011/<STORAGEGRID_IP> HEAD /<ONTAP_CLUSTER>/ (child: -/-, --FS-pP): Delaying shutdown - still processing data from network
NOTICE 0638 HTSM: Connection 1642485000071011/<STORAGEGRID_IP> HEAD /<ONTAP_CLUSTER>/ (child: -/-, --FSCp-): Delaying shutdown - still processing data from network
NOTICE 1293 HFCS: Connection 1642485000071011/<STORAGEGRID_IP>:41438 (R--------): write closing: end of stream
NOTICE 1401 HFCS: Connection 1642485000071011/<STORAGEGRID_IP>:41438 (----CC---): Closing: read: stream truncated
NOTICE 0706 HTSM: Connection 1642485000071011/<STORAGEGRID_IP> HEAD /<ONTAP_CLUSTER>/ (child: -/-, --FSC--): Network read error: end of stream
NOTICE 0189 HTSM: Connection 1642485000071011: Session destroyed: ERRC
- Active IQ Unified Manager 检测
External Capacity Tier Unreachable事件
- ONTAP 和 StorageGRID 之间没有网络错误
- 所有服务均已在 StorageGRID 中启动并运行