跳转到主内容

由于可写节点不足,StorageGRID EC Rebalance 立即失败

Views:
12
Visibility:
Public
Votes:
0
Category:
storagegrid
Specialty:
sgrid
Last Updated:

适用于

  • NetApp StorageGRID
  • 纠删码 (EC) 重新平衡流程

问题

  • EC 重新平衡程序在开始新作业或重新启动作业后立即失败,且未尝试任何移动:
    • rebalance-data status   
      ========================
      JobID: 1234567890     
      Site: SiteName      
      State: Failure      
      Planned Moves: 0     
      Completed Moves: 0    
      Failed Moves: 0      
      Site Imbalance: Unknown 
      Retry Rebalance: Yes   
      ========================
  • 从主管理节点/var/local/log/rebalance-data.log记录未找到用于 EC 修复的作业:

    D, [2026-04-29T12:31:32.611561 #4050370] DEBUG -- : No jobs found for replicated repair for the given parameters {"alert_for_node_repair"=>false, "include_node_repair"=>true, "repair"=>["replicated", "erasure-coded"], "state"=>"running"}
    D, [2026-04-29T12:31:32.634167 #4050370] DEBUG -- : No jobs found for erasure-coded repair for the given parameters {"alert_for_node_repair"=>false, "include_node_repair"=>true, "repair"=>["replicated", "erasure-coded"], "state"=>"running"}
    I, [2026-04-29T12:31:32.723691 #4050370]  INFO -- : EC Site rebalance is restarted successfully.

  • 从EC Job Leader存储节点/var/local/log/bycast.log记录用尽重试限制: 

    Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM ???? 2026-04-29T12:28:44.205607| NOTICE   0040 ECJM: Starting job 1234567890: Site Rebalance - Group ID 20.
    Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:44.231500| NOTICE   0234 ECJM: 1234567890(rebalance 20): Retrying
    Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:44.231579| NOTICE   1283 ECJM: 1234567890(rebalance 20): saving state. status: JOBSTATUS_IN_PROGRESS
    Apr 29 12:28:44 nodename ADE: |21014662 1884999497 ECJM EVIU 2026-04-29T12:28:44.254866| NOTICE   0281 ECJM: 1234567890(rebalance 20): Already have 0 recommendations, asking for a further 200...
    Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM EVIU 2026-04-29T12:28:46.179064| NOTICE   0295 ECJM: 1234567890(rebalance 20): received message GVCR
    Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM EVIU 2026-04-29T12:28:46.179083| WARNING  0300 ECJM: 1234567890(rebalance 20): Got error SUNV while trying to retrieve VCS moves. Retrying.
    Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM GVCR 2026-04-29T12:28:46.179112| NOTICE   1283 ECJM: 1234567890(rebalance 20): saving state. status: JOBSTATUS_PAUSED
    Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:46.270051| WARNING  0062 ECJM: Caught exception 'ENFORCE failed: !"Exhausted retry limit or retry time for getting move recommendations"' when running job 1234567890: Site Rebalance - Group ID 20.
    Apr 29 12:28:46 nodename ADE: |21014662 1884999497 ECJM ^RDY 2026-04-29T12:28:46.292765| ERROR   1125 PROC: Exception: /build/src/modules/ErasureCoding/EC_JobManager_Module/SiteRebalanceJob.cc(382): Throw in function getMoveRecommendations#012Dynamic exception type: boost::wrapexcept<std::runtime_error>#012std::exception::what: ENFORCE failed: !"Exhausted retry limit or retry time for getting move recommendations"#012

  • 某些存储节点处于只读状态。
  • ILM placement unachievable 警报也可能存在。

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.