StorageGRID 11.5 使用 AWS SDK for Java 针对零字节 S3 载入返回 HTTP 500

最后更新
另存为PDF

Views:: 24

Visibility:: Internal

Votes:: 0

Category:: storagegrid<a>2008816991</a>

Specialty:: sgrid

Last Updated:

适用场景

NetApp StorageGRID 11.5
适用于 Java 的 AWS SDK
客户端通过 HTTP 将请求发送到 StorageGRID 端口 18084
上传对象为 0 字节
Hadoop 2.6 版
Java 版本 1.7

问题描述

HTTP 500 升级StorageGRID 11.5后载入失败并出现错误。
运行命令 "hadoop distcp -m 50 /source-path s3a://bucket-name/destination-path” 以在 Hadoop 应用程序端载入出现以下错误的对象。

Caused by: org.apache.hadoop.fs.s3a.AWSS3IOException: innerMkdirs on s3a://bucketname/datapath/views/checkNumber/2020-11/testpath com.amazonaws.services.s3.model.AmazonS3Exception: We encountered an internal error. Please try again. (Service: Amazon S3; Status Code: 500; Error Code: InternalError; Request ID: 1624352367639862), Extended Request ID: null: We encountered an internal error. Please try again. (Service: Amazon S3; Status Code: 500; Error Code: InternalError; Request ID: 1624352367639862)

bycast-err.log 在StorageGRID 端显示以下错误：

MMM YY hh:mm:ss <nodename> ADE: |12345678 0123456789 S3RQ POPD YYYY-MM-DDThh:mm:ss.uuuuuu| ERROR 1878 <traceid> S3RQ: S3 request error: connection=<connectionid>, Resource=/bucket1/prefix1/object1, HTTP Status Code=500, ErrorMsg=InternalError, ErrorType=Client CustomErrorMessage={<none>}, Details={asyncPop error: no producer}

或者：

MMM YY hh:mm:ss <nodename> ADE: |12345678 0123456789 S3RQ %DED YYYY-MM-DDThh:mm:ss.uuuuuu| NOTICE 0090 <traceid> S3RQ: S3 error response: RequestId=<requestid>, TraceId=<traceid>, Resource=/bucket1/prefix1/object1, HTTP Status Code=500, ErrorMsg=InternalError, ErrorType=Client, CustomErrorMessage={<none>}, Details={unexpected error (GERR). details: ,}