将文件从NFS复制到S3时、Cloud Sync 失败、并出现多个错误
适用场景
- Cloud Sync
- AWS S3
问题描述
- 在从NFS复制到S3时、Cloud Sync 无法复制多个文件。
- 数据代理会报告多个错误、例如
"TimeoutError: socket hang up" , "Error: write EPIPE", "RequestTimeout:"
[WARN] [TRANSFERRER] [1361] [32677] [64137xxxxxxxxxx] RETRYING copy from: {"local":{"path":"mnt/64137xxxxxxxxx/test_src/test1/folder1"}} to: {"s3":{"bucket":"test-input","tags":[],"provider":"s3","storageClass":"STANDARD","region":"eu-xx-1","path":"test1/folder1"}} entry: {"path":"test0_test2","type":"FILE","size":1165827801088,"mode":33184,"uid":207,"gid":205,"mtimeSec":1677791421,"creationTimeSec":1677791421,"inode":955xxxx} TimeoutError: socket hang up
[WARN] [TRANSFERRER] [1361] [32677] [64137xxxxxxxxx] RETRYING copy from: {"local":{"path":"mnt/64137xxxxxxxxx/test_src/test1/folder1"}} to: {"s3":{"bucket":"test-input","tags":[],"provider":"s3","storageClass":"STANDARD","region":"eu-xx-1","path":"test1/folder1"}} entry: {"path":"test0_test2","type":"FILE","size":1221348679680,"mode":33184,"uid":207,"gid":205,"mtimeSec":1677792320,"creationTimeSec":1677792320,"inode":955xxxxx} Error: write EPIPE
[WARN] [TRANSFERRER] [1362] [1968] [64137xxxxxxxxx] RETRYING copy from: {"local":{"path":"mnt/64137xxxxxxxxx/test_src/test1/folder1"}} to: {"s3":{"bucket":"test-input","tags":[],"provider":"s3","storageClass":"STANDARD","region":"eu-xx-1","path":"test1/folder1"}} entry: {"path":"test0_test2","type":"FILE","size":1181281681408,"mode":33184,"uid":207,"gid":205,"mtimeSec":1677792475,"creationTimeSec":1677792475,"inode":955xxxxx} RequestTimeout: Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.