大网数据广告活动
服务器运维问答

How can I move s3 objects >5gb from one bucket to another?

· 52CE 我爱测

Objects larger than 5GB are supported with multi-part uploading. We have 5gb+ files in one bucket already that I'd like to move to another, under the same AWS account. When I issue the command using s3cmd: s3cmd mv s3://BUCKET1/O…

问题原文

原帖链接 · Ben Keating · CC BY-SA 3.0

Objects larger than 5GB are supported with multi-part uploading. We have 5gb+ files in one bucket already that I'd like to move to another, under the same AWS account. When I issue the command using s3cmd:

s3cmd mv s3://BUCKET1/OBJECT1 s3://BUCKET2[/OBJECT2]

I comes back with the error:

ERROR: S3 error: 400 (InvalidRequest): The specified copy source is larger than the maximum allowable size for a copy source: 5368709120

If it's at all possible, I presume it will not be able to be moved over without extra bandwidth/cost. Even so, I'm trying to figure out if you can move large files in some sort of multi-part method.

社区高分解答

原帖链接 · emmdee · CC BY-SA 3.0

Currently, what you're trying to do can't be done in a single operation. Move in S3cmd to the API is essentially a copy and delete all in one and it's a restriction of the copy operation.

http://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectCOPY.html

You can store individual objects of up to 5 TB in Amazon S3. You create a copy of your object up to 5 GB in size in a single atomic operation using this API. However, for copying an object greater than 5 GB, you must use the multipart upload Upload Part - Copy API

http://docs.aws.amazon.com/AmazonS3/latest/dev/CopyingObjctsMPUapi.html

The examples in this section show you how to copy objects greater than 5 GB using the multipart upload API. You can copy objects less than 5 GB in a single operation.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2013-04-03)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。