大网数据广告活动
服务器运维问答

Keeping a delta sync between Azure Storage blob containers

· 52CE 我爱测

I have three different Azure Storage blob containers that are used to serve website content, one for production, one for staging and one for development. My goal is to sync staging and development on a daily or weekly basis so th…

问题原文

原帖链接 · Kevin Denham · CC BY-SA 3.0

I have three different Azure Storage blob containers that are used to serve website content, one for production, one for staging and one for development.

My goal is to sync staging and development on a daily or weekly basis so they match production.

I put together something in PowerShell that works in principal but it's slow and heavy handed. It involves deleting the staging and dev containers, then copying the entire production container twice. For just 20k items, this whole process takes over an hour.

Considering only a couple hundred items may change in a week, a delta operation would likely be done much faster.

Has anyone seen a tool or method that can do a delta copy between Azure Storage blob containers? I'll likely end up writing my own tool but wanted to see if there are any out there currently.

已采纳解答

原帖链接 · Kevin Denham · CC BY-SA 4.0

I revisited the AzCopy tool today and found it's come quite a long way and serves this purpose perfectly. The flag is AzCopy Sync and there are a number of control options as well, such as deleting destination files which don't exist on the target.

Probably due to improvements in the Azure architecture or infrastructure, this transfer is also incredibly fast. It did an initial sync of 10GB in less than 60 seconds. Previously this would take an hour or more.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2018-02-12)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0 / CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。