大网数据广告活动
服务器运维问答

Duplicity backup is unexpectedly slow

· 52CE 我爱测

I have a home cloud server whose data directory contains about 400GB of data. I've tried to do a full duplicity backup on the directory. It's been running for 17 hours and only about 19 GB of data (compared to the 368 GB of the p…

问题原文

原帖链接 · maxbc · CC BY-SA 4.0

I have a home cloud server whose data directory contains about 400GB of data.

I've tried to do a full duplicity backup on the directory. It's been running for 17 hours and only about 19 GB of data (compared to the 368 GB of the previous backup) have been generated. That's a speed of about 310 KB / s (!)

Server :

  • cheap tower from a few years ago
  • Debian 9
  • duplicity from packets (0.7.11)
  • Intel J4205 @1.5Ghz, 1MB cache
  • cheap hard drive but still capable of 50+ MB/s

Backup destination :

  • Synology disk station, also capable of 50+ MB/s (much more as a matter of fact)
  • connected via ethernet (in fact, I can test a file copy independently which runs generally around 100MB/s)
  • A backup passphrase is used, but encryption parameters are kept to default

The CPU seems stuck at 100% on a single duplicity process.

Is this expected? I can understand that my hardware is cheap and a bit old, but is it supposed to be SO slow? I would ideally like a speedup of at least 40-100x by upgrading, how can I even be sure that I can obtain this kind of performance improvement, and what should I even aim for?

PS: it seems that duplicity uses gnuPG which by default uses SHA-256. Still, if it's so slow on a 2016 CPU, it means that you can't even browse the web on this PC?

已采纳解答

原帖链接 · maxbc · CC BY-SA 4.0

I replaced duplicity with duplicacy which does the job orders of magnitudes faster (although archives are not compatible).

It can be installed from github. Instructions for the CLI version are here.

There is also another web version which I have not used (it's not free apparently, only the CLI version is free, and only for individuals).

I have no logs from full backups, but performance is quite good at ~5-50MB/s which is consistent with disk and CPU encryption performance.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2021-06-03)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。