大网数据广告活动
服务器运维问答

RAID level and filesystem for a large storage server

· 52CE 我爱测

This has been asked a million times but every time the answer is subject to "it depends on your requirements" condition, so I cannot extract a general guideline to apply to my case. So I ask again. I have a 24 bays disk server (d…

问题原文

原帖链接 · Nicola Mori · CC BY-SA 4.0

This has been asked a million times but every time the answer is subject to "it depends on your requirements" condition, so I cannot extract a general guideline to apply to my case. So I ask again.

I have a 24 bays disk server (dual Xeon Silver 4210R with 128 GB RAM and CentOS 7) and 16 TB disks to store scientific data, organized in large files (size ~ GB) which are typically written once and then processed many times (the output of this processing does not matter for what follows). Data is mission critical but to some extent recoverable from other storage sites, so a failure with data loss is a big issue but probably not a killer. Available disk space should be maxed within the previous constraints. To summarize, in order of decreasing importance my constraints are:

  1. data integrity
  2. read performance
  3. available disk space

My tentative solution is to use a hardware RAID 60 level with two RAID 6 arrays of 12 disks each, and the ZFS filesystem. In my poor understanding, RAID 60 should provide a more reliable and read-performant solution than RAID 6 with a reasonable loss in terms of available space, and ZFS is a good choice for a fault-tolerant filesystem. I have no clue about possible downsides of this configuration (e.g. array rebuild time? A different filesystem?) nor about possible better alternatives, so I'd like to hear some informed opinion.

Thanks in advance for any suggestion.

社区高分解答

原帖链接 · Nikita Kipriyanov · CC BY-SA 4.0

ZFS doesn't like to be on top of hardware RAID. Probably you might just use ZFS on raw disks, and configure it in raidz2 or raid60 mode. Also, probably it's good to have a replacement drive nearby, or even leave a hot spare(s) in the rack.

See the performance benchmarks here: https://calomel.org/zfs_raid_speed_capacity.html

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2021-01-15)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。