大网数据广告活动
服务器运维问答

Optimal RAID 6+0 Setup for 40+ 4TB Disks

· 52CE 我爱测

I am setting up a JBOD containing 44 4TB 7200 RPM SAS HDs. I chose RAID 60 as I prefer drive failure protection over the performance improvements offered by RAID 10. My issue is how to choose the optimal disks per span that would…

问题原文

原帖链接 · Vince · CC BY-SA 3.0

I am setting up a JBOD containing 44 4TB 7200 RPM SAS HDs. I chose RAID 60 as I prefer drive failure protection over the performance improvements offered by RAID 10. My issue is how to choose the optimal disks per span that would results in a reasonable rebuild time. For example, assuming I leave 4 hot-spares, this results in 40 disks for the following possible RAID setups:

  • 2 spans with 20 disks, ~144 TB usable capacity.
  • 4 spans with 10 disks, ~128 TB usable capacity.
  • 5 spans with 8 disks, ~120 TB usable capacity.
  • 8 spans with 5 disks, ~96 TB usable capacity.

I am leaning towards 4 spans of 10 disks as it seems to offer best balance of fault-tolerance (2 of 10 drive failures per span tolerated) and usable capacity (80%, down from 90% for 2 spans of 20 disks).

However, what can I expect rebuild time to be for a single 10 disk span? Web search reveals that even a 10 disk span might not be feasible as rebuild may take too long, thus risks additional drive failure during rebuild. However, many resources on the internet are based on fewer disks or lower capacity disks.

Any thoughts as to what is the optimal setup for this relatively large number of disks?

NOTE: There is backup policy for about 10 TB of data, but not feasible to backup all data. Hence my leaning towards RAID 60 over RAID10. I realize this is not a substitute for backup, but better recovery from drive failure does make system more robust by providing opportunity to rebuild then migrate data to other storage should multiple disk failures occur.

EDIT: Specifications:

  • Disks: Seagate 4TB SAS 3.5" HDD 7200 RPM, enterprise grade.
  • Controller: ServerRAID M5016 controller, including RAID6 enabled, LSI2208 chipset. See: https://www.broadcom.com/products/storage/raid-on-chip/sas-2208.
  • Enclosure: Supermicro 4U storage JBOD 45x3.5 with 2x1400W redundant power modules.
  • OS: CentOS Linux release 7.1.1503 (Core).

Thank you for the help.

已采纳解答

原帖链接 · wazoox · CC BY-SA 3.0

With modern hardware RAID controllers from Avago (LSI) or Microsemi (Adaptec), 20+2 disks RAID arrays are perfectly fine. The rebuild time is reasonable (less than 24 hours). Current drives have very low failure rates, anyway. I'd definitely use 2 spans.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2017-12-08)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。