大网数据广告活动
服务器运维问答

bonding-rr vs single 10G for NFS NAS - pros and cons?

· 52CE 我爱测

I'm standing before choice of NICs and switch for storage server and virtualization hosts and I can't decide between 10G and quad gigabit with bonding-rr. 10G is noticeably more expensive solution and we don't really need 10G, 4G…

问题原文

原帖链接 · Lapsio · CC BY-SA 3.0

I'm standing before choice of NICs and switch for storage server and virtualization hosts and I can't decide between 10G and quad gigabit with bonding-rr. 10G is noticeably more expensive solution and we don't really need 10G, 4G is definitely enough...

However I'm a bit worried about how NFS scales with bonding-rr. Did anyone use NFS with such setup? Is it viable alternative to single higher bandwidth link? I'm aware of some good practices for this kind of bonding (4 separate vlans for each set of links to reduce collisions) and I took a look at some stories describing such setups in production but they typically compare it to theoretical bandwidth or single gigabit performance - not 10G.

Does anyone know some other topics and issues I should take into consideration with mentioned options?

已采纳解答

原帖链接 · Spooler · CC BY-SA 3.0

You definitely should not consider balance-rr as a bonding mode for anything other than direct point-to-point links for a single protocol to go over. The primary issue with balance-rr is that you'll get excessive jitter and out-of-order delivery, which is pretty damning for services like NFS and CIFS. Even with a point-to-point topology and one protocol, bonding the maximum supported amount of 1G links in balance-rr won't be anywhere near as reliable as a single 10G link. balance-rr is a desperate last-resort kludge for more bandwidth in a limited system.

LACP will balance connections well, but is only effective for multiple endpoints. This isn't an issue for most file and block servers, since those are typically deployed for the purpose of providing storage to multiple endpoints. Most switches max out at 8 port LACP bonds, and balancing traffic over 8 ports is far from perfect.

10G Ethernet is fairly expensive to transition to. Have you looked at 10G or 40G infiniband? It's worlds cheaper, you can run all your hosts along a homogeneous redundant fabric, and you get built in RDMA.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2018-03-08)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。