大网数据广告活动
服务器运维问答

nfs server getting many rpc-srv/tcp: nfsd: sent only 700260 when sending 1048708 bytes - shutting down socket

· 52CE 我爱测

System is running CentOS 7.3, serving files over both ethernet and infiniband, but the vast majority of traffic is over infiniband I just stood up a new file server that is now generating large numbers of the following error: [20…

问题原文

原帖链接 · MrBooks · CC BY-SA 3.0

System is running CentOS 7.3, serving files over both ethernet and infiniband, but the vast majority of traffic is over infiniband

I just stood up a new file server that is now generating large numbers of the following error:

[2007827.701033] rpc-srv/tcp: nfsd: sent only 618872 when sending 1048708 bytes - shutting down socket
[2007835.313884] rpc-srv/tcp: nfsd: sent only 75908 when sending 1048708 bytes - shutting down socket

I increased the tcp_rmem and wmem to a max of 32mb, but the problem persists

net.ipv4.tcp_rmem = 4096 87380 33554432 
net.ipv4.tcp_wmem = 4096 65536 33554432

Are there any other ways I could tune this to get around the issue?

社区高分解答

原帖链接 · Davide · CC BY-SA 3.0

This site reports some more suggestions, including increasing the NIC txqueuelen. These suggestions are mainly aimed at high latency networks, however I noticed that under Fedora24 Infiniband interfaces get by default a lower txqueuelen value (256) than other interfaces (1000), so the txquelen suggestion, besides the others, may also make sense in this case.

The modern way to do so is actually:

ip link set ib0 txqueuelen 10000

After following the suggestions on the indicated page, nfs-on-Infiniband errors of the type you reported have ceased in my nfs server.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2017-10-26)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 3.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。