大网数据广告活动
服务器运维问答

Query peak GPU memory used by finished job

· 52CE 我爱测

I have a SLURM job I submit with sbatch , such as sbatch --gres gpu:Tesla-V100:1 job.sh job.sh trains a model on a V100 GPU. The code itself does not log GPU memory usage. Is there a SLURM command to query peak GPU memory usage o…

问题原文

原帖链接 · Mathias Müller · CC BY-SA 4.0

I have a SLURM job I submit with sbatch, such as

sbatch --gres gpu:Tesla-V100:1 job.sh

job.sh trains a model on a V100 GPU. The code itself does not log GPU memory usage.

Is there a SLURM command to query peak GPU memory usage once the job is finished?

已采纳解答

原帖链接 · Mathias Müller · CC BY-SA 4.0

After talking to staff from our HPC team: it seems that

SLURM does not log GPU memory usage of running jobs submitted with sbatch.

Hence, this information cannot be recovered with any SLURM command. For instance, a command like

ssacct -j [job id]

does show general memory usage, but not GPU memory usage.

摘自公开归档,保留原文语言,版式经整理,外部媒体与邮箱地址已移除。

资料来源与适用范围

资料来源
Server Fault
适用范围
以原帖系统、软件版本与发布日期为准(2020-03-11)
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY-SA 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。