大网数据广告活动
Linux 与通用命令

vllm · 常用命令示例

· 52CE 我爱测

Serve large language models efficiently and interact with them through an OpenAI-compatible API. > More information: <https://docs.vllm.ai/en/latest/getting_started/quickstart.html>.

vllm

Serve large language models efficiently and interact with them through an OpenAI-compatible API. More information: https://docs.vllm.ai/en/latest/getting_started/quickstart.html.

  • Launch an OpenAI-compatible API server for a model:

vllm serve

  • Serve a model on a specific host and port:

vllm serve --host --port

  • Start an interactive chat session:

vllm chat

  • Run batch prompts from a file and write results to a file:

vllm run-batch -i -o --model

  • Print environment information for bug reports:

vllm collect-env

  • List all available subcommands:

vllm --help

来源:tldr-pages contributors · 作者与贡献记录 · CC BY 4.0。离线整理了版式、链接和媒体显示。

资料来源与适用范围

资料来源
tldr-pages contributors
适用范围
请按文中版本与环境说明核对
内容语言
中文;命令、路径和错误标识保留技术原文
本地收录日期
2026-11-15
授权说明
CC BY 4.0

正文与所需资源由本站本地存储。查看来源及更新记录 ↗

请按适用版本和实际日志确认原因;本站没有对每一种系统或设备逐项执行文中的操作。