llama-cli
Command-line interface for LLM inference. More information: https://github.com/ggml-org/llama.cpp#llama-cli.
- Start up LLM [m]odel and interface:
llama-cli
- Start with setup prompt [c]ontext size:
llama-cli
- Start with set offload [n]umber of layer [g]pu [l]ayers:
llama-cli
- Start with sending content as [sys]tem prompt from a [f]ile:
llama-cli
- Start with sending content in [f]ile as first prompt:
llama-cli
来源:tldr-pages contributors · 作者与贡献记录 · CC BY 4.0。离线整理了版式、链接和媒体显示。
