koboldcpp
An AI text-generation application for GGML and GGUF models. More information: https://github.com/LostRuins/koboldcpp/wiki#command-line-arguments-reference.
- Load one or more model files:
koboldcpp
- Set port to listen on (defaults to 5001):
koboldcpp --port
- Set amount of threads to use:
koboldcpp
- Launch web browser when boot is complete:
koboldcpp --launch
- Start without the GUI launcher:
koboldcpp --skiplauncher
来源:tldr-pages contributors · 作者与贡献记录 · CC BY 4.0。离线整理了版式、链接和媒体显示。
