litert-lm
Run and manage LiteRT-LM models. More information: https://developers.google.com/edge/litert-lm/cli/usage.
- List all imported models:
litert-lm list
- Run a local or imported model interactively:
litert-lm run
- Run a model directly from a Hugging Face repository with a single prompt:
litert-lm run --from-huggingface-repo --prompt ""
- Run a model using GPU acceleration:
litert-lm run --backend gpu
- Run a multimodal model with an image attachment:
litert-lm run --vision-backend --attachment --prompt ""
- Run a model with Python function calling tools via a preset file:
litert-lm run --preset
- Benchmark a model's performance:
litert-lm benchmark
- Start an OpenAI-compatible API server on a specific port:
litert-lm serve --port
来源:tldr-pages contributors · 作者与贡献记录 · CC BY 4.0。离线整理了版式、链接和媒体显示。
