Chen-zexi / vllm-cli
A command-line interface tool for serving LLM using vLLM.
Why this job: topics: llm-inference, vllm
What it does
- Interactive Mode. Rich terminal interface with menu-driven navigation
- Command-Line Mode. Direct CLI commands for automation and scripting
- Model Management. Automatic discovery of local models with HuggingFace and Ollama support
- Configuration Profiles. Pre-configured and custom server profiles for different use cases
- Server Monitoring. Real-time monitoring of active vLLM servers
Get started
# Install vLLM CLI + vLLM
pip install vllm-cli[vllm]
vllm-cliYou need: Python 3.9+; CUDA-compatible GPU (recommended); vLLM package installed
- Maintenance
- Inactive
- Last commit 9 months ago
- Stars
- 506
- +1 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.2.5
- Released 14 months ago
- Built with
- Python
- 99% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 55% closed
- 5 still open
- Pull requests
- 2 merged
- 0 waiting
- Releases
- 12
- 0 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| ashhart / TensorFold | 1,797 | today | Apache-2.0 | Mac, Linux |
| runpod-workers / worker-vllm | 474 | 7 days ago | MIT | No downloads |
| ai-dynamo / dynamo | 8,472 | yesterday | Custom | No downloads |
More: languages, topics and project record
Languages
- Python 99%
- Shell 1%
- Makefile <1%
Topics
- llm
- llm-inference
- llm-tools
- vllm
Project record
- JobLocal LLMs
- StatusListed
- Commits61
- Forks30
- Watching2
- Stars in 28 days+1
- CreatedAug 14, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026