StartLuxLabs / StartLux-Decision
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Why this job: topics: llama-cpp, gguf, vllm, inference, mlx, llama.cpp
What it does
StartLux-Decision is a family of open decision models. Given a state (text, JSON or images) and a set of typed questions, a model returns a probability for every option of every question: a choice among listed options (choice), a yes or no judgement (noul), or a level on a scale (score). Instant models answer in a single forward pass with bidirectional attention over the prompt. AutoThink models answer in one pass when the top probability reaches a gate, 0.6 by default, and otherwise generate a short reasoning trace and read the answer again.
Get started
git clone https://github.com/StartLuxLabs/StartLux-Decision.git
cd StartLux-Decision
pip install -e '.[vllm]'
# vLLM 0.31.0; the published numbers were measured on 0.19.1, which is also supported - Maintenance
- Active
- Last commit 17 days ago
- Stars
- 1,698
- +61 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.1.0
- Released 26 days ago
- Built with
- Python
- 96% of the code
Is it looked after?
- Contributors
- 3
- Last 90 days
- Issues
- 0% closed
- 10 still open
- Pull requests
- 4 merged
- 3 waiting
- Releases
- 1
- 1 in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| llmmanorg / llmman | 585 | yesterday | Apache-2.0 | Mac, Windows, Linux |
| AlexsJones / llmfit | 38,802 | today | MIT | Mac, Windows, Linux |
| vllm-project / vllm-metal | 1,974 | today | Apache-2.0 | Mac |
More: languages, topics and project record
Languages
- Python 96%
- JavaScript 2%
- CSS 1%
- HTML <1%
Topics
- agents
- calibration
- classification
- decision-making
- gguf
- inference
- llama-cpp
- llm
- mlx
- open-weights
- reasoning
- vllm
Project record
- JobLocal LLMs
- StatusListed
- Commits43
- Forks163
- Watching68
- Stars in 28 days+1,314
- CreatedSep 29, 2026
- First seen by usNov 7, 2026
- CheckedNov 7, 2026