ferrumox / fox
A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.
Why this job: says: local llm, llama.cpp; topics: llama-cpp, ollama, local-llm, gguf, mlx, inference-engine
What it does
Fox is dual-licensed MIT OR Apache-2.0 and stays that way. There is no paid tier and no plan for one.
Get started
curl -fsSL https://github.com/ferrumox/fox/releases/latest/download/install.sh | sh git clone --recurse-submodules https://github.com/ferrumox/fox
cd fox && cargo build --release --bin fox - Maintenance
- Active
- Last commit 2 months ago
- Stars
- 190
- +1 this week
- Licence
- Custom
- Read before business use
- Downloads for
- Linux
- From the latest release
- Latest version
- v0.22.1
- Released 2 months ago
- Built with
- Rust
- 83% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 20% closed
- 4 still open
- Pull requests
- 0 merged
- 0 waiting
- Releases
- 16
- 16 in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| mw00 / project-maya | 2,741 | yesterday | MIT | No downloads |
| simplexai-labs / PolyStrata | 956 | 3 days ago | MIT | Windows |
| mlx-node / mlx-node | 167 | yesterday | MIT | Mac |
More: download files, languages, topics and project record
Languages
- Rust 83%
- Shell 10%
- Python 5%
- Makefile 1%
Topics
- cuda
- gguf
- inference-engine
- llama-cpp
- llm
- local-llm
- mlx
- ollama
- ollama-api
- openai-api
- rocm
- rust
Project record
- JobLocal LLMs
- StatusListed
- Commits428
- Forks28
- Watching5
- Stars in 28 days+1
- CreatedMar 8, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026