Epistates / pmetal
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.
Why this job: topics: apple-silicon, llm-inference, gguf, mlx, quantization, local llm, llm inference
What it does
PMetal trains and runs large language models on the Mac's GPU and Neural Engine, with no Python or CUDA in the loop. One tensor runtime (MLX under it, PMetal's own Metal kernels beside it) sits under a command line, a terminal UI, a desktop app, an MCP server, Python bindings and a Rust SDK.
Get started
brew install epistates/tap/pmetal - Maintenance
- Active
- Last commit 8 days ago
- Stars
- 332
- On GitHub
- Licence
- Custom
- Read before business use
- Downloads for
- Mac
- From the latest release
- Latest version
- v0.7.1
- Released 12 days ago
- Built with
- Rust
- 95% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 83% closed
- 5 still open
- Pull requests
- 1 merged
- 0 waiting
- Releases
- 17
- 17 in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| jundot / omlx | 23,491 | 5 days ago | Apache-2.0 | Mac |
| vllm-project / vllm-metal | 1,982 | today | Apache-2.0 | Mac |
| incoai / splash | 2,170 | 4 days ago | Apache-2.0 | Mac |
More: download files, languages, topics and project record
Languages
- Rust 95%
- Python 2%
- C++ 2%
- Svelte 1%
Topics
- ai
- ane
- apple-silicon
- deep-learning
- distillation
- fine-tuning
- gguf
- inference-server
- llm
- llm-inference
- llm-training
- lora
Project record
- JobLocal LLMs
- StatusListed
- Commits1,971
- Forks27
- Watching3
- Stars in 28 days+5
- CreatedJan 12, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026