john-rocky / CoreML-LLM
Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU
Why this job: matched by what the repo talks about: llm, apple, gpu, engine
What it does
Where MLX Swift is the right call when you want maximum GPU throughput, CoreML-LLM is what you use when the LLM should live on the ANE so the GPU stays free for the rest of the app.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 36 days ago
- Stars
- 205
- +1 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.9.0
- Released 6 months ago
- Built with
- Python
- 64% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 33% closed
- 4 still open
- Pull requests
- 138 merged
- 2 waiting
- Releases
- 21
- 21 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Desert-Ant-Labs / desert-ant-core | 451 | 5 days ago | Custom | No downloads |
| maziyarpanahi / openmed | 5,797 | 2 days ago | Apache-2.0 | No downloads |
| SharpAI / SwiftLM | 797 | 3 days ago | MIT | Mac |
More: languages, topics and project record
Languages
- Python 64%
- Swift 32%
- Shell 2%
- Jupyter Notebook 2%
Topics
- coreml
- ios
- llm
- apple-neural-engine
- core-ml
- machine-learning
- mlx
- on-device
- swift
Project record
- JobLocal LLMs
- StatusListed
- Commits472
- Forks27
- Watching4
- Stars in 28 days+7
- CreatedApr 8, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026