engeldlgado / toshllm
Run large language models locally on Intel Macs with AMD GPUs - native macOS app with Metal acceleration
Why this job: topics: llama-cpp, local-ai

What it does
- Native chat. multiple persistent conversations, full Markdown with code-copy, regenerate, system prompt, live tokens/sec, file attachments, conversation forking and per-message metrics
- Agent tools and MCP. the model can read, edit and run files and commands with per-step permission, run JavaScript in a sandbox, and use tools from external Model Context Protocol servers you connect
- Symbolic math (SymPy). optional exact math tools for the model: simplify, solve equations and systems, derivatives, integrals, limits, series, differential equations, matrices, Laplace and Fourier transforms, and checking that two expressi
- Scientific computing (NumPy and SciPy). optional numerical tools for the model: definite integrals without a closed form, roots, optimization and curve fitting, differential equations over an interval, linear algebra on decimal matrices, F
- Math answers you can check. with either math tool set on, the engine runs the turn itself: a calculation has to go through a tool or a question back, every call is checked against your message, and the answer only states numbers from your
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 5 days ago
- Stars
- 246
- +12 this week
- Licence
- GPL-3.0
- Share-alike terms
- Downloads for
- Mac
- From the latest release
- Latest version
- v0.87.33
- Released 5 days ago
- Built with
- Swift
- 80% of the code
Is it looked after?
- Contributors
- 4
- Last 90 days
- Issues
- 87% closed
- 15 still open
- Pull requests
- 21 merged
- 5 waiting
- Releases
- 145
- 30+ in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Neywa-Labs / nativ | 1,581 | today | MIT | Mac |
| vllm-project / vllm-metal | 1,974 | today | Apache-2.0 | Mac |
| incoai / splash | 2,159 | 3 days ago | Apache-2.0 | Mac |
More: download files, languages, topics and project record
Languages
- Swift 80%
- Python 16%
- Shell 3%
- HTML <1%
Topics
- amd-gpu
- hackintosh
- intel-mac
- llama-cpp
- llm
- local-ai
- macos
- metal
- swiftui
Project record
- JobLocal LLMs
- StatusListed
- Commits1,047
- Forks30
- Watching0
- Stars in 28 days+33
- CreatedJun 14, 2026
- First seen by usNov 7, 2026
- CheckedNov 7, 2026
