AtomicBot-ai / Atomic-Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
Why this job: says: inference engine; topics: apple-silicon, llamacpp, local-llm, llm-inference, gguf, local-ai, mlx
What it does
- Run open-weight LLMs locally from HuggingFace. Llama, Gemma, Qwen, Mistral, Phi, and others
- Multi-Token Prediction (MTP) speculative decoding — 30–70% throughput boost on supported models, up to 3× on Gemma 4
- DFlash block-diffusion decoding. up to 6× faster on Qwen 3.6, Gemma 4, Kimi K2.5
- Flash Attention toggle (on / off / auto)
- Automatic reasoning-context tracking for chain-of-thought models
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit yesterday
- Stars
- 1,973
- +49 this week
- Licence
- Custom
- Read before business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest version
- v2.3.5
- Released 6 days ago
- Built with
- TypeScript
- 72% of the code
Is it looked after?
- Contributors
- 2
- Last 90 days
- Issues
- 68% closed
- 48 still open
- Pull requests
- 162 merged
- 24 waiting
- Releases
- 62
- 30+ in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| fiveoutofnine / whatcanirun | 248 | 2 months ago | MIT | No downloads |
| FrigadeHQ / hob | 524 | 11 days ago | MIT | Mac, Windows, Linux |
| unslothai / unsloth | 79,258 | today | Apache-2.0 | Mac, Windows, Linux |
More: download files, languages, topics and project record
Download files, v2.3.5
- Mac1 file, 666 downloads
- Windows4 files, 4,619 downloads
- Linux6 files, 803 downloads
Languages
- TypeScript 72%
- Rust 24%
- JavaScript 2%
- Python 1%
Topics
- ai-chat
- ai-tools
- apple-silicon
- chatgpt
- deepseek
- desktop-app
- gemma
- gguf
- gpt-oss
- llamacpp
- llm
- llm-inference
Project record
- JobLocal LLMs
- StatusListed
- Commits9,413
- Forks232
- Watching14
- Stars in 28 days+210
- CreatedMar 31, 2026
- First seen by usNov 7, 2026
- CheckedNov 10, 2026