New in Local LLMs
17 new repos on our list for this job.
Newest first. Growth cannot be measured yet, so they are listed separately. How we rank
New to our list
| Rank | Name |
|---|---|
| 1. | Aevonix /FlashAlign ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, OpenClaw and custom harnesses. 125 stars+6 this week |
| 2. | ahtx /kindi Kindi 0.4: local LLM inference on low-cost NVIDIA GPUs, Radeon 780M and CPUs. Bonsai 2B-27B, AH-Nanbeige4.3-33B and experimental Nemotron, with an OpenAI-compatible server. 148 stars+33 this week |
| 3. | DevDock-AI /Speedy Qwen3.8-Flash-Next (125B MoE) up to 1M context on one or two RTX cards (tuned on 3080 10gb). A measured, tuned and benchmarked fork of Strata. 56 stars+31 this week |
| 4. | dicksondickson /system-d-monitor Btop-style ESP32-S3 touchscreen dashboard for vLLM and TensorFold inference servers 11 stars+5 this week |
| 5. | drawthingsai /local-code-community Source code of Local Code, a private AI agent for Mac, iPad and iPhone. Runs DeepSeek 4.1 on device, with Python, Node.js and a shell built into the app. 126 stars+24 this week |
| 6. | FrigadeHQ /hob An easier way to use AI on your own computer. A free, open-source alternative to Claude and ChatGPT that runs open-weight models like Gemma and gpt-oss locally on Mac, Windows and Linux. Private, and works offline. 521 stars+58 this week |
| 7. | GianlucaBave /murmury The open-source Cluely alternative for Mac: live answers from your own docs during video calls, hidden from screen sharing. Local Whisper, your own AI key. 11 stars+11 this week |
| 8. | heterodoxin /AbliteratedOutTheBox llama.cpp fork that abliterates at inference 170 stars+8 this week |
| 9. | Incept5-AI /inferd Native Apple Silicon inference engine for many AI agents at once: C++/Metal, agent-contexts API, 8-bit paged KV, SSD tier (Qwen3.8) 27 stars+27 this week |
| 10. | johnpsasser /lifeboat Offline emergency assistant: a local LLM and a 200 GB offline library on one Mac, with cited answers and no internet. 42 stars+38 this week |
| 11. | Jumbomuffin777 /Frontier-UI ChatGPT-style generative UI for Open WebUI: photo galleries, live maps with real routes, multi-day trips, budgets, calculators, live weather & stocks, link previews, and one-click Word/Excel/PowerPoint exports via ArtCraft. One file, no API keys. 65 stars+10 this week |
| 12. | Magnvs7 /Promethevs PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-then-correct), OpenAI-compatible local server, report and logs. 156 stars+72 this week |
| 13. | OlegChe77 /local-ai Свой ИИ-чат на вашем ПК в один клик: подбирает модель под железо, ставит Ollama и модель. Windows. / One-click local AI chat for Windows: picks a model for your hardware, installs Ollama. 11 stars+7 this week |
| 14. | T-Crypt /berth Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off. 290 stars+8 this week |
| 15. | tuan3w /qwen-warp Fast Qwen3.8-27B for one RTX 3090. 200k context, 100+ tok/s. Custom CUDA decode engine, OpenAI-compatible API. 24 stars+24 this week |
| 16. | wici-ai /inferssd Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp. 364 stars+101 this week |
| 17. | ZhuLinsen /LiteMoE A MoE inference engine you can read in an afternoon. 29 stars+19 this week |