unslothai / unsloth
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
Why this job: says: gguf; topics: llama
What it does
- Run and train LLMs, MLX, GGUF, diffusion, decision, embedding, audio models: Qwen3.8, GLM-5.3-Flash, Kimi K3, Qwen-Image-2.1, MiniMax-H3, DeepSeek-V4, Gemma 4.
- Agents & Tools. Use local models with Claude Code, Codex, and MCP, including tool calling and code execution.
- Browser use. Navigate sites, fill out forms, read PDFs, and edit files beside your chat with a local model.
- Sandboxing. Restrict which files your model can access when it runs commands in a sandbox.
- Search & RAG. Use private and unlimited web search, deep research, auto-compaction (rolling context window) and RAG.
Get started
curl -fsSL https://unsloth.ai/install.sh | sh - Maintenance
- Active
- Last commit today
- Stars
- 79,226
- +278 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest version
- v0.1.916-beta
- Released 3 days ago
- Built with
- Python
- 72% of the code
Is it looked after?
- Contributors
- 5
- Last 90 days
- Issues
- 97% closed
- 168 still open
- Pull requests
- 9,664 merged
- 344 waiting
- Releases
- 86
- 30+ in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| AlexsJones / llmfit | 38,802 | today | MIT | Mac, Windows, Linux |
| tattn / LocalLLMClient | 219 | 2 months ago | MIT | No downloads |
| zhongkaifu / TensorSharp | 667 | today | BSD-3-Clause | Mac, Windows, Linux |
More: download files, languages, topics and project record
Download files, v0.1.916-beta
- Mac1 file, 3,132 downloads
- Windows2 files, 16,669 downloads
- Linux3 files, 4,945 downloads
Languages
- Python 72%
- TypeScript 24%
- PowerShell 1%
- Shell 1%
Topics
- fine-tuning
- llama
- llms
- gemma
- unsloth
- llm
- deepseek
- text-to-speech
- tts
- qwen
- agent
- openai
Project record
- JobLocal LLMs
- StatusFeatured
- Commits13,739
- Forks7,378
- Watching380
- Stars in 28 days+1,487
- CreatedNov 29, 2023
- First seen by usNov 7, 2026
- CheckedNov 9, 2026
