carloslfu / slotstream
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
Why this job: topics: apple-silicon, ollama, local-llm, llm-inference, local-ai, mlx, inference-engine, on-device-ai
What it does
Slotstream is a fully native local AI engine for Apple Silicon Macs, written in Swift on Apple's MLX and Metal. It streams model experts from SSD and keeps the ones it needs in a memory cache, so the model can be much larger than your Mac's RAM. Inference runs on your Mac, offline after the download, with no Python runtime or cloud account.
Get started
curl -fsSL https://raw.githubusercontent.com/carloslfu/slotstream/main/install.sh | sh - Maintenance
- Active
- Last commit today
- Stars
- 659
- +14 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.2.30
- Released 21 days ago
- Built with
- Swift
- 61% of the code
Is it looked after?
- Contributors
- 3
- Last 90 days
- Issues
- 91% closed
- 2 still open
- Pull requests
- 99 merged
- 2 waiting
- Releases
- 38
- 30+ in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| jundot / omlx | 23,475 | 4 days ago | Apache-2.0 | Mac |
| vllm-project / vllm-metal | 1,974 | today | Apache-2.0 | Mac |
| SharpAI / SwiftLM | 797 | 2 days ago | MIT | Mac |
More: languages, topics and project record
Languages
- Swift 61%
- Python 37%
- Shell 2%
- C <1%
Topics
- apple-silicon
- llm
- llm-inference
- local-llm
- macos
- mixture-of-experts
- mlx
- ollama
- qwen
- swift
- claude-code
- inference-engine
Project record
- JobLocal LLMs
- StatusListed
- Commits753
- Forks54
- Watching3
- Stars in 28 days+203
- CreatedAug 28, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026