cactus-compute / engine
2bit quants, kernels and runtime for consumer devices.
Why this job: topics: llamacpp, llm-inference, on-device-ai, edge-ai
What it does
A hybrid edge-cloud AI engine for mobile devices & wearables.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 5 days ago
- Stars
- 6,188
- +15 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- v2.2.2
- Released 45 days ago
- Built with
- C++
- 32% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 76% closed
- 46 still open
- Pull requests
- 405 merged
- 70 waiting
- Releases
- 23
- 21 in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| RunanywhereAI / runanywhere-sdks | 10,338 | 5 days ago | Custom | Mac, Windows, Linux |
| software-mansion / react-native-executorch | 1,788 | 4 days ago | Custom | No downloads |
| alibaba / MNN | 16,462 | yesterday | Apache-2.0 | Mac, Windows, Linux |
More: languages, topics and project record
Languages
- C++ 32%
- Python 30%
- TypeScript 24%
- C 7%
Topics
- ai
- android
- arm
- edge
- edge-ai
- framework
- ios
- llamacpp
- llm
- llm-inference
- llms
- mobile
Project record
- JobLocal LLMs
- StatusListed
- Commits969
- Forks515
- Watching49
- Stars in 28 days+75
- CreatedApr 23, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026