RunanywhereAI / runanywhere-sdks
Production ready toolkit to run AI locally
Why this job: topics: llamacpp, ollama, inference, on-device-ai

What it does
- Discovery. Bonjour / NSD service type _runanywhere-connect._tcp
- Transport. framed TCP on the LAN; commons owns protocol version, role policy, session accounting, and generation validation (idl/connect.proto, rac_connect_*)
- Lifecycle. the host app selects and loads the model, starts hosting, and supplies generation; stopping the host disconnects clients
- Threat model. trusted LAN only — no TLS, pairing PIN, or mutual auth in this release. Do not expose Connect across untrusted networks. Future work may add TLS/pairing, Windows hosting, or a daemon; those change lifecycle and security and ar
- Electron note. RunAnywhereMain.connect() is local MessagePort / utility-process IPC inside one Electron app. It is unrelated to LAN Connect
Get started
pip install runanywhere- Maintenance
- Active
- Last commit 6 days ago
- Stars
- 10,338
- +14 this week
- Licence
- Custom
- Read before business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest tag
- cpp-desktop-v0.20.43
- Released 14 days ago
- Built with
- C++
- 38% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 65% closed
- 160 still open
- Pull requests
- 582 merged
- 58 waiting
- Releases
- 42
- 30+ in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| cactus-compute / engine | 6,187 | 6 days ago | Custom | No downloads |
| mybigday / llama.rn | 1,072 | 2 days ago | MIT | No downloads |
| nobodywho-ooo / nobodywho | 1,674 | yesterday | EUPL-1.2 | No downloads |
More: download files, languages, topics and project record
Download files, cpp-desktop-v0.20.43
- Mac2 files, 58 downloads
- Windows4 files, 38 downloads
- Linux4 files, 309 downloads
Languages
- C++ 38%
- TypeScript 19%
- Dart 8%
- Swift 8%
Topics
- ios
- kotlin
- llm
- swift
- inference
- multimodal
- on-device-ai
- voice-ai
- android
- edge
- llamacpp
- apple-intelligence
Project record
- JobLocal LLMs
- StatusListed
- Commits4,295
- Forks414
- Watching27
- Stars in 28 days+60
- CreatedJul 22, 2025
- First seen by usNov 7, 2026
- CheckedNov 11, 2026
