Skip to content
The Daily Repo

RunanywhereAI / runanywhere-sdks

Production ready toolkit to run AI locally

Why this job: topics: llamacpp, ollama, inference, on-device-ai

RunAnywhere architecture: eight SDKs over one C++ core, a capability registry that routes to QHexRT, MLX, llama.cpp, sherpa + ONNX, Core ML, or Cloud, landing on the Hexagon NPU, Apple Neural Engine, Metal, CUDA, WebGPU, or CPU. The RunAnywhere Console deploys models and collects telemetry.

What it does

  • Discovery. Bonjour / NSD service type _runanywhere-connect._tcp
  • Transport. framed TCP on the LAN; commons owns protocol version, role policy, session accounting, and generation validation (idl/connect.proto, rac_connect_*)
  • Lifecycle. the host app selects and loads the model, starts hosting, and supplies generation; stopping the host disconnects clients
  • Threat model. trusted LAN only — no TLS, pairing PIN, or mutual auth in this release. Do not expose Connect across untrusted networks. Future work may add TLS/pairing, Windows hosting, or a daemon; those change lifecycle and security and ar
  • Electron note. RunAnywhereMain.connect() is local MessagePort / utility-process IPC inside one Electron app. It is unrelated to LAN Connect

Get started

pip install runanywhere
Maintenance
Active
Last commit 6 days ago
Stars
10,338
+14 this week
Licence
Custom
Read before business use
Downloads for
3 systems
Mac, Windows, Linux
Latest tag
cpp-desktop-v0.20.43
Released 14 days ago
Built with
C++
38% of the code

Is it looked after?

Contributors
Not stated
Last 90 days
Issues
65% closed
160 still open
Pull requests
582 merged
58 waiting
Releases
42
30+ in the last year

Similar repos

Repos similar to this one
RepoStarsLast commitLicenceDownloads for
cactus-compute / engine6,1876 days agoCustomNo downloads
mybigday / llama.rn1,0722 days agoMITNo downloads
nobodywho-ooo / nobodywho1,674yesterdayEUPL-1.2No downloads
More: download files, languages, topics and project record

Download files, cpp-desktop-v0.20.43

  • Mac2 files, 58 downloads
  • Windows4 files, 38 downloads
  • Linux4 files, 309 downloads

All files on GitHub (opens in new tab)

Languages

  • C++ 38%
  • TypeScript 19%
  • Dart 8%
  • Swift 8%

Topics

  • ios
  • kotlin
  • llm
  • swift
  • inference
  • multimodal
  • on-device-ai
  • voice-ai
  • android
  • edge
  • llamacpp
  • apple-intelligence

Project record

  • JobLocal LLMs
  • StatusListed
  • Commits4,295
  • Forks414
  • Watching27
  • Stars in 28 days+60
  • CreatedJul 22, 2025
  • First seen by usNov 7, 2026
  • CheckedNov 11, 2026

Type to search.

Try