lone-cloud / gerbil

A desktop app for running Large Language Models locally.

Why this job: topics: gguf, local-ai

1 of 6

What it does

Run LLMs locally. Powered by KoboldCpp, a fork of llama.cpp
Cross-platform. Native support for Windows, macOS, and Linux (including Wayland)
Offline capable. Import pre-downloaded KoboldCpp binaries and run entirely without an internet connection
Flexible hardware support. Works on CPU-only systems while also supporting GPU acceleration (CUDA, ROCm, Vulkan, Metal)
Image generation. Built-in presets for Flux, Chroma, Qwen Image, and Z-Image workflows

# fnm will auto-install Node.js based on .nvmrc or engines field
fnm use --install-if-missing
pnpm install

You need: fnm - Fast Node.js version manager (installs correct Node.js versions automatically)

Repos similar to this one
Repo	Stars	Last commit	Licence	Downloads for
zeraix / zeraix	403	21 days ago	Apache-2.0	Mac, Windows
feder-cr / jev	952	22 days ago	MIT	Mac, Windows, Linux
nathaninline / ajean	110	9 days ago	MIT	Mac, Windows, Linux

More: download files, languages, topics and project record