dadwritestech / LlamaForge

Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, one-click llama.cpp updates, several models at once, and Embers (local agents whose quotes are checked by code). Windows · Linux · macOS.

Why this job: says: llama.cpp; topics: llama-cpp, llamacpp, local-llm, llm-inference, gguf, vllm, inference, local-ai