AlexsJones / llmfit

What it does

• Hardware Auto-Detection. Detects CPU cores, system RAM, available discrete/integrated GPUs, VRAM, and unified memory architecture (NVIDIA CUDA, Apple Silicon, AMD ROCm, Intel OneAPI).
• Model Compatibility Engine. Analyzes model parameter counts, context lengths, and quantization formats (GGUF, AWQ, GPTQ, EXL2) to project memory footprints and tokens-per-second performance.
• Interactive TUI & Web Dashboard. Choose between a lightweight, zero-dependency terminal interface or a feature-rich web dashboard.
• REST API Endpoint. Exposes standard HTTP JSON endpoints (/api/v1/system, /api/v1/models) for integration into orchestrators, dashboards, and automated deployment pipelines.
• Multi-Platform Support. macOS (Apple Silicon & Intel), Linux (x86_64 & ARM64), and Windows (x86_64).