generative-computing / granite-switch

What it does

• Composable. Combine independently developed adapter functions into one checkpoint, whether IBM's or yours. Swap, upgrade, or customize without retraining.
• Fast. Built on IBM's Activated LoRA technology for efficient KV cache reuse, low latency, and high inference throughput.
• Accurate. Task-specific adapter functions can match and even surpass the accuracy of significantly larger generalist models, while requiring only a fraction of the serving cost. See the adapter function catalog for benchmark comparisons ac
• Inference-ready. Deploy with vLLM for production or HuggingFace for prototyping. Same checkpoint, no conversion step.