modular / llm-inference-handbook
Everything you need to know about LLM inference
Why this job: says: handbook
What it does
This repository contains the source for the LLM Inference Handbook, a practical guide for understanding, optimizing, scaling, and operating LLM inference systems.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 14 days ago
- Stars
- 477
- +3 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- TypeScript
- 57% of the code
Is it looked after?
- Contributors
- 2
- Last 90 days
- Issues
- 0% closed
- 5 still open
- Pull requests
- 213 merged
- 7 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
More: languages, topics and project record
Languages
- TypeScript 57%
- CSS 29%
- SCSS 11%
- JavaScript 2%
Topics
- llm
- llm-inference
- inference-handbook
- inference-optimization
- inference-infrastructure
Project record
- JobLists and guides
- StatusListed
- Commits594
- Forks59
- Watching3
- Stars in 28 days+26
- CreatedJul 7, 2025
- First seen by usNov 7, 2026
- CheckedNov 9, 2026