patchy631 / time-to-first-token
A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.
Why this job: says: roadmap; topics: roadmap
What it does
A 10-week, 30-minutes-a-day roadmap for engineers who want to actually run LLM inference in production, not just read about it.
Get started
pip install vllm
pip install guidellm
pip install sglang- Maintenance
- Active
- Last commit 2 months ago
- Stars
- 1,137
- +126 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- HTML
- 100% of the code
Is it looked after?
- Contributors
- 1
- Last 90 days
- Issues
- None
- No issues filed
- Pull requests
- 0 merged
- 2 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| zorost / AI-Engineering-Lab | 315 | 2 months ago | MIT | No downloads |
| loganthorneloe / ai-for-software-engineers | 1,375 | 2 months ago | MIT | No downloads |
| pierpaolo28 / Awesome-FDE-Roadmap | 1,529 | 57 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- HTML 100%
Topics
- learning-resources
- llm
- llm-inference
- mlops
- roadmap
- sglang
- vllm
Project record
- JobLists and guides
- StatusListed
- Commits3
- Forks135
- Watching6
- Stars in 28 days+167
- CreatedAug 2, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026