xlite-dev / Awesome-LLM-Inference
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
Why this job: name: awesome; says: curated list
What it does
Awesome-LLM-Inference: A curated list of 📙Awesome LLM Inference Papers with Codes. For Awesome Diffusion Inference, please check 📖Awesome-DiT-Inference . For CUDA learn notes, please check 📖LeetCUDA .
Get started
python3 download_pdfs.py # The code is generated by Doubao AI- Maintenance
- Active
- Last commit 20 days ago
- Stars
- 5,551
- +10 this week
- Licence
- GPL-3.0
- Share-alike terms
- Downloads for
- None listed
- No release files
- Latest version
- v2.6.20
- Released 17 months ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- 6
- Last 90 days
- Issues
- 92% closed
- 1 still open
- Pull requests
- 164 merged
- 9 waiting
- Releases
- 45
- 0 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| YeonwooSung / llm-architecture-from-scratch | 856 | today | BSD-3-Clause | No downloads |
More: languages, topics and project record
Languages
- Python 100%
Topics
- flash-attention
- paged-attention
- tensorrt-llm
- vllm
- awesome-llm
- llm-inference
- deepseek
- flash-attention-3
- deepseek-v3
- minimax-01
- deepseek-r1
- mla
Project record
- JobLists and guides
- StatusListed
- Commits531
- Forks443
- Watching132
- Stars in 28 days+30
- CreatedAug 27, 2023
- First seen by usNov 7, 2026
- CheckedNov 9, 2026