jax-ml / scaling-book
Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
Why this job: works in the areas we cover, but does not say which job it does
What it does
This book aims to demystify the art of scaling LLMs on TPUs. We try to explain how TPUs work, how LLMs actually run at scale, and how to pick parallelism schemes during training and inference that avoid communication bottlenecks. The book is available at https://jax-ml.github.io/scaling-book.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 24 days ago
- Stars
- 1,527
- +8 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- SCSS
- 44% of the code
Is it looked after?
- Contributors
- 4
- Last 90 days
- Issues
- 67% closed
- 4 still open
- Pull requests
- 86 merged
- 9 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| avinash201199 / free-ai-agents-resources | 1,083 | 8 months ago | MIT | No downloads |
| google / grain | 806 | yesterday | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- SCSS 44%
- JavaScript 32%
- HTML 10%
- CSS 6%
Topics
- jax
- llm-inference
- llms
- roofline
- tpus
Project record
- JobOther AI tools
- StatusListed
- Commits387
- Forks218
- Watching11
- Stars in 28 days+45
- CreatedFeb 3, 2025
- First seen by usNov 7, 2026
- CheckedNov 9, 2026