rasbt / LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Why this job: says: from scratch
What it does
This repository contains the code for developing, pretraining, and finetuning a GPT-like LLM and is the official code repository for the book Build a Large Language Model (From Scratch).
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit yesterday
- Stars
- 108,118
- +350 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Jupyter Notebook
- 73% of the code
Is it looked after?
- Contributors
- 10
- Last 90 days
- Issues
- 100% closed
- 1 still open
- Pull requests
- 534 merged
- 3 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| raiyanyahya / how-to-train-your-gpt | 4,177 | 15 days ago | MIT | No downloads |
| rohitg00 / ai-engineering-from-scratch | 78,169 | yesterday | MIT | No downloads |
| analyticalrohit / llms-from-scratch | 386 | 5 months ago | MIT | No downloads |
More: languages, topics, project record and preview image
Languages
- Jupyter Notebook 73%
- Python 27%
- Dockerfile <1%
Topics
- gpt
- large-language-models
- llm
- python
- pytorch
- ai
- artificial-intelligence
- language-model
- deep-learning
- machine-learning
- from-scratch
- generative-ai
Project record
- JobLists and guides
- StatusListed
- Commits1,090
- Forks16,727
- Watching869
- Stars in 28 days+1,767
- CreatedJul 23, 2023
- First seen by usNov 7, 2026
- CheckedNov 10, 2026