amitshekhariitbhu / transformers-explained
Transformer architecture explained step by step - the full architecture, every attention variant, positional embeddings, and every layer inside a Transformer.
Why this job: works in the areas we cover, but does not say which job it does

What it does
We start with the complete picture - every component of the Transformer and how data flows through it. The rest of this guide then zooms into each piece.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 4 months ago
- Stars
- 230
- On GitHub
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Not stated
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- None
- No issues filed
- Pull requests
- 0 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| brandokoch / attention-is-all-you-need-paper | 254 | 3 months ago | MIT | No downloads |
| feifeibear / long-context-attention | 697 | 57 days ago | Apache-2.0 | No downloads |
| CASE-Lab-UMD / LLM-Drop | 193 | 41 days ago | Apache-2.0 | No downloads |
More: topics and project record
Topics
- architecture
- attention-is-all-you-need
- attention-mechanism
- large-language-models
- llm
- llms
- transformers
Project record
- JobOther AI tools
- StatusListed
- Commits6
- Forks25
- Watching1
- Stars in 28 days+4
- CreatedJul 8, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026
