ROCm / FastFlowLM
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
Why this job: matched by what the repo talks about: llm, amd, optimiz, npu
What it does
- Runs fully on AMD Ryzen™ AI NPU. no GPU or CPU load
- Lightweight runtime (17 MB). installs within 20 seconds, easy to integrate
- Developer-first flow. a familiar single-command CLI, optimized for NPU
- Support for long context windows. up to 256k tokens (e.g., Qwen3-4B-Thinking-2507)
- No low-level tuning required. You focus on your app, we handle the rest
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit today
- Stars
- 2,042
- +19 this week
- Licence
- Custom
- Read before business use
- Downloads for
- 2 systems
- Windows, Linux
- Latest version
- v1.0.12
- Released 7 days ago
- Built with
- C++
- 78% of the code
Is it looked after?
- Contributors
- 9
- Last 90 days
- Issues
- 44% closed
- 182 still open
- Pull requests
- 616 merged
- 40 waiting
- Releases
- 69
- 30+ in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| lemonade-sdk / lemonade | 6,186 | yesterday | Apache-2.0 | Mac, Windows, Linux |
| vllm-project / vllm | 96,774 | today | Apache-2.0 | Mac, Linux |
| amd / IRON | 154 | 3 days ago | Apache-2.0 | No downloads |
More: download files, languages, topics and project record
Download files, v1.0.12
- Windows3 files, 1,371 downloads
- Linux10 files, 841 downloads
Languages
- C++ 78%
- C 14%
- Python 4%
- CMake 2%
Topics
- amd
- deepseek
- llama
- llm
- npu
Project record
- JobLocal LLMs
- StatusListed
- Commits2,544
- Forks176
- Watching28
- Stars in 28 days+86
- CreatedJun 16, 2025
- First seen by usNov 7, 2026
- CheckedNov 12, 2026