JakeATX / llamAmpere
llama.cpp fork for significantly improved performance on Ampere generation Nvidia cards (especially RTX 3090 / 3090 Ti): example: 110+ tok/s over a 100K-token generation at temperature 1 for qwen3.8, supporting full 262K ctx. Supports low memory (12gb) configs for 200k+ ctx. 120+ TPS, 3300+ prefill for QFN 3.8.
Why this job: says: llama.cpp; topics: llama-cpp, local-llm, llm-inference, gguf, quantization
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit today
- Stars
- 299
- +85 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.6.3.9
- Released today
- Built with
- C++
- 54% of the code
Is it looked after?
- Contributors
- 2
- Last 90 days
- Issues
- 78% closed
- 5 still open
- Pull requests
- 62 merged
- 6 waiting
- Releases
- 23
- 22 in the last year
- Contributing guide (opens in new tab)
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| syv-ai / HyperQwen | 2,626 | 6 days ago | Apache-2.0 | No downloads |
| Sandermage / sndr_core_engine | 133 | 4 months ago | Apache-2.0 | No downloads |
| StayLameBro / backburner | 1,173 | 2 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- C++ 54%
- C 16%
- Cuda 12%
- Python 6%
Topics
- ampere
- consumer-gpu
- cuda
- ggml
- gguf
- kv-cache-quantization
- llama-cpp
- llm
- llm-inference
- local-llm
- long-context
- mtp
Project record
- JobLocal LLMs
- StatusListed
- Commits13,449
- Forks37
- Watching2
- Stars in 28 days+131
- CreatedSep 7, 2026
- First seen by usNov 7, 2026
- CheckedNov 9, 2026