mlc-ai / mlc-llm
Universal LLM Deployment Engine with ML Compilation
Why this job: matched by what the repo talks about: llm, engine, deployment, universal
What it does
MLC LLM is a machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone's platforms.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 11 days ago
- Stars
- 23,319
- +23 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- 1 releases
- None marked latest
- Built with
- Python
- 70% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 81% closed
- 308 still open
- Pull requests
- 1,697 merged
- 61 waiting
- Releases
- 1
- 0 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| ling0322 / libllm | 154 | 2 months ago | MIT | No downloads |
| lone-cloud / gerbil | 480 | 7 days ago | AGPL-3.0 | Mac, Windows, Linux |
More: languages, topics and project record
Languages
- Python 70%
- C++ 24%
- Kotlin 2%
- Swift 2%
Topics
- llm
- machine-learning-compilation
- language-model
- tvm
Project record
- JobLocal LLMs
- StatusListed
- Commits1,823
- Forks2,165
- Watching209
- Stars in 28 days+103
- CreatedApr 29, 2023
- First seen by usNov 7, 2026
- CheckedNov 8, 2026