ai-dynamo / dynamo
A Datacenter Scale Distributed Inference Serving Framework
Why this job: topics: llm-inference, vllm
What it does
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit today
- Stars
- 8,462
- +34 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.6.2
- Released 5 days ago
- Built with
- Rust
- 50% of the code
Is it looked after?
- Contributors
- 45
- Last 90 days
- Issues
- 71% closed
- 850 still open
- Pull requests
- 10,142 merged
- 1,467 waiting
- Releases
- 73
- 30+ in the last year
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| SemiAnalysisAI / InferenceX | 2,016 | today | Apache-2.0 | No downloads |
| eagle-hq / EAGLE-4 | 1,163 | 9 days ago | Custom | No downloads |
| matrixhub-ai / matrixhub | 366 | 6 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Rust 50%
- Python 36%
- Go 12%
- Shell 1%
Topics
- diffusion
- disaggregated-serving
- kubernetes
- llm-inference
- omni
- routing-engine
- rust
- sglang
- tensorrt-llm
- vllm
Project record
- JobLocal LLMs
- StatusListed
- Commits8,553
- Forks1,839
- Watching76
- Stars in 28 days+198
- CreatedMar 3, 2025
- First seen by usNov 7, 2026
- CheckedNov 10, 2026