microsoft / Tutel
Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4
Why this job: matched by what the repo talks about: moe, optimiz, deepseek, support
What it does
Tutel MoE: An Optimized Mixture-of-Experts Implementation, also the first parallel solution proposing "No-penalty Parallism/Sparsity/Capacity/.. Switching" for modern training and inference that have dynamic behaviors. Support direct NVFP4/MXFP4/BlockwiseFP8 Inference for MoE-based GLM-5.x / DeepSeek-3.x / Kimi-2.x / Kimi-3.x / Qwen3 / Gpt-OSS using A100/A800/H100/MI300/..
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 6 days ago
- Stars
- 1,028
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.4.1
- Released 20 months ago
- Built with
- C
- 85% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 40% closed
- 55 still open
- Pull requests
- 237 merged
- 0 waiting
- Releases
- 13
- 0 in the last year
- No contributing guide
- Security policy (opens in new tab)
- Code of conduct (opens in new tab)
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| vllm-project / vllm | 96,774 | today | Apache-2.0 | Mac, Linux |
| mw00 / project-maya | 2,806 | yesterday | MIT | No downloads |
| ymcui / Chinese-Mixtral | 613 | 6 months ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- C 85%
- Python 11%
- C++ 4%
- Shell <1%
Topics
- pytorch
- moe
- mixture-of-experts
- deepseek
- llm
Project record
- JobLocal LLMs
- StatusListed
- Commits247
- Forks111
- Watching17
- Stars in 28 days+4
- CreatedAug 6, 2021
- First seen by usNov 7, 2026
- CheckedNov 8, 2026