pie-project / pie
A programmable system for high-performance model serving
Why this job: topics: llm-inference, inference, inference-engine, model serving
What it does
Pie runs WebAssembly programs—*inferlets*—directly next to the model. An inferlet drives the forward pass, owns its state, and compiles custom epilogues to GPU kernels, so decoding, sampling, caching, and agent loops are written per application in Python, JavaScript, or Rust.
Get started
curl -fsSL https://pie-project.org/install.sh | bash
# Linux, macOS, WSL
irm https://pie-project.org/install.ps1 | iex
# Windows PowerShell - Maintenance
- Active
- Last commit today
- Stars
- 240
- +1 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- 3 systems
- Mac, Windows, Linux
- Latest version
- 0.6.0
- Released 13 days ago
- Built with
- Rust
- 79% of the code
Is it looked after?
- Contributors
- 4
- Last 90 days
- Issues
- 94% closed
- 16 still open
- Pull requests
- 1,029 merged
- 9 waiting
- Releases
- 8
- 8 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| xLLM-AI / xllm | 1,618 | today | Apache-2.0 | No downloads |
| EfficientMoE / MoE-Infinity | 381 | 2 days ago | Apache-2.0 | Linux |
| pegainfer-project / pegainfer | 738 | yesterday | Apache-2.0 | Linux |
More: download files, languages, topics and project record
Download files, 0.6.0
- Mac2 files, 7 downloads
- Windows2 files, 7 downloads
- Linux5 files, 17 downloads
Languages
- Rust 79%
- Cuda 7%
- Python 3%
- HIP 3%
Topics
- inference
- inference-engine
- llm-inference
- machine-learning
- mlsystem
- diffusion-model
- llms
- multimodal
Project record
- JobLocal LLMs
- StatusListed
- Commits1,667
- Forks39
- Watching1
- Stars in 28 days+13
- CreatedJan 21, 2025
- First seen by usNov 7, 2026
- CheckedNov 9, 2026