lakehq / sail
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
Why this job: works in the areas we cover, but does not say which job it does
What it does
Sail is a drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads on a distributed, multimodal compute engine.
Get started
pip install pysail
pip install "pyspark-client"- Maintenance
- Active
- Last commit today
- Stars
- 3,496
- +9 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.7.3
- Released 13 days ago
- Built with
- Rust
- 71% of the code
Is it looked after?
- Contributors
- 13
- Last 90 days
- Issues
- 68% closed
- 163 still open
- Pull requests
- 1,874 merged
- 144 waiting
- Releases
- 30
- 20 in the last year
- Contributing guide (opens in new tab)
- No security policy
- Code of conduct (opens in new tab)
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| jddevtime / open-lakehouse-compute-fabric | 274 | 30 days ago | Apache-2.0 | No downloads |
| microsoft / SynapseML | 5,255 | today | MIT | No downloads |
| dotnet / spark | 2,097 | 7 days ago | MIT | Mac, Linux |
More: languages, topics and project record
Languages
- Rust 71%
- Python 15%
- Gherkin 13%
- Thrift <1%
Topics
- arrow
- big-data
- pyspark
- rust
- spark
- sql
- datafusion
- python
- artificial-intelligence
- data-engineering
- distributed-computing
- machine-learning
Project record
- JobOther AI tools
- StatusListed
- Commits1,873
- Forks241
- Watching21
- Stars in 28 days+58
- CreatedDec 21, 2023
- First seen by usNov 7, 2026
- CheckedNov 12, 2026