apache / wayang
Apache Wayang is the first cross-platform data processing system.
Why this job: works in the areas we cover, but does not say which job it does
What it does
You write your pipeline against a single API, then decide how it runs. Point it at one engine and it runs there. Or hand Wayang's cost-based optimizer the choice and let it pick the best platform for each step across your laptop, Apache Spark, Apache Flink, or a database, even splitting a single job across several. Either way, when your data outgrows one machine you don't rewrite anything, you just make another engine available.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit today
- Stars
- 284
- +1 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Java
- 88% of the code
Is it looked after?
- Contributors
- 13
- Last 90 days
- Issues
- 65% closed
- 107 still open
- Pull requests
- 491 merged
- 25 waiting
- Releases
- None
- Never published
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| h2oai / h2o-3 | 7,522 | yesterday | Apache-2.0 | No downloads |
| microsoft / SynapseML | 5,255 | today | MIT | No downloads |
| hyperai / tvm-cn | 3,952 | 11 months ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Java 88%
- Scala 9%
- Python 1%
- Shell 1%
Topics
- cross-platform
- data-processing
- apache
- big-data
- data-management-platform
- distributed-system
- hadoop
- java
- jdbc
- open-source
- scala
- spark
Project record
- JobOther AI tools
- StatusListed
- Commits3,346
- Forks143
- Watching16
- Stars in 28 days+8
- CreatedDec 16, 2020
- First seen by usNov 7, 2026
- CheckedNov 12, 2026