arkflow-rs / arkflow
High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.
Why this job: works in the areas we cover, but does not say which job it does
What it does
- High Performance. Built on Rust and Tokio async runtime, offering excellent performance and low latency
- Durable Delivery. Opt-in per-stream WAL durability for at-least-once delivery, with optional exactly-once for transactional sinks
- Multiple Data Sources. Support for Kafka, MQTT, HTTP, files, SQL databases, and many other input/output sources
- Powerful Processing. Built-in SQL queries, Python UDFs, JSON processing, Protobuf encoding/decoding, batch processing, and VRL
- Streaming Codecs. JSON and Protobuf codecs, plus Debezium CDC envelopes and Confluent Schema Registry wire-format
Get started
./target/release/arkflow --config config.yaml - Maintenance
- Active
- Last commit today
- Stars
- 1,315
- +1 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.6.0
- Released 27 days ago
- Built with
- Rust
- 94% of the code
Is it looked after?
- Contributors
- 2
- Last 90 days
- Issues
- 84% closed
- 5 still open
- Pull requests
- 1,137 merged
- 26 waiting
- Releases
- 10
- 1 in the last year
- No contributing guide
- Security policy (opens in new tab)
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| OtterMind / Chat2DB | 28,363 | yesterday | Custom | Mac, Windows, Linux |
| dbcodeio / public | 366 | 2 days ago | Custom | No downloads |
| Rohithgilla12 / data-peek | 1,686 | yesterday | Custom | Mac, Windows, Linux |
More: languages, topics and project record
Languages
- Rust 94%
- TypeScript 5%
- CSS <1%
- Shell <1%
Topics
- flow
- rust
- rust-lang
- stream
- sql
- datafusion
- duckdb
- kafka
- mysql
- postgresql
- sqlite
- tokio
Project record
- JobOther AI tools
- StatusListed
- Commits1,144
- Forks51
- Watching2
- Stars in 28 days+6
- CreatedMar 1, 2025
- First seen by usNov 7, 2026
- CheckedNov 12, 2026