Photoroom / datago
A natively parallel dataloader for Python, written in Rust. Serving data at GB/s speeds, while covering aspect ratio bucketing, crop and resize for image ML workloads.
Why this job: works in the areas we cover, but does not say which job it does
What it does
A Rust-written data loader which can be used as a python module. Handles several data sources, from local files to webdataset or a VectorDB focused http stack like our open sourced dataroom. Focused on image data at the moment, could also easily be more generic.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 16 days ago
- Stars
- 128
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- v2026.10.1
- Released 28 days ago
- Built with
- Rust
- 73% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 83% closed
- 5 still open
- Pull requests
- 127 merged
- 2 waiting
- Releases
- 50
- 6 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| openeverest / openeverest | 967 | today | Apache-2.0 | Mac, Windows, Linux |
More: languages, topics and project record
Languages
- Rust 73%
- Python 27%
Topics
- dataloader
- machine-learning
- ml
- mlinfra
- storage
Project record
- JobOther AI tools
- StatusListed
- Commits220
- Forks12
- Watching12
- Stars in 28 days0
- CreatedSep 16, 2024
- First seen by usNov 7, 2026
- CheckedNov 8, 2026