visual-layer / fastdup
fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.
Why this job: matched by what the repo talks about: video, image, free, generate
What it does
- Quality. High-quality analysis to identify duplicates/near-duplicates, outliers, mislabels, broken images, and low-quality images.
- Scale. Highly scalable, capable of processing 400M images on a single CPU machine. Scales up to billions of images.
- Speed. Optimized C++ engine enables high performance even on low-resource CPU machines.
- Privacy. Runs locally or on your cloud infrastructure. Your data stays where it is.
- Ease of use. Works on labeled or unlabeled datasets in image or video format with support for major operating systems like MacOS, Linux and Windows.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 2 months ago
- Stars
- 1,916
- +1 this week
- Licence
- Custom
- Read before business use
- Downloads for
- Linux
- From the latest release
- Latest tag
- v2.2_3.7
- Released 2 years ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 89% closed
- 30 still open
- Pull requests
- 94 merged
- 0 waiting
- Releases
- 136
- 0 in the last year
- No contributing guide
- No security policy
- No code of conduct
More: download files, languages, topics and project record
Languages
- Python 100%
- Dockerfile <1%
Topics
- data-curation
- dataset
- deep-learning
- image-duplicate-detection
- machine-learning
- novelty-detection
- object-detection
- outlier-detection
- python
- visual-search
- data-augmentation
- image-classification
Project record
- JobVideo
- StatusListed
- Commits1,363
- Forks95
- Watching21
- Stars in 28 days+4
- CreatedMay 11, 2022
- First seen by usNov 7, 2026
- CheckedNov 8, 2026