infiniflow / infinity
The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.
Why this job: topics: rag, vector-database, vector-search, hybrid-search
What it does
- Achieves 0.1 milliseconds query latency and 15K+ QPS on million-scale vector datasets.
- Achieves 1 millisecond latency and 12K+ QPS in full-text search on 33M documents.
- Supports a hybrid search of dense embedding, sparse embedding, tensor, and full text, in addition to filtering.
- Supports several types of rerankers including RRF, weighted sum and ColBERT.
- Intuitive Python API. See the Python API
Get started
sudo mkdir -p /var/infinity && sudo chown -R $USER /var/infinity
docker pull infiniflow/infinity:nightly
docker run -d --name infinity -v /var/infinity/:/var/infinity --ulimit nofile=500000:500000 --network=host infiniflow/infinity:nightly sudo mkdir -p /var/infinity && sudo chown -R $USER /var/infinity
docker pull infiniflow/infinity:nightly
docker run -d --name infinity -v /var/infinity/:/var/infinity --ulimit nofile=500000:500000 --network=host infiniflow/infinity:nightly You need: CPU: x86_64 with AVX2 support.; Python: Python 3.11+.
- Maintenance
- Active
- Last commit yesterday
- Stars
- 4,762
- +11 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- Linux
- From the latest release
- Latest version
- v0.7.5
- Released 4 days ago
- Built with
- C++
- 61% of the code
Is it looked after?
- Contributors
- 13
- Last 90 days
- Issues
- 85% closed
- 105 still open
- Pull requests
- 2,532 merged
- 47 waiting
- Releases
- 59
- 25 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| qdrant / qdrant | 35,479 | 19 days ago | Apache-2.0 | Mac, Windows, Linux |
| zvec-ai / zvec-grep | 4,294 | today | Apache-2.0 | No downloads |
| milvus-io / milvus | 46,614 | today | Apache-2.0 | No downloads |
More: download files, languages, topics and project record
Languages
- C++ 61%
- Rust 25%
- Python 8%
- Go 3%
Topics
- ai-native
- nearest-neighbor-search
- rag
- vector-search
- information-retrival
- bm25
- embedding
- full-text-search
- search-engine
- cpp20-modules
- approximate-nearest-neighbor-search
- vector-database
Project record
- JobRAG and search
- StatusListed
- Commits3,189
- Forks458
- Watching43
- Stars in 28 days+29
- CreatedJul 18, 2022
- First seen by usNov 7, 2026
- CheckedNov 9, 2026