jolibrain / colette
Multimodal RAG to search and interact locally with technical documents of any kind
Why this job: says: rag; topics: retrieval-augmented-generation
What it does
- Vision RAG (V-RAG). treats every document page as an image; preserves tables, figures, diagrams and spatial layout that text extraction loses. Powered by vision embedding models (e.g. gme-Qwen2-VL) and VLMs (e.g. Qwen3-VL).
- Hybrid retrieval. runs vector embedding search and BM25 lexical search (Tantivy) in parallel. Especially effective for technical documents with product codes, part numbers, or rare identifiers.
- HyDE (Hypothetical Document Embeddings). optionally generates a short hypothetical answer passage before retrieval (llm.use_hyde: true). The passage is embedded instead of the raw question, landing closer in vector space to real document c
- Text RAG. classical text-extraction pipeline using unstructured + langchain for text-only documents.
- Multi-backend support. huggingface, vllm, ollama, vllm_client for LLM inference; chromadb or coldb for vector storage.
Get started
git clone https://github.com/jolibrain/colette.git You need: Python >= 3.12; CUDA >= 12.1; GPU >= 24GB
- Maintenance
- Active
- Last commit 2 months ago
- Stars
- 302
- +1 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- v1.0.0
- Released 18 months ago
- Built with
- HTML
- 66% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 100% closed
- 0 still open
- Pull requests
- 79 merged
- 1 waiting
- Releases
- 1
- 0 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Future-House / paper-qa | 9,572 | 15 days ago | Apache-2.0 | No downloads |
| neuml / txtai | 13,248 | 4 days ago | Apache-2.0 | No downloads |
| OpenBMB / VisRAG | 989 | 8 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- HTML 66%
- Python 31%
- Shell 2%
- CSS 1%
Topics
- llm
- retrieval-augmented-generation
- search
- multimodal-large-language-models
- multimodal-retrieval
- vision-language-model
Project record
- JobRAG and search
- StatusListed
- Commits331
- Forks31
- Watching4
- Stars in 28 days+1
- CreatedApr 4, 2025
- First seen by usNov 7, 2026
- CheckedNov 8, 2026
