Skip to content
The Daily Repo

jolibrain / colette

Multimodal RAG to search and interact locally with technical documents of any kind

Why this job: says: rag; topics: retrieval-augmented-generation

What it does

  • Vision RAG (V-RAG). treats every document page as an image; preserves tables, figures, diagrams and spatial layout that text extraction loses. Powered by vision embedding models (e.g. gme-Qwen2-VL) and VLMs (e.g. Qwen3-VL).
  • Hybrid retrieval. runs vector embedding search and BM25 lexical search (Tantivy) in parallel. Especially effective for technical documents with product codes, part numbers, or rare identifiers.
  • HyDE (Hypothetical Document Embeddings). optionally generates a short hypothetical answer passage before retrieval (llm.use_hyde: true). The passage is embedded instead of the raw question, landing closer in vector space to real document c
  • Text RAG. classical text-extraction pipeline using unstructured + langchain for text-only documents.
  • Multi-backend support. huggingface, vllm, ollama, vllm_client for LLM inference; chromadb or coldb for vector storage.

Get started

git clone https://github.com/jolibrain/colette.git

You need: Python >= 3.12; CUDA >= 12.1; GPU >= 24GB

Maintenance
Active
Last commit 2 months ago
Stars
302
+1 this week
Licence
Custom
Read before business use
Downloads for
None listed
No release files
Latest version
v1.0.0
Released 18 months ago
Built with
HTML
66% of the code

Is it looked after?

Contributors
Not stated
Last 90 days
Issues
100% closed
0 still open
Pull requests
79 merged
1 waiting
Releases
1
0 in the last year

Similar repos

Repos similar to this one
RepoStarsLast commitLicenceDownloads for
Future-House / paper-qa9,57215 days agoApache-2.0No downloads
neuml / txtai13,2484 days agoApache-2.0No downloads
OpenBMB / VisRAG9898 days agoApache-2.0No downloads
More: languages, topics and project record

Languages

  • HTML 66%
  • Python 31%
  • Shell 2%
  • CSS 1%

Topics

  • llm
  • retrieval-augmented-generation
  • search
  • multimodal-large-language-models
  • multimodal-retrieval
  • vision-language-model

Project record

  • JobRAG and search
  • StatusListed
  • Commits331
  • Forks31
  • Watching4
  • Stars in 28 days+1
  • CreatedApr 4, 2025
  • First seen by usNov 7, 2026
  • CheckedNov 8, 2026

Type to search.

Try