naver / bergen
Benchmarking library for RAG
Why this job: matched by what the repo talks about: benchmark, library, rag
What it does
- Easy reproducibility and integration of new datasets and models
- Support for various retrievers (20+), rerankers(4) and large language models (20+)
- Flexible configuration system using YAML files
- Comprehensive evaluation metrics (*Match, EM, LLMEval*, ... )
- Support for multilingual experiments
Get started
python3 bergen.py retriever="bm25" reranker="minilm6" generator='tinyllama-chat' dataset='kilt_nq'- Maintenance
- Inactive
- Last commit 8 months ago
- Stars
- 282
- On GitHub
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.1
- Released 2 years ago
- Built with
- Jupyter Notebook
- 76% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 100% closed
- 0 still open
- Pull requests
- 28 merged
- 2 waiting
- Releases
- 1
- 0 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| WenjieDu / PyPOTS | 2,096 | 3 days ago | BSD-3-Clause | No downloads |
| illuin-tech / vidore-benchmark | 278 | 23 days ago | MIT | No downloads |
More: languages, topics and project record
Languages
- Jupyter Notebook 76%
- Python 23%
- Shell <1%
Topics
- augmentation
- generation
- llms
- rag
- retrieval
Project record
- JobEvals and observability
- StatusListed
- Commits346
- Forks34
- Watching8
- Stars in 28 days+1
- CreatedMay 9, 2024
- First seen by usNov 7, 2026
- CheckedNov 8, 2026