microsoft / benchmark-qed
Automated benchmarking of Retrieval-Augmented Generation (RAG) systems
Why this job: says: rag, retrieval augmented; topics: rag
What it does
BenchmarkQED is a suite of tools designed for automated benchmarking of retrieval-augmented generation (RAG) systems. It provides components for query generation, evaluation, and dataset preparation to facilitate reproducible testing at scale.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 4 days ago
- Stars
- 103
- On GitHub
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest tag
- release/v0.3.0
- Released 16 months ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- 2
- Last 90 days
- Issues
- 53% closed
- 9 still open
- Pull requests
- 49 merged
- 19 waiting
- Releases
- 4
- 0 in the last year
- No contributing guide
- Security policy (opens in new tab)
- Code of conduct (opens in new tab)
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| DocAILab / XRAG | 612 | 8 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 100%
- Shell <1%
Topics
- benchmarking
- benchmarkqed
- llm
- rag
Project record
- JobRAG and search
- StatusListed
- Commits47
- Forks24
- Watching5
- Stars in 28 days+3
- CreatedApr 3, 2025
- First seen by usNov 7, 2026
- CheckedNov 7, 2026