vectara / hallucination-leaderboard
Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents
Why this job: works in the areas we cover, but does not say which job it does
What it does
Public LLM leaderboard computed using Vectara's Hallucination Evaluation Model, also known as HHEM. This evaluates how often an LLM introduces hallucinations when summarizing a document. We plan to update this regularly as our model and the LLMs get updated over time.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 20 days ago
- Stars
- 3,326
- +2 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 49% closed
- 20 still open
- Pull requests
- 149 merged
- 2 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
More: languages, topics and project record
Languages
- Python 100%
Topics
- generative-ai
- hallucinations
- llm
Project record
- JobOther AI tools
- StatusListed
- Commits458
- Forks108
- Watching61
- Stars in 28 days+8
- CreatedOct 31, 2023
- First seen by usNov 7, 2026
- CheckedNov 8, 2026