open-compass / opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
Why this job: says: llm evaluation; topics: evaluation, benchmark, llm-eval
What it does
Just like a compass guides us on our journey, OpenCompass will guide you through the complex landscape of evaluating large language models. With its powerful algorithms and intuitive interface, OpenCompass makes it easy to assess the quality and effectiveness of your NLP models.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 3 days ago
- Stars
- 7,577
- +20 this week
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- 0.5.5
- Released 3 days ago
- Built with
- Python
- 100% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 70% closed
- 250 still open
- Pull requests
- 1,280 merged
- 88 waiting
- Releases
- 41
- 4 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| truera / trulens | 3,631 | 5 days ago | MIT | No downloads |
| Giskard-AI / giskard-oss | 5,946 | 7 days ago | Apache-2.0 | No downloads |
| suyoumo / ClawProBench | 829 | 2 months ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 100%
Topics
- evaluation
- benchmark
- large-language-model
- llm
- llm-eval
Project record
- JobEvals and observability
- StatusListed
- Commits1,290
- Forks904
- Watching29
- Stars in 28 days+87
- CreatedJun 15, 2023
- First seen by usNov 7, 2026
- CheckedNov 8, 2026