eth-sri / matharena
Evaluation of LLMs on latest math competitions
Why this job: matched by what the repo talks about: evaluation, llm
What it does
MathArena (NeurIPS D&B '25) is a platform for evaluation of LLMs on latest math competitions and olympiads. It is hosted on matharena.ai. This repository contains all code used for model evaluation. This README explains how to run your models. For more details about other aspects of the project, such as adding new competitions, please refer to the specific README files in the readmes/ folder. You can find logs from our evaluation containing full reasoning traces (if available) and solutions produced by the models on our HuggingFace page: https://huggingface.co/MathArena.
Get started
curl -LsSf https://astral.sh/uv/install.sh | sh - Maintenance
- Active
- Last commit yesterday
- Stars
- 295
- +1 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 92% of the code
Is it looked after?
- Contributors
- 2
- Last 90 days
- Issues
- 89% closed
- 4 still open
- Pull requests
- 2 merged
- 3 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
More: languages, topics and project record
Languages
- Python 92%
- Shell 3%
- HTML 3%
- CSS <1%
Topics
- evaluating-models
- llm
Project record
- JobEvals and observability
- StatusListed
- Commits55
- Forks36
- Watching11
- Stars in 28 days+4
- CreatedFeb 12, 2025
- First seen by usNov 7, 2026
- CheckedNov 10, 2026