Simreal-AI / Simreal-MLBench
[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.
Why this job: says: benchmark; topics: benchmark
What it does
An agent studies a dataset, develops a modeling approach, runs experiments, and submits predictions. ML Benchmark brings together 60 tasks across tabular learning, forecasting, vision, language, audio, multimodal learning, and structured scientific data.
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit 47 days ago
- Stars
- 269
- On GitHub
- Licence
- Apache-2.0
- Allows business use
- Downloads for
- None listed
- No release files
- Latest version
- None yet
- No releases
- Built with
- Python
- 89% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- None
- No issues filed
- Pull requests
- 0 merged
- 0 waiting
- Releases
- None
- Never published
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| StartLuxLabs / DecisionPivot | 154 | 20 days ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 89%
- HTML 10%
- Shell 1%
Topics
- agentic
- benchmark
- benchmarking
- calibration
- llm
- llm-agents
- llms
- metacognition-in-llms
- rl-environment
- rsi
- ai-evaluation
- machine-learning
Project record
- JobEvals and observability
- StatusListed
- Commits4
- Forks36
- Watching25
- Stars in 28 days+2
- CreatedSep 21, 2026
- First seen by usNov 7, 2026
- CheckedNov 8, 2026