New in Evals and observability
5 new repos on our list for this job.
Newest first. Growth cannot be measured yet, so they are listed separately. How we rank
Back to Evals and observability
New to our list
| Rank | Name |
|---|---|
| 1. | cxcscmu /IdeaTaste IdeaTaste - A benchmark for research taste: let LLM agents propose research ideas, then check how many of them the research area actually went on to do. 31 stars+29 this week |
| 2. | jwuthri-cloud /Tracely-ai Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable. 946 stars-30 this week |
| 3. | rmr2024 /finextract Benchmark and fix LLM hallucinations when extracting figures from SEC 10-K filings 24 stars0 this week |
| 4. | StartLuxLabs /DecisionPivot DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners. 154 stars+2 this week |
| 5. | StarTrail-org /DRPixel DR Pixel: Page-Native Deep Research with Vision-Language Models — benchmark, evaluation harness and training code 42 stars+41 this week |