ServiceNow / AgentLab
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
Why this job: matched by what the repo talks about: benchmark, open, test, task
What it does
- Study contains a dict of information about reproducibility, including benchmark version, package
- The Study class allows automatic upload of your results to
- Reproduced results in the leaderboard. For agents that are reprocudibile, we encourage users
- ReproducibilityAgent. You can run this agent on an existing study and it will try to re-run
Get started
pip install agentlab- Maintenance
- Active
- Last commit 35 days ago
- Stars
- 663
- +2 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.4.2
- Released 9 months ago
- Built with
- Python
- 76% of the code
Is it looked after?
- Contributors
- Not stated
- Last 90 days
- Issues
- 73% closed
- 22 still open
- Pull requests
- 198 merged
- 17 waiting
- Releases
- 16
- 2 in the last year
- No contributing guide
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| TIGER-AI-Lab / ClawBench | 1,247 | 5 days ago | Apache-2.0 | No downloads |
| EuroEval / EuroEval | 204 | today | MIT | No downloads |
| kaiko-ai / eva | 175 | 3 months ago | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 76%
- Jupyter Notebook 20%
- HTML 3%
- Makefile <1%
Topics
- agents
- benchmark
- evaluation-framework
- llm
- llm-agents
- prompting
- web-agents
- agent
- lab
Project record
- JobEvals and observability
- StatusListed
- Commits965
- Forks140
- Watching4
- Stars in 28 days+12
- CreatedMay 21, 2024
- First seen by usNov 7, 2026
- CheckedNov 8, 2026