rhesis-ai / rhesis
The collaboration layer for teams building AI agents. Test, simulate, and trace your agents, while domain experts annotate behavior and engineers improve the agent from what they find.
Why this job: topics: observability, llmops, llm-evaluation
What it does
- Architect. a chat agent that turns a PRD into requirements, metrics, and test sets, runs them, and charts the results
- Test generation from your requirements, a PRD, or an uploaded file
- Conversation simulation with Penelope; adversarial probing with Polyphemus and garak
- Requirement coverage. see which requirements pass or fail, and in which conversations
- Production tracing. OpenTelemetry traces with latency, tokens, and cost. Auto-instrumentation for LangChain, LangGraph, Microsoft Agent Framework, Pydantic AI, Google ADK, and Haystack
Get started
No single install command. Read the steps in the README (opens in new tab)
- Maintenance
- Active
- Last commit yesterday
- Stars
- 404
- +2 this week
- Licence
- Custom
- Read before business use
- Downloads for
- None listed
- No release files
- Latest version
- v0.20.1
- Released 7 days ago
- Built with
- Python
- 69% of the code
Is it looked after?
- Contributors
- 5
- Last 90 days
- Issues
- 94% closed
- 43 still open
- Pull requests
- 2,313 merged
- 16 waiting
- Releases
- 185
- 30+ in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| langfuse / langfuse | 37,218 | yesterday | Custom | No downloads |
| overmind-core / overmind | 754 | yesterday | AGPL-3.0 | No downloads |
| mlflow / mlflow | 28,736 | today | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 69%
- TypeScript 28%
- Shell 1%
- Jinja 1%
Topics
- ai-agents
- ai-safety
- llm
- llm-evaluation
- llm-testing
- observability
- red-teaming
- annotations
- feedback-loop
- llmops
Project record
- JobEvals and observability
- StatusListed
- Commits5,193
- Forks40
- Watching1
- Stars in 28 days+7
- CreatedOct 9, 2024
- First seen by usNov 7, 2026
- CheckedNov 10, 2026