truera / trulens
Evaluation and Tracking for LLM Experiments and AI Agents
Why this job: topics: llmops, evals, llm-evaluation, ai-observability, llm-eval
What it does
Instrument any app with a decorator, score every step with LLM judges that explain themselves, then compare versions and ship the one that earns it. Tracing is OpenTelemetry-native, so a trace is portable to any OTLP backend, and evaluations run either as traces land or over a dataset after the fact.
Get started
pip install trulens- Maintenance
- Active
- Last commit 6 days ago
- Stars
- 3,633
- +8 this week
- Licence
- MIT
- Allows business use
- Downloads for
- None listed
- No release files
- Latest tag
- trulens-2.16.0
- Released 22 days ago
- Built with
- Python
- 91% of the code
Is it looked after?
- Contributors
- 26
- Last 90 days
- Issues
- 90% closed
- 60 still open
- Pull requests
- 1,946 merged
- 90 waiting
- Releases
- 127
- 19 in the last year
- Contributing guide (opens in new tab)
- No security policy
- No code of conduct
Similar repos
| Repo | Stars | Last commit | Licence | Downloads for |
|---|---|---|---|---|
| Giskard-AI / giskard-oss | 5,947 | 8 days ago | Apache-2.0 | No downloads |
| future-agi / future-agi | 2,258 | 7 days ago | Apache-2.0 | No downloads |
| mlflow / mlflow | 28,736 | today | Apache-2.0 | No downloads |
More: languages, topics and project record
Languages
- Python 91%
- Jupyter Notebook 6%
- TypeScript 3%
- Makefile <1%
Topics
- machine-learning
- neural-networks
- explainable-ml
- llmops
- ai-monitoring
- ai-observability
- evals
- llm-evaluation
- llms
- ai-agents
- llm-eval
- agentops
Project record
- JobEvals and observability
- StatusFeatured
- Commits1,992
- Forks388
- Watching23
- Stars in 28 days+40
- CreatedNov 2, 2020
- First seen by usNov 7, 2026
- CheckedNov 10, 2026