Agent Evaluation & Regression Testing
Products that measure whether an agent completes its intended tasks correctly and whether a new version improves or degrades performance. They focus on functional quality across full agent runs. Security testing and production monitoring are excluded.
- Companies
- 8
Explore
Companies
- Braintrust
Braintrust provides an agent observability and evaluation platform that helps teams test AI agents, catch regressions, and improve quality before release.
- Confident AI
Confident AI is an AI quality platform for testing, evaluating, and improving AI applications and agents before and after deployment.
- Crux Labs
Crux Labs turns expert judgment into custom evaluations that test AI agents on real tasks and track whether their performance changes.
- LangChain
LangChain builds software for developing and testing AI agents, including LangSmith for evaluation, debugging, monitoring, and testing of LLM and agent workflows.
- Langfuse
Langfuse is an open source AI engineering platform that helps teams trace, evaluate, and improve LLM applications and AI agents in production.
- Latitude
Latitude is an open source platform for AI agent observability and evaluation. It traces agent runs, surfaces failures, and turns real production issues into evals that can catch regressions…
- Maxim AI
Maxim AI builds an enterprise AI evaluation, observability, and gateway platform that helps teams route, govern, test, and monitor production AI applications.
- Patronus AI
Patronus AI builds evaluation and testing software that helps teams measure whether AI systems and agents work correctly and safely, then catch regressions before deployment.