langevals
Provides a platform for evaluating and benchmarking LLM models using various evaluators
GraphCanon updated Oct 22, 2026 · GitHub synced Oct 22, 2026
Decision brief
Unverified catalog guidance: LangEvals is an amalgamation platform for various language model evaluators under one umbrella. This tool offers a standardized interface to assess and protect large language models with ease.
Good fit when
- Unverified catalog guidance: When you need a singular point of access to multiple LLM evaluation tools
- Unverified catalog guidance: For standardizing the assessment process across different evaluators as part of your pipeline
Avoid when
- Unverified catalog guidance: If you prefer not having a dependency on LangEvals after it has been moved into the LangWatch monorepo, opting for directly managing individual evaluators could be a better option
- Unverified catalog guidance: When needing to customize evaluation processes extensively beyond what the provided standard interface allows
- Pricing:
- unknown
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Archived (248d since push)
- As of Oct 22, 2026
- Provenance
- Not a fork · Organization account
- As of Oct 22, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/langwatch/langevalsSource repositorySimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
LangEvals acts as an aggregator for multiple language model evaluation tools under one interface, facilitating the protection and assessment of large language models.
Capability facts
- MCP server
- Unknown; MCP server not established by this scan
Source: repo_scan · Oct 22, 2026
Categories
Tags
README
LangEvals MOVED This project has been moved into the LangWatch monorepo. You can find the langevals source code at: langwatch/langwatch/langevals PyPI Packages The PyPI packages ( , , , etc.) continue to be published from the new location. No changes needed for existing users ins...
For agents
This page has a .md twin and JSON over the API.