GraphCanon updated Oct 17, 2026 · GitHub synced Oct 17, 2026
Decision brief
Unverified catalog guidance: Contextcheck is a MIT-licensed framework for testing large language models, retrieval-augmented generation systems, and chatbots. It is configurable via YAML and can be integrated into CI pipelines for automated testing.
Good fit when
- Unverified catalog guidance: When you need a framework that is specifically designed for testing large language models, retrieval-augmented generation systems, and chatbots.
- Unverified catalog guidance: If your project requires integration with CI pipelines for automated testing, and you prefer configuration via YAML files.
Avoid when
- Unverified catalog guidance: If your testing requirements do not align with the specific focus on large language models, retrieval-augmented generation systems, and chatbots.
- Unverified catalog guidance: If you prefer a testing tool that does not require YAML configuration or CI pipeline integration.
- Requirements:
- Requires Python environment.; Supports integration with CI pipelines.
Observed Sep 30, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (674d since push)
- As of Oct 17, 2026
- Provenance
- Not a fork · Organization account
- As of Oct 17, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/addepto/contextcheckSource repositorySimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
MIT-licensed framework for testing large language models, retrieval-augmented generation systems, and chatbots. Configurable via YAML and can be integrated into CI pipelines for automated testing.
Capability facts
- CLI
- Declared CLI entrypoint
Source: pyproject.toml:[tool.poetry.scripts] · Oct 17, 2026
- MCP server
- Unknown; MCP server not established by this scan
Source: repo_scan · Oct 17, 2026
- Languages
- python
Source: github.language+pyproject.toml · Oct 17, 2026
Categories
Tags
README
License This project is licensed under the MIT License see the LICENSE file for details
For agents
This page has a .md twin and JSON over the API.