GraphCanon updated Sep 8, 2026 · GitHub synced Sep 8, 2026
45views this month
Decision brief
Contextcheck, an MIT-licensed Python framework for evaluating large language models and RAG systems through configurable YAML settings that integrate with CI pipelines.
Good fit when
- When you require a framework specifically designed to test the robustness of both LLMs and Retrieval-Augmented Generation systems within Python projects.
- If your development pipeline needs modular testing capabilities where tests can be configured via YAML files, aligning well with continuous integration practices.
Avoid when
- Avoid if you aim for a framework without configuration flexibility through YAML as contextcheck strictly relies on this format for setting up test environments.
- Skip contextcheck if your project environment or requirements do not align with the MIT license terms, especially in contexts where licensing compatibility must be strictly observed.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (635d since push)
- As of Sep 8, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 8, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install contextcheckSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
MIT-licensed framework for testing large language models, retrieval-augmented generation systems, chatbots, and other generative AI components. Configurable via YAML with CI pipeline integration.
Capability facts
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 8, 2026
- Languages
- python
Source: github.language+pyproject.toml · Sep 8, 2026
Categories
Tags
README
License This project is licensed under the MIT License see the LICENSE file for details
For agents
This page has a .md twin and JSON over the API.