contextcheck logo

contextcheck

Addepto/contextcheck

Framework for LLMs, RAGs, Chatbots testing

GraphCanon updated Oct 17, 2026 · GitHub synced Oct 17, 2026

98 stars13 forksLast push Dec 11, 2024 Python MIT

Decision brief

Unverified catalog guidance: Contextcheck is a MIT-licensed framework for testing large language models, retrieval-augmented generation systems, and chatbots. It is configurable via YAML and can be integrated into CI pipelines for automated testing.

Good fit when

  • Unverified catalog guidance: When you need a framework that is specifically designed for testing large language models, retrieval-augmented generation systems, and chatbots.
  • Unverified catalog guidance: If your project requires integration with CI pipelines for automated testing, and you prefer configuration via YAML files.

Avoid when

  • Unverified catalog guidance: If your testing requirements do not align with the specific focus on large language models, retrieval-augmented generation systems, and chatbots.
  • Unverified catalog guidance: If you prefer a testing tool that does not require YAML configuration or CI pipeline integration.
Requirements:
Requires Python environment.; Supports integration with CI pipelines.

Observed Sep 30, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (674d since push)
As of Oct 17, 2026
Provenance
Not a fork · Organization account
As of Oct 17, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/addepto/contextcheck
Source repository

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

MIT-licensed framework for testing large language models, retrieval-augmented generation systems, and chatbots. Configurable via YAML and can be integrated into CI pipelines for automated testing.

Capability facts

CLI
Declared CLI entrypoint

Source: pyproject.toml:[tool.poetry.scripts] · Oct 17, 2026

MCP server
Unknown; MCP server not established by this scan

Source: repo_scan · Oct 17, 2026

Languages
python

Source: github.language+pyproject.toml · Oct 17, 2026

Categories

Tags

README

License This project is licensed under the MIT License see the LICENSE file for details

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.