just-eval
A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.
GraphCanon updated Oct 18, 2026 · GitHub synced Oct 18, 2026
Decision brief
Unverified catalog guidance: just-eval provides a straightforward GPT-based framework for evaluating LLMs across multiple dimensions with clear outputs.
Good fit when
- Unverified catalog guidance: When your team requires an in-depth yet interpretable evaluation of LLM performance, focusing on various aspects.
- Unverified catalog guidance: If you aim to leverage GPT technology for assessing the quality and reliability of language models without complex setup procedures.
Avoid when
- Unverified catalog guidance: Avoid if direct integration with competing API services is needed as just-eval focuses solely on OpenAI API key configuration.
- Unverified catalog guidance: Not suitable when your project demands a custom evaluation framework that extends beyond simple GPT-based assessments.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (992d since push)
- As of Oct 18, 2026
- Provenance
- Not a fork · Organization account
- As of Oct 18, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/re-align/just-evalSource repositorySimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
just-eval is an evaluation toolkit based on GPT technology designed to assess language models across multiple dimensions in an understandable way.
Capability facts
- MCP server
- Unknown; MCP server not established by this scan
Source: repo_scan · Oct 18, 2026
- Languages
- python
Source: github.language · Oct 18, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (readme_declaration_v2, Oct 18, 2026)
pip install .Source link
Tags
README
Installation or Setup OpenAI API Key
For agents
This page has a .md twin and JSON over the API.