just-eval
A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
36views this month
Decision brief
just-eval provides a straightforward GPT-based framework for evaluating LLMs across multiple dimensions with clear outputs.
Good fit when
- When your team requires an in-depth yet interpretable evaluation of LLM performance, focusing on various aspects.
- If you aim to leverage GPT technology for assessing the quality and reliability of language models without complex setup procedures.
Avoid when
- Avoid if direct integration with competing API services is needed as just-eval focuses solely on OpenAI API key configuration.
- Not suitable when your project demands a custom evaluation framework that extends beyond simple GPT-based assessments.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (953d since push)
- As of Sep 9, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 9, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install just-evalSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
just-eval is an evaluation toolkit based on GPT technology designed to assess language models across multiple dimensions in an understandable way.
Capability facts
- Languages
- python
Source: github.language · Sep 9, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 9, 2026)
***Setup OpenAI API Key***Source link
Tags
README
Installation or Setup OpenAI API Key
For agents
This page has a .md twin and JSON over the API.