just-eval logo

just-eval

Re-Align/just-eval

A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.

GraphCanon updated Oct 18, 2026 · GitHub synced Oct 18, 2026

90 stars7 forksLast push Jan 29, 2024 Python MIT

Decision brief

Unverified catalog guidance: just-eval provides a straightforward GPT-based framework for evaluating LLMs across multiple dimensions with clear outputs.

Good fit when

  • Unverified catalog guidance: When your team requires an in-depth yet interpretable evaluation of LLM performance, focusing on various aspects.
  • Unverified catalog guidance: If you aim to leverage GPT technology for assessing the quality and reliability of language models without complex setup procedures.

Avoid when

  • Unverified catalog guidance: Avoid if direct integration with competing API services is needed as just-eval focuses solely on OpenAI API key configuration.
  • Unverified catalog guidance: Not suitable when your project demands a custom evaluation framework that extends beyond simple GPT-based assessments.

Observed Jul 16, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (992d since push)
As of Oct 18, 2026
Provenance
Not a fork · Organization account
As of Oct 18, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/re-align/just-eval
Source repository

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

just-eval is an evaluation toolkit based on GPT technology designed to assess language models across multiple dimensions in an understandable way.

Capability facts

MCP server
Unknown; MCP server not established by this scan

Source: repo_scan · Oct 18, 2026

Languages
python

Source: github.language · Oct 18, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Documented Python runtime (not runtime-tested)Python

Source: README excerpt (readme_declaration_v2, Oct 18, 2026)

pip install .
Source link

Tags

README

Installation or Setup OpenAI API Key

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.