Home/Compare/deepeval vs just-eval

Comparison

deepeval vs just-eval

Verdict

Unverified catalog guidance: deepeval: Deepeval is a Python-based framework designed for evaluating large language models with an array of metrics and evaluation methodologies. just-eval: just-eval provides a straightforward GPT-based framework for evaluating LLMs across multiple dimensions with clear outputs.

Markdown twin · deepeval alternatives · just-eval alternatives

GraphCanon updated Oct 18, 2026

deepeval logo

deepeval

confident-ai/deepeval

★ 18kpushed Sep 18, 2026
vs
just-eval logo

just-eval

Re-Align/just-eval

★ 90pushed Jan 29, 2024

Trust & integrity

Signaldeepevaljust-eval
Maintenance
Very active (1d since push)
As of Sep 20, 2026 · github_public_v1
Dormant (992d since push)
As of Oct 18, 2026 · github_public_v1
Provenance
Not a fork · Organization account
As of Sep 20, 2026 · github_public_v1
Not a fork · Organization account
As of Oct 18, 2026 · github_public_v1
OSV dependency advisories
No lockfile (source not queried)
As of Jul 11, 2026 · osv@v1
No lockfile (source not queried)
As of Jul 15, 2026 · osv@v1
deps.dev advisories
Not queried
deps.dev@v1
Not queried
deps.dev@v1
OpenSSF Scorecard
Not queried
openssf-scorecard@v1
Not queried
openssf-scorecard@v1

Tagline

deepeval
LLM Evaluation Framework.
just-eval
A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.

Stars

deepeval
18k
just-eval
90

Forks

deepeval
2.0k
just-eval
7

Open issues

deepeval
624
just-eval
2

Language

deepeval
Python
just-eval
Python

Adopt for

deepeval
Unverified catalog guidance: Deepeval is a Python-based framework designed for evaluating large language models with an array of metrics and evaluation methodologies.
just-eval
Unverified catalog guidance: just-eval provides a straightforward GPT-based framework for evaluating LLMs across multiple dimensions with clear outputs.

Persona

deepeval
-
just-eval
-

Runtime

deepeval
-
just-eval
-

License

deepeval
Apache-2.0 License
just-eval
MIT

Last pushed

deepeval
Sep 18, 2026
just-eval
Jan 29, 2024

Categories

deepeval
Evaluation & Observability
just-eval
Evaluation & Observability

Trust and health

Maintenance

deepeval
Very active (96%)
just-eval
Dormant (18%)

Days since push

deepeval
1d
just-eval
992d

Open issues (recorded)

deepeval
624
just-eval
2

Stars delta

deepeval
+1.1k (30d)
just-eval
0 (30d)

Open issues delta

deepeval
+220 (30d)
just-eval
0 (30d)

Full report

deepeval
Trust report
just-eval
Trust report

Shared compatibility

  • Python · deepeval: Python runtime · just-eval: Documented Python runtime (not runtime-tested)

Choose deepeval if…

  • License: deepeval is Apache-2.0, just-eval is MIT.
  • Requirements: Requires Python environment and familiarity with large language models to effectively utilize Deepeval's capabilities..
  • Tags unique to deepeval: metrics.
  • Unverified catalog guidance: When developing large language models and you need a comprehensive evaluation framework to measure their performance across various metrics.

When NOT to use deepeval

  • Unverified catalog guidance: For small-scale applications that do not require the depth of metrics and evaluations offered by Deepeval, as it might be overkill.
  • Unverified catalog guidance: In situations where there is a need for real-time performance monitoring, since Deepeval focuses more on post-development evaluation rather than continuous runtime analysis.

Choose just-eval if…

  • License: just-eval is MIT, deepeval is Apache-2.0.
  • Tags unique to just-eval: gpt4, llm, llm-eval, llm-evaluation-toolkit.
  • Unverified catalog guidance: When your team requires an in-depth yet interpretable evaluation of LLM performance, focusing on various aspects.

When NOT to use just-eval

  • Unverified catalog guidance: Avoid if direct integration with competing API services is needed as just-eval focuses solely on OpenAI API key configuration.
  • Unverified catalog guidance: Not suitable when your project demands a custom evaluation framework that extends beyond simple GPT-based assessments.

Explore

Sources

Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.

GitHub stars on cards: deepeval 18k · just-eval 90 (synced Sep 20, 2026).

Common questions

What is the difference between deepeval and just-eval?
deepeval: LLM Evaluation Framework.. just-eval: A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.. See the comparison table for recorded GitHub metadata and shared categories.
When should I choose deepeval over just-eval?
For deepeval, compare these recorded points with just-eval: License: deepeval is Apache-2.0, just-eval is MIT; Requirements: Requires Python environment and familiarity with large language models to effectively utilize Deepeval's capabilities.; Tags unique to deepeval: metrics; Unverified catalog guidance: When developing large language models and you need a comprehensive evaluation framework to measure their performance across various metrics.
When should I choose just-eval over deepeval?
For just-eval, compare these recorded points with deepeval: License: just-eval is MIT, deepeval is Apache-2.0; Tags unique to just-eval: gpt4, llm, llm-eval, llm-evaluation-toolkit; Unverified catalog guidance: When your team requires an in-depth yet interpretable evaluation of LLM performance, focusing on various aspects.
When should I avoid deepeval?
Unverified catalog guidance: For small-scale applications that do not require the depth of metrics and evaluations offered by Deepeval, as it might be overkill. Unverified catalog guidance: In situations where there is a need for real-time performance monitoring, since Deepeval focuses more on post-development evaluation rather than continuous runtime analysis.
When should I avoid just-eval?
Unverified catalog guidance: Avoid if direct integration with competing API services is needed as just-eval focuses solely on OpenAI API key configuration. Unverified catalog guidance: Not suitable when your project demands a custom evaluation framework that extends beyond simple GPT-based assessments.
Is deepeval or just-eval more popular on GitHub?
deepeval has more recorded GitHub stars (18,342 vs 90). Stars measure visibility, not whether either tool fits your constraints.
Which licenses are recorded for deepeval and just-eval?
deepeval: Apache-2.0. just-eval: MIT. Check each repository's current license and terms before use. Public GitHub hosting alone does not establish open-source licensing.
Where can I find alternatives to deepeval or just-eval?
GraphCanon lists candidates at deepeval alternatives and just-eval alternatives (deepeval markdown twin, just-eval markdown twin). The discovery order uses stored relationship proposals and shared categories; it is not a verified replacement ranking.
Is there a machine-readable version of this comparison?
Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
Which is better maintained, deepeval or just-eval?
deepeval: Very active. just-eval: Dormant. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
Where are the full trust reports for deepeval and just-eval?
GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: deepeval trust report; just-eval trust report.

Was this helpful?

Anonymous feedback helps us improve pages and translations.