PHUDGE logo

PHUDGE

deshwalmahesh/PHUDGE

Evaluation toolkit for LLM responses with scalable grading and hallucination detection.

GraphCanon updated Oct 19, 2026 · GitHub synced Oct 19, 2026

53 stars7 forksLast push Jul 10, 2024 Jupyter Notebook

Decision brief

Unverified catalog guidance: PHUDGE grades LLM responses using scalable configurations with custom rubrics and reference answers for both relative and absolute grading.

Good fit when

  • Unverified catalog guidance: Need robust evaluation of LLM responses on a scale from one to five
  • Unverified catalog guidance: Require scalable hallucination detection in LLM outputs

Avoid when

  • Unverified catalog guidance: Looking for real-time deployment without setup for different environments
  • Unverified catalog guidance: Need support for models not compatible with Phi-3 architecture
Pricing:
freemium - Primary model is free; potential costs associated with training and running on specific hardware.

Observed Jul 16, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (830d since push)
As of Oct 19, 2026
Provenance
Not a fork · Personal account
As of Oct 19, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/deshwalmahesh/phudge
Source repository

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

PHUDGE is a model designed to evaluate language model responses on a scale from one to five using various configurations including custom rubrics and reference answers, focusing on both relative and absolute grading. The project offers tools for training, evaluation, and deployment of this model.

Capability facts

MCP server
Unknown; MCP server not established by this scan

Source: repo_scan · Oct 19, 2026

Languages
jupyter notebook

Source: github.language · Oct 19, 2026

Categories

Tags

README

PHUDG3: Phi 3 as Scalable Judge is for The Legend himself Paper Link What is it? A robust production grade and scalable SOTA (4 Benchmarks) model for Relative and Absolute grading of LLM (as well human) responses. What it can do? Given a question and it's response, it can judge t...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.