PHUDGE
Evaluation toolkit for LLM responses with scalable grading and hallucination detection.
GraphCanon updated Oct 19, 2026 · GitHub synced Oct 19, 2026
Decision brief
Unverified catalog guidance: PHUDGE grades LLM responses using scalable configurations with custom rubrics and reference answers for both relative and absolute grading.
Good fit when
- Unverified catalog guidance: Need robust evaluation of LLM responses on a scale from one to five
- Unverified catalog guidance: Require scalable hallucination detection in LLM outputs
Avoid when
- Unverified catalog guidance: Looking for real-time deployment without setup for different environments
- Unverified catalog guidance: Need support for models not compatible with Phi-3 architecture
- Pricing:
- freemium - Primary model is free; potential costs associated with training and running on specific hardware.
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Dormant (830d since push)
- As of Oct 19, 2026
- Provenance
- Not a fork · Personal account
- As of Oct 19, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/deshwalmahesh/phudgeSource repositorySimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
PHUDGE is a model designed to evaluate language model responses on a scale from one to five using various configurations including custom rubrics and reference answers, focusing on both relative and absolute grading. The project offers tools for training, evaluation, and deployment of this model.
Capability facts
- MCP server
- Unknown; MCP server not established by this scan
Source: repo_scan · Oct 19, 2026
- Languages
- jupyter notebook
Source: github.language · Oct 19, 2026
Categories
Tags
README
PHUDG3: Phi 3 as Scalable Judge is for The Legend himself Paper Link What is it? A robust production grade and scalable SOTA (4 Benchmarks) model for Relative and Absolute grading of LLM (as well human) responses. What it can do? Given a question and it's response, it can judge t...
For agents
This page has a .md twin and JSON over the API.