Home/Model Training/agent-learning-kit
agent-learning-kit logo

agent-learning-kit

Enrichment pending
future-agi/agent-learning-kit

Evaluation Framework for all your AI related Workflows

GraphCanon updated today · GitHub synced today

113
Stars
42
Forks
4
Open issues
1
Watchers
1w
Last push
Python Apache-2.0Created Jun 11, 2025

Trust & integrity

Full report
Maintenance
Active (11d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Organization account
As of today · Source: github_public_v1
Security (OSV)
No lockfile
As of today · Source: none

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

Evaluation Framework for all your AI related Workflows

Capability facts

Languages
python

Source: github.language · Jul 11, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Jul 11, 2026)

**Requirements:** Python 3.10+
Source link

Tags

README

Installation

pip install ai-evaluation

Optional extras:

pip install ai-evaluation[nli]        # DeBERTa NLI model for faithfulness/hallucination
pip install ai-evaluation[embeddings] # sentence-transformers for embedding similarity
pip install ai-evaluation[feedback]   # ChromaDB for feedback loop
pip install ai-evaluation[celery]     # Celery distributed backend
pip install ai-evaluation[ray]        # Ray distributed backend
pip install ai-evaluation[temporal]   # Temporal distributed backend
pip install ai-evaluation[all]        # Everything

Requirements: Python 3.10+



Quick Start

from fi.evals import evaluate