Comparison
evalml vs agent-learning-kit
Verdict
Pick evalml if evalML serves Python users seeking automated machine learning services with streamlined feature engineering, selection, and hyperparameter tuning, underpinned by the BSD-3-Clause license; pick agent-learning-kit if agent-learning-kit is a Python framework for evaluating AI-related workflows with modules for faithfulness assessment, embedding similarity analysis, and feedback loop integration via ChromaDB.
Markdown twin · evalml alternatives · agent-learning-kit alternatives
GraphCanon updated 2w
Trust & integrity
| Signal | evalml | agent-learning-kit |
|---|---|---|
| Maintenance | Slowing (201d since push) As of 2w · github_public_v1 | Very active (0d since push) As of 3w · github_public_v1 |
| Provenance | Not a fork · Organization account As of 2w · github_public_v1 | Not a fork · Organization account As of 3w · github_public_v1 |
| OSV dependency advisories | No lockfile (source not queried) As of 1mo · osv@v1 | No lockfile (source not queried) As of 1mo · osv@v1 |
| deps.dev advisories | Not queried deps.dev@v1 | Not queried deps.dev@v1 |
| OpenSSF Scorecard | Not queried openssf-scorecard@v1 | Not queried openssf-scorecard@v1 |
Tagline
- evalml
- An AutoML library written in Python
- agent-learning-kit
- Evaluation Framework for all your AI related Workflows
Stars
- evalml
- 852
- agent-learning-kit
- 118
Forks
- evalml
- 93
- agent-learning-kit
- 43
Open issues
- evalml
- 324
- agent-learning-kit
- 6
Language
- evalml
- Python
- agent-learning-kit
- Python
Adopt for
- evalml
- EvalML serves Python users seeking automated machine learning services with streamlined feature engineering, selection, and hyperparameter tuning, underpinned by the BSD-3-Clause license.
- agent-learning-kit
- Agent-learning-kit is a Python framework for evaluating AI-related workflows with modules for faithfulness assessment, embedding similarity analysis, and feedback loop integration via ChromaDB.
Persona
- evalml
- -
- agent-learning-kit
- -
Runtime
- evalml
- -
- agent-learning-kit
- -
License
- evalml
- EvalML uses the BSD-3-Clause license which allows free use, modification, and distribution but requires preservation of copyright notices.
- agent-learning-kit
- Apache-2.0
Last pushed
- evalml
- Jan 14, 2026
- agent-learning-kit
- Aug 1, 2026
Categories
- evalml
- Evaluation & Observability, Model Training
- agent-learning-kit
- Evaluation & Observability
Trust and health
Maintenance
- evalml
- Slowing (36%)
- agent-learning-kit
- Very active (96%)
Days since push
- evalml
- 201d
- agent-learning-kit
- 0d
Open issues (now)
- evalml
- 324
- agent-learning-kit
- 6
Full report
- evalml
- Trust report
- agent-learning-kit
- Trust report
Shared compatibility
- Python · evalml: Python runtime · agent-learning-kit: Python runtime
Choose evalml if…
- License: evalml is BSD-3-Clause, agent-learning-kit is Apache-2.0.
- Pricing: Access to features comes at no cost due to its open-source nature; however, premium support can be purchased..
- Requirements: Min 2 GB RAM.
- Tags unique to evalml: automl, data-science, feature-engineering, feature-selection.
- Also covers Model Training.
- You value an intuitive API for automating model training processes in Python contexts where feature engineering and selection are critical.
When NOT to use evalml
- You require deep customization of feature engineering processes that go beyond what EvalML automates out-of-the-box.
- Your team prefers tools that offer more advanced explainability features for model decisions and behavior analysis, as this is a focus area lacking specific mention in EvalML's capabilities.
Choose agent-learning-kit if…
- License: agent-learning-kit is Apache-2.0, evalml is BSD-3-Clause.
- Tags unique to agent-learning-kit: ai-agents, ci-cd, evaluation, ml.
- When you need comprehensive evaluation of your AI models including faithfulness checks using DeBERTa NLI model installed.
When NOT to use agent-learning-kit
- If your workflow does not align with the specific evaluation criteria and methods supported by agent-learning-kit.
- When you seek a framework that integrates with backend systems other than those provided as optional extras, such as MongoDB or DynamoDB instead of ChromaDB.
Explore
Sources
Every stat on this page traces to a dated GitHub sync, license file, enrichment field, or trust scan.
- GitHub stars (alteryx/evalml) · observed Aug 4, 2026
- GitHub forks (alteryx/evalml) · observed Aug 4, 2026
- Last push (alteryx/evalml) · observed Jan 14, 2026
- License file (BSD-3-Clause) · observed Aug 4, 2026
- Decision facts (enrichment) · observed Jul 17, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
- GitHub stars (future-agi/agent-learning-kit) · observed Aug 1, 2026
- GitHub forks (future-agi/agent-learning-kit) · observed Aug 1, 2026
- Last push (future-agi/agent-learning-kit) · observed Aug 1, 2026
- License file (Apache-2.0) · observed Aug 1, 2026
- Decision facts (enrichment) · observed Jul 14, 2026
- Trust scan (lockfile / OSV) · observed Jul 11, 2026
GitHub stars on cards: evalml 852 · agent-learning-kit 118 (synced Aug 4, 2026).
Common questions
- What is the difference between evalml and agent-learning-kit?
- evalml: An AutoML library written in Python. agent-learning-kit: Evaluation Framework for all your AI related Workflows. See the comparison table for live GitHub stats and shared categories.
- When should I choose evalml over agent-learning-kit?
- Choose evalml over agent-learning-kit when License: evalml is BSD-3-Clause, agent-learning-kit is Apache-2.0; Pricing: Access to features comes at no cost due to its open-source nature; however, premium support can be purchased.; Requirements: Min 2 GB RAM; Tags unique to evalml: automl, data-science, feature-engineering, feature-selection; Also covers Model Training; You value an intuitive API for automating model training processes in Python contexts where feature engineering and selection are critical.
- When should I choose agent-learning-kit over evalml?
- Choose agent-learning-kit over evalml when License: agent-learning-kit is Apache-2.0, evalml is BSD-3-Clause; Tags unique to agent-learning-kit: ai-agents, ci-cd, evaluation, ml; When you need comprehensive evaluation of your AI models including faithfulness checks using DeBERTa NLI model installed.
- When should I avoid evalml?
- You require deep customization of feature engineering processes that go beyond what EvalML automates out-of-the-box. Your team prefers tools that offer more advanced explainability features for model decisions and behavior analysis, as this is a focus area lacking specific mention in EvalML's capabilities.
- When should I avoid agent-learning-kit?
- If your workflow does not align with the specific evaluation criteria and methods supported by agent-learning-kit. When you seek a framework that integrates with backend systems other than those provided as optional extras, such as MongoDB or DynamoDB instead of ChromaDB.
- Is evalml or agent-learning-kit more popular on GitHub?
- evalml has more GitHub stars (852 vs 118). Stars measure visibility, not whether either tool fits your constraints.
- Are evalml and agent-learning-kit open source?
- Yes - both are open-source projects on GitHub (evalml: BSD-3-Clause, agent-learning-kit: Apache-2.0).
- Where can I find alternatives to evalml or agent-learning-kit?
- GraphCanon lists graph-backed alternatives at evalml alternatives and agent-learning-kit alternatives (evalml markdown twin, agent-learning-kit markdown twin), ranked by typed relationship edges rather than popularity votes.
- Is there a machine-readable version of this comparison?
- Yes. The markdown twin at this comparison mirrors this page for agents and LLM crawlers, with the same stats table and FAQ answers.
- Which is better maintained, evalml or agent-learning-kit?
- evalml: Slowing. agent-learning-kit: Very active. Compare maintenance labels, days since push, and release cadence in the trust section below - stars alone do not measure maintenance.
- Where are the full trust reports for evalml and agent-learning-kit?
- GraphCanon publishes per-repo trust reports with dated maintenance, provenance, and scan summaries: evalml trust report; agent-learning-kit trust report.