leva

kieranklaassen/leva

LLM Evaluation Framework for Rails apps

GitHub

GraphCanon updated 3w · GitHub synced 3w

142 stars7 forksLast push 2mo Ruby MIT

Decision brief

Leva is an LLM evaluation framework for Ruby on Rails apps, aiming to use production data directly in the evaluation process.

Good fit when

You are working with Ruby on Rails applications and need a tool specific to this environment
Integration into existing production data flows within Rails applications is desired

Avoid when

If your application is not built using Ruby on Rails, Leva may not be the best fit
For scenarios requiring broader cross-platform support or with non-Rails production data integration needs, consider other tools

Observed Jul 16, 2026 · Source: enrich:decision_facts

leva alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Steady (55d since push); As of 3w
Provenance: Not a fork · Personal account; As of 3w
Security (OSV): No lockfile; As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

gem install leva

RubyGems

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

evals

Framework for evaluating LLMs and LLM systems with an open-source registry of benchmarks.

19k★

deepeval

LLM Evaluation Framework.

17k★

lm-evaluation-harness

A framework for few-shot evaluation of language models.

14k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Leva is an LLM evaluation framework built with Ruby on Rails to help evaluate language models using production data.

Capability facts

Languages: ruby
Source: github.language · Jul 29, 2026

README

Installation

Add this line to your application's Gemfile:

gem 'leva'

And then execute:

bundle install

Add the migrations to your database:

rails leva:install:migrations
rails db:migrate

Mount the Leva engine in your application's routes file:


---

### Installation

Add the DSPy gems to your Gemfile:

```ruby
gem "dspy"           # Core DSPy functionality (required)
gem "dspy-ruby_llm"  # RubyLLM provider adapter (required)
gem "dspy-gepa"      # GEPA optimizer (optional, recommended)
gem "dspy-miprov2"   # MIPROv2 optimizer (optional)

You can use any DSPy provider adapter instead of dspy-ruby_llm, such as dspy-openai or dspy-anthropic.

License

The gem is available as open source under the terms of the MIT License.

For agents

This page has a .md twin and JSON over the API.

/tools/kieranklaassen-leva.md GET /api/graphcanon/tools/kieranklaassen-leva GET /api/graphcanon/graph?tool=kieranklaassen-leva