litmus
A comprehensive LLM testing and evaluation tool for GenAI application development with user-friendly UI
GraphCanon updated Oct 19, 2026 · GitHub synced Oct 19, 2026
Decision brief
Unverified catalog guidance: Litmus is an extensive GenAI application development platform for testing and evaluating LLM performance, featuring a user-friendly UI and deployment flexibility via CLI or manual setup.
Good fit when
- Unverified catalog guidance: When deploying on Google Cloud with the need for CLI ease of use
- Unverified catalog guidance: For comprehensive evaluation methods like Custom LLM Evaluation, Ragas, DeepEval
Avoid when
- Unverified catalog guidance: In environments not using Google Cloud services and APIs
- Unverified catalog guidance: When manual setup for each component outweighs potential benefits of automation provided by Litmus CLI
Observed Jul 16, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Slowing (203d since push)
- As of Oct 19, 2026
- Provenance
- Not a fork · Organization account
- As of Oct 19, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Backing
Company context for Google. Display-only - separate from trust and ranking.
- Company
- Google·GitHub org profile·Jul 11, 2026
- Employees
- 47,756·Wikidata (P1128 employees)·Jul 11, 2026
- Commercial model
- Pure OSS·GitHub org profile (public repos)·Jul 11, 2026
Install
Package installation is not established from the available documentation. Check the source repository for setup instructions.
git clone https://github.com/google/litmusSource repositorySimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Litmus is an all-inclusive platform aimed at developing and evaluating the performance of AI applications powered by large language models.
Capability facts
- Docker
- Docker configuration present
Source: dockerfile:proxy/Dockerfile · Oct 19, 2026
- MCP server
- Unknown; MCP server not established by this scan
Source: repo_scan · Oct 19, 2026
- Languages
- vue, javascript, typescript
Source: github.language+docs/package.json+api/ui/package.json · Oct 19, 2026
Categories
Graph entities
Tags
README
Getting Started 1. Quick Deployment with the Litmus CLI: This is the easiest way to set up Litmus. Make sure you have the Google Cloud SDK installed and configured with the correct project. Install the Litmus CLI: Linux : install: binary: https://storage.googleapis.com/litmus clo...
For agents
This page has a .md twin and JSON over the API.