oumi logo

oumi

oumi-ai/oumi

Easily fine-tune, evaluate and deploy open source LLMs/VLMs

GraphCanon updated 2d · GitHub synced 2d

9.4k stars784 forksLast push 3d Python Apache-2.0

Decision brief

Oumi is a tool for fine-tuning, evaluating, and deploying open-source large language models (LLMs) such as Gemma 4, Qwen3.5, Qwen3.6, gpt-oss, DeepSeek-R1, among others.

Good fit when

  • - You are working specifically with one of the supported open-source LLMs including Gemma 4 or Qwen variants.
  • - Your project requires a dedicated tool that offers specific fine-tuning and evaluation functionalities for a wide range of language models.

Avoid when

  • - If your focus is on proprietary models rather than open-source ones, Oumi may not offer the necessary support or integrations.
  • - You require deployment flexibility beyond what Oumi provides for less commonly supported open-source LLMs outside its primary focus (e.g., Gemma 4, Qwen series).
Requirements:
Requires Docker; Docker is used for standardized and portable environment deployments.

Observed Jul 12, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (1d since push)
As of 2d
Provenance
Not a fork · Organization account
As of 2d
Security (OSV)
No lockfile
As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

pip install oumi
PyPI

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

A comprehensive tool for the management and deployment of various open-source language models (LLMs) including Gemma 4, Qwen3.5, Qwen3.6, gpt-oss, DeepSeek-R1, among others.

Capability facts

Deploy
Self-host

Source: dockerfile:Dockerfile · Aug 23, 2026

Docker
Dockerfile present

Source: dockerfile:Dockerfile · Aug 23, 2026

CLI
CLI entrypoint

Source: pyproject.toml:[project.scripts] · Aug 23, 2026

Languages
python

Source: github.language+pyproject.toml · Aug 23, 2026

Categories

Tags

README

🚀 Getting Started

NotebookTry in ColabGoal
🎯 Getting Started: A TourOpen In ColabQuick tour of core features: training, evaluation, inference, and job management
🔧 Model Finetuning GuideOpen In ColabEnd-to-end guide to LoRA tuning with data prep, training, and evaluation
📚 Model DistillationOpen In ColabGuide to distilling large models into smaller, efficient ones
📋 Model EvaluationOpen In ColabComprehensive model evaluation using Oumi's evaluation framework
☁️ Remote TrainingOpen In ColabLaunch and monitor training jobs on cloud (AWS, Azure, GCP, Lambda, etc.) platforms
📈 LLM-as-a-JudgeOpen In ColabFilter and curate training data with built-in judges

Installation

Choose the installation method that works best for you:

Using pip (Recommended)

---

## 📜 License

This project is licensed under the Apache License 2.0. See the [LICENSE](LICENSE) file for details.

[^1]: Open models are defined as models with fully open weights, training code, and data, and a permissive license. See [Open Source Definitions](https://opensource.org/ai) for more information.

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.