ART

OpenPipe/ART

Agent Reinforcement Trainer

10k
Stars
937
Forks
121
Open issues
67
Watchers
Python Apache-2.0Last pushed Jul 7, 2026

Overview

OpenPipe's ART is an open-source RL framework for training multi-step agents using GRPO, designed to enhance the reliability of LLMs through experience learning.

Categories

Tags

Relationships

Similar tools

Install

pip install ART

README

ART logo

Agent Reinforcement Trainer

Train multi-step agents for real-world tasks using GRPO.

[![PRs-Welcome][contribute-image]][contribute-url] [][pypi-url]

🚀 W&B Training: Serverless RL

W&B Training (Serverless RL) is the first publicly available service for flexibly training models with reinforcement learning. It manages your training and inference infrastructure automatically, letting you focus on defining your data, environment and reward function—leading to faster feedback cycles, lower costs, and far less DevOps.

Key Benefits:

  • 40% lower cost - Multiplexing on shared production-grade inference cluster
  • 28% faster training - Scale to 2000+ concurrent requests across many GPUs
  • Zero infra headaches - Fully managed infrastructure that stays healthy
  • Instant deployment - Every checkpoint instantly available via W&B Inference
# Before: Hours of GPU setup and infra management
# RuntimeError: CUDA error: out of memory 😢

# After: Serverless RL with instant feedback
from art.serverless.backend import ServerlessBackend

model = art.TrainableModel(
  project="voice-agent",
  name="agent-001",
  base_model="Qwen/Qwen3.6-27B"
)

backend = ServerlessBackend(
    api_key="your_wandb_api_key"
)
model.register(backend)
# Edit and iterate in minutes, not hours!

📖 Learn more about W&B Training →

ART Overview

ART is an open-source RL framework that improves agent reliability by allowing LLMs to learn from experience. ART provides an ergonomic harness for integrating GRPO into any python application. For a quick hands-on introduction, run one of the notebooks below. When you're ready to learn more, check out the docs.

📒 Notebooks

Agent TaskExample NotebookDescriptionComparative Performance
ART•E [Serverless]🏋️ Train agentQwen 3.6 27B learns to search emails using RULER benchmarks
2048 [Serverless]🏋️ Train agentQwen 3.6 27B learns to play 2048 benchmarks
ART•E LangGraph🏋️ Train agentQwen 2.5 7B learns to search emails using LangGraph[Link coming s