ART
OpenPipe/ART
Agent Reinforcement Trainer
Overview
OpenPipe's ART is an open-source RL framework for training multi-step agents using GRPO, designed to enhance the reliability of LLMs through experience learning.
Categories
Tags
Relationships
Similar tools
AutoGPT
Significant-Gravitas/AutoGPT
AutoGPT: Build, Deploy, and Run AI Agents
ollama
ollama/ollama
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
transformers
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models
langflow
langflow-ai/langflow
Langflow is a powerful platform for building and deploying AI-powered agents and workflows.
Install
pip install ARTREADME
Agent Reinforcement Trainer
Train multi-step agents for real-world tasks using GRPO.
[![PRs-Welcome][contribute-image]][contribute-url] [][pypi-url]
🚀 W&B Training: Serverless RL
W&B Training (Serverless RL) is the first publicly available service for flexibly training models with reinforcement learning. It manages your training and inference infrastructure automatically, letting you focus on defining your data, environment and reward function—leading to faster feedback cycles, lower costs, and far less DevOps.
✨ Key Benefits:
- 40% lower cost - Multiplexing on shared production-grade inference cluster
- 28% faster training - Scale to 2000+ concurrent requests across many GPUs
- Zero infra headaches - Fully managed infrastructure that stays healthy
- Instant deployment - Every checkpoint instantly available via W&B Inference
# Before: Hours of GPU setup and infra management
# RuntimeError: CUDA error: out of memory 😢
# After: Serverless RL with instant feedback
from art.serverless.backend import ServerlessBackend
model = art.TrainableModel(
project="voice-agent",
name="agent-001",
base_model="Qwen/Qwen3.6-27B"
)
backend = ServerlessBackend(
api_key="your_wandb_api_key"
)
model.register(backend)
# Edit and iterate in minutes, not hours!
📖 Learn more about W&B Training →
ART Overview
ART is an open-source RL framework that improves agent reliability by allowing LLMs to learn from experience. ART provides an ergonomic harness for integrating GRPO into any python application. For a quick hands-on introduction, run one of the notebooks below. When you're ready to learn more, check out the docs.
📒 Notebooks
| Agent Task | Example Notebook | Description | Comparative Performance |
|---|---|---|---|
| ART•E [Serverless] | 🏋️ Train agent | Qwen 3.6 27B learns to search emails using RULER | |
| 2048 [Serverless] | 🏋️ Train agent | Qwen 3.6 27B learns to play 2048 | |
| ART•E LangGraph | 🏋️ Train agent | Qwen 2.5 7B learns to search emails using LangGraph | [Link coming s |