dynamo logo

dynamo

ai-dynamo/dynamo

A Datacenter Scale Distributed Inference Serving Framework

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

78views this month

8.1k stars1.6k forksLast push Sep 19, 2026 Rust Other

Decision brief

Dynamo is a Rust-built framework for large-scale distributed inference serving, aimed at efficient management and deployment of machine learning models in a datacenter environment.

Good fit when

  • When you are working with high-throughput, low-latency requirements using Kubernetes.
  • For projects that leverage diffusion models or require disaggregated-serving capabilities.

Avoid when

  • If your project is not compatible with Rust and you face limitations in leveraging the dynamo's full potential without a strong Rust support team on hand.
  • In scenarios where fine-grained model management is less important than ease of use or when a more universally-supported language (like Python) is required.

Observed Jul 12, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (0d since push)
As of Sep 19, 2026
Provenance
Not a fork · Organization account
As of Sep 19, 2026
Security (OSV)
No lockfile
As of Jul 11, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

cargo add dynamo
crates.io

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Dynamo is a framework designed for large-scale distributed inference serving, primarily implemented in Rust and focusing on efficient handling of machine learning models.

Capability facts

Languages
rust, python

Source: github.language+pyproject.toml · Sep 19, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 19, 2026)

ld-essential libhwloc-dev libudev-dev pkg-config libclang-dev protobuf-compiler python3-dev cmake
Source link
Works with CursorCursor

Source: README excerpt (regex_v1, Sep 19, 2026)

> Cursor), clone the repo and ask it to deploy, troubleshoot, benchmark, or optimize a D
Source link

Tags

README

Quick Start This repo ships agent skills: if you work with an AI coding agent (Claude Code, Codex, Cursor), clone the repo and ask it to deploy, troubleshoot, benchmark, or optimize a Dynamo deployment. The skills activate automatically; no setup required. Option B: Install from...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.