Home/Inference & Serving/paddler

paddler

intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting at scale

GitHub Website

GraphCanon updated today · GitHub synced today · 28 views this month

1.7k stars97 forksLast push 1mo Rust Apache-2.0

Decision brief

Paddler offers a streamlined approach to serve LLMs/VLMs with minimal setup complexity, focusing on scaling through simplicity.

Good fit when

Need a platform that simplifies deployments around the ggml ecosystem for self-hosting at scale
Prefer single-binary deployment and less dependency management compared to alternatives like llm-d or Docker Model Runner

Avoid when

Require extensive customization options in model serving infrastructure that Paddler's minimalistic design does not support
Seek complex feature sets beyond simple scale-out capabilities, which might be found in more comprehensive platforms

Observed Jul 12, 2026 · Source: enrich:decision_facts

paddler alternatives Trust report

paddler vs ollama paddler vs sglang paddler vs vllm

Verify the decision

Maintenance and security

Full trust report

Maintenance: Steady (31d since push); As of today
Provenance: Not a fork · Organization account; As of today
Security (OSV): No criticals; As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

cargo add paddler

crates.io

How it fits your stack(11)

Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.

Relationship graph

Optional deeper exploration of typed edges and category neighbours.

AlternativeIntegratesDepends on

AlternativeIntegratesDepends on

Similar tools

Same-category neighbours not already linked as typed edges.

llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

32k★

open-llms

A list of open LLMs available for commercial use.

13k★

awesome-generative-ai

A curated list of modern Generative Artificial Intelligence projects and services

13k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Platform for hosting Large Language Models (LLMs) and Visual Language Models (VLMs) with a focus on simplicity in deployment, built around the ggml ecosystem.

Capability facts

Deploy: Self-host
Source: dockerfile:Dockerfile · Aug 20, 2026
Docker: Dockerfile present
Source: dockerfile:Dockerfile · Aug 20, 2026
MCP server: No MCP server detected
Source: repo_scan · Aug 20, 2026
Languages: rust, javascript, typescript
Source: github.language+package.json · Aug 20, 2026

README

Installation and Quickstart

Paddler is self-contained in a single binary file, so all you need to do to start using it is obtain the paddler binary and make it available in your system.

You can obtain the binary by:

Option 1: Downloading the latest release from our GitHub releases
Option 2: Or building Paddler from source (MSRV is 1.88.0)

For agents

This page has a .md twin and JSON over the API.

/tools/intentee-paddler.md GET /api/graphcanon/tools/intentee-paddler GET /api/graphcanon/graph?tool=intentee-paddler