paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting at scale
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
49views this month
Decision brief
Paddler offers a streamlined approach to serve LLMs/VLMs with minimal setup complexity, focusing on scaling through simplicity.
Good fit when
- Need a platform that simplifies deployments around the ggml ecosystem for self-hosting at scale
- Prefer single-binary deployment and less dependency management compared to alternatives like llm-d or Docker Model Runner
Avoid when
- Require extensive customization options in model serving infrastructure that Paddler's minimalistic design does not support
- Seek complex feature sets beyond simple scale-out capabilities, which might be found in more comprehensive platforms
Observed Jul 12, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (2d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- No criticals
- As of Jul 11, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
cargo add paddlerHow it fits your stack(11)
Typed graph edges - alternatives, integrations, successors, and dependencies. Ranked by relationship type, not raw GitHub stars.
Alternative
Integrates
Depends on
Relationship graph
Optional deeper exploration of typed edges and category neighbours.
Similar tools
Same-category neighbours not already linked as typed edges.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Platform for hosting Large Language Models (LLMs) and Visual Language Models (VLMs) with a focus on simplicity in deployment, built around the ggml ecosystem.
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Sep 20, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Sep 20, 2026
- MCP server
- No MCP server detected
Source: repo_scan · Sep 20, 2026
- Languages
- rust, javascript, typescript
Source: github.language+package.json · Sep 20, 2026
Categories
Tags
README
Installation and Quickstart Paddler is self contained in a single binary file, so all you need to do to start using it is obtain the binary and make it available in your system. You can obtain the binary by: Option 1: Downloading the latest release from our GitHub releases Option...
For agents
This page has a .md twin and JSON over the API.