GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
47views this month
Decision brief
Mosec is a high-performance ML model serving framework that supports dynamic batching and CPU/GPU pipelines, making it suitable for environments where compute machine exploitation is critical.
Good fit when
- When you need to serve machine learning models with dynamic batching capabilities to optimize throughput.
- If your application requires support for both CPU and GPU pipelines to maximize hardware utilization.
Avoid when
- If your deployment setup requires Gunicorn or NGINX for load balancing or reverse proxying.
- When you do not need dynamic batching or have a simple model serving setup that does not benefit from CPU/GPU pipeline support.
- Requirements:
- Requires Docker; Requires Python 3.7 or above.; Supports installation via PyPI, conda, or pixi.; Building from source requires Rust.
Observed Sep 18, 2026 · Source: enrich:decision_facts
Verify the decision
Adoption
Package downloads where a registry match exists. GitHub stars (902) are secondary evidence.
- Docker Hub pulls (30d)
- 1,880·Docker Hub API·Sep 18, 2026
Maintenance and security
Full trust report- Maintenance
- Very active (0d since push)
- As of Sep 18, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 18, 2026
- Security (OSV)
- No lockfile
- As of Sep 18, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
pip install mosecSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Mosec is a framework for serving machine learning models with dynamic batching and support for CPU/GPU pipelines, enhancing compute machine exploitation.
Capability facts
- Deploy
- Self-host
Source: dockerfile:Dockerfile · Sep 18, 2026
- Docker
- Dockerfile present
Source: dockerfile:Dockerfile · Sep 18, 2026
- CLI
- CLI entrypoint
Source: pyproject.toml:[project.scripts] · Sep 18, 2026
- Languages
- python
Source: github.language+pyproject.toml · Sep 18, 2026
Categories
Compatibility
Sourced claims from the README excerpt - not unsourced marketing copy.
Source: README excerpt (regex_v1, Sep 18, 2026)
Mosec requires Python 3.7 or above. Install the latest [PyPI package](https://pypi.org/project/mosec/) foSource link
Tags
README
Installation Mosec requires Python 3.7 or above. Install the latest PyPI package for Linux or macOS with: To build from the source code, install Rust and run the following command: You will get a mosec wheel file in the folder. Deployment If you're looking for a GPU base image wi...
For agents
This page has a .md twin and JSON over the API.