ai-serving
Serving AI/ML models in open standard formats PMML and ONNX with HTTP and gRPC endpoints
GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026
56views this month
Decision brief
Ai-Serving is an inference server supporting PMML and ONNX formats via HTTP or gRPC endpoints, easily deployable with Docker.
Good fit when
- When you need to serve models in both PMML and ONNX formats without manual configuration changes between formats.
- For projects requiring deployment of AI/ML models over REST API or gRPC interfaces for real-time inference scenarios.
Avoid when
- Avoid if your team lacks familiarity or willingness to use Scala for deployment through sbt build system for customization needs.
- Not suitable when only one model format, either PMML or ONNX but not both, is needed and a simpler solution would suffice.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Slowing (208d since push)
- As of Sep 20, 2026
- Provenance
- Not a fork · Organization account
- As of Sep 20, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/autodeployai/ai-servingSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
autodeployai/ai-serving is an inference server for both PMML and ONNX model formats supporting deployment via REST API or gRPC, deployable using Docker images or built from source requiring sbt build system.
Capability facts
- Languages
- scala
Source: github.language · Sep 20, 2026
Categories
Tags
README
Install using Docker The easiest and most straight forward way of using AI Serving is with Docker images. Install from Source Install SBT The build system is required. After sbt installed, clone this repository, then change into the repository root directory: Build Assembly AI Se...
For agents
This page has a .md twin and JSON over the API.