GraphCanon updated Aug 14, 2026 · GitHub synced Aug 14, 2026
14views this month
Decision brief
The ONNX Runtime Server delivers ONNX model inference services over TCP and HTTP/HTTPS through its versatile server framework.
Good fit when
- You need a flexible serving solution where models can be accessed via both TCP and HTTP/HTTPS REST APIs simultaneously, allowing for diverse application integration scenarios.
- Your setup requires a high-performance inferencing engine with optional support for Nvidia GPU acceleration through CUDA, enhancing the speed of deep learning inference tasks.
Avoid when
- If your deployment environment only supports package managers without official onnxruntime-server packages like Debian or MacOSbrew (requires manual installation).
- When your architecture lacks support for CUDA and you cannot utilize its performance benefits, as other frameworks might offer more straightforward CPU-only setups.
- Requirements:
- Requires Docker; Install ONNX Runtime, Boost, CMake, and pkg-config.; CUDA is optional for Nvidia GPU support; OpenSSL is required only if HTTPS is needed.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (1d since push)
- As of Aug 14, 2026
- Provenance
- Not a fork · Personal account
- As of Aug 14, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/kibae/onnxruntime-serverSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Provides inference services via ONNX Runtime over TCP and HTTP/HTTPS REST APIs.
Capability facts
- Languages
- c++
Source: github.language · Aug 14, 2026
Categories
Tags
README
Requirements ONNX Runtime Boost CMake, pkg config CUDA( optional, for Nvidia GPU support ) OpenSSL( optional, for HTTPS ) Install ONNX Runtime Linux Use script This script downloads the latest version of the binary and install to . Also, add to and run . Or manually download bina...
For agents
This page has a .md twin and JSON over the API.