orkhon logo

orkhon

vertexclique/orkhon

ML Inference Framework and Server Runtime

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

33views this month

153 stars4 forksLast push Feb 1, 2021 Rust MIT

Decision brief

Orkhon is an ML inference framework and server runtime primarily written in Rust, emphasizing async, data-parallelism, multiprocessing features.

Good fit when

  • Use Orkhon when you need an inference solution with support for asynchronous operations, which can significantly enhance performance on I/O-bound tasks compared to synchronous alternatives.
  • Opt for it if your environment leverages Rust and seeks tight integration capabilities, benefiting from the language's memory safety guarantees and high performance.

Avoid when

  • Avoid Orkhon when you require a more mature ecosystem or community support that languages such as Python offer with frameworks like TensorFlow Serving.
  • Do not use if your project heavily depends on Python-specific libraries for inference tasks, given Orkhon prioritizes Rust integration.
Pricing:
freemium
Requirements:
Min 0.5 GB RAM; As Orkhon is written in Rust, ensure you have the necessary tools in place for Rust development and deployment.

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Dormant (2056d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

cargo add orkhon
crates.io

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Orkhon is an ML inference framework written in Rust that supports async, data-parallelism, multiprocessing and serves as an inference server.

Capability facts

Languages
rust

Source: github.language · Sep 20, 2026

Categories

Tags

README

Installation You can include Orkhon into your project with; License License is MIT

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.