Home/Inference & Serving/OlliteRT

OlliteRT

NightMean/OlliteRT

Android-based local inference server for OpenAI-compatible LLMs

GitHub

GraphCanon updated Aug 13, 2026 · GitHub synced Aug 13, 2026

31views this month

146 stars15 forksLast push Aug 2, 2026 Kotlin Apache-2.0

Decision brief

OlliteRT lets Android users run local AI inference with OpenAI-like compatibility using their devices

Good fit when

Android phones running Android 12+ arm64-v8a are required for deployment
Ideal for users preferring a private on-device setup without cloud dependency

Avoid when

Not suitable for devices with less than 6 GB of RAM, more is needed for performance
Avoid if device does not support arm64-v8a architecture or runs Android versions lower than 12

Observed Jul 17, 2026 · Source: enrich:decision_facts

OlliteRT alternatives Trust report

Verify the decision

Maintenance and security

Full trust report

Maintenance: Active (10d since push); As of Aug 13, 2026
Provenance: Not a fork · Personal account; As of Aug 13, 2026
Security (OSV): No lockfile; As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

git clone https://github.com/NightMean/OlliteRT

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

181k★

whichllm

Command-line tool to find and benchmark local LLM performance

6.2k★

ODS

Transform personal computers into AI servers.

4.8k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

OlliteRT allows users to conduct on-device AI inference using their Android phones by transforming them into servers compatible with the OpenAI API protocol.

Capability facts

Languages: kotlin
Source: github.language · Aug 13, 2026

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Aug 13, 2026)

/v1`) with any OpenAI-compatible client — Open WebUI, OpenClaw, Home Assistant, Python, etc. See **[Client Setup](docs/CLIENT_SETUP.md)** for detailed guides.

Source link

README

Quick Start 1. Download & install the APK <br <a href="https://github.com/NightMean/ollitert/releases/latest" <img src="assets/Github/Download Get it on Github.png" alt="Get it on GitHub" height="45" / </a 2. Download a model — Gemma 4 E2B is recommended for most devices (2.4 GB,...

For agents

This page has a .md twin and JSON over the API.

/tools/nightmean-ollitert.md GET /api/graphcanon/tools/nightmean-ollitert GET /api/graphcanon/graph?tool=nightmean-ollitert