OlliteRT logo

OlliteRT

NightMean/OlliteRT

Android-based local inference server for OpenAI-compatible LLMs

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

373 stars47 forksLast push Sep 19, 2026 Kotlin Apache-2.0

Decision brief

Unverified catalog guidance: OlliteRT lets Android users run local AI inference with OpenAI-like compatibility using their devices

Good fit when

  • Unverified catalog guidance: Android phones running Android 12+ arm64-v8a are required for deployment
  • Unverified catalog guidance: Ideal for users preferring a private on-device setup without cloud dependency

Avoid when

  • Unverified catalog guidance: Not suitable for devices with less than 6 GB of RAM, more is needed for performance
  • Unverified catalog guidance: Avoid if device does not support arm64-v8a architecture or runs Android versions lower than 12

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (0d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/nightmean/ollitert
Source repository

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

OlliteRT allows users to conduct on-device AI inference using their Android phones by transforming them into servers compatible with the OpenAI API protocol.

Capability facts

Languages
kotlin

Source: github.language · Sep 20, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Sep 20, 2026)

/v1`) with any OpenAI-compatible client — Open WebUI, OpenClaw, Home Assistant, Python, etc. See **[Client Setup](docs/CLIENT_SETUP.md)** for detailed guides.
Source link

Tags

README

Quick Start 1. Download & install the APK <br <a href="https://github.com/NightMean/ollitert/releases/latest" <img src="assets/Github/Download Get it on Github.png" alt="Get it on GitHub" height="45" / </a 2. Download a model — Gemma 4 E2B is recommended for most devices (2.4 GB,...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.