OlliteRT logo

OlliteRT

Enrichment pending
NightMean/OlliteRT

Turn your Android phone into an OpenAI-compatible LLM inference server, Fully local, private and Open Source

GraphCanon updated today · GitHub synced today

135 stars14 forksLast push 1d Kotlin Apache-2.0

Verify the decision

Maintenance and security

Full trust report
Maintenance
Very active (1d since push)
As of today
Provenance
Not a fork · Personal account
As of today
Security (OSV)
No lockfile
As of today

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

git clone https://github.com/NightMean/OlliteRT

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Turn your Android phone into an OpenAI-compatible LLM inference server — Fully local, private and Open Source

Capability facts

Languages
kotlin

Source: github.language · Jul 15, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Python runtimePython

Source: README excerpt (regex_v1, Jul 15, 2026)

/v1`) with any OpenAI-compatible client — Open WebUI, OpenClaw, Home Assistant, Python, etc. See **[Client Setup](docs/CLIENT_SETUP.md)** for detailed guides.
Source link

Tags

README

Quick Start

  1. Download & install the APK
  2. Download a modelGemma 4 E2B is recommended for most devices (2.4 GB, runs on 8 GB RAM)
  3. Start the server — Tap the Start Server button on the downloaded model card
  4. Configure your client — Use the endpoint shown on the Status screen (e.g. http://PHONE_IP:8000/v1) with any OpenAI-compatible client — Open WebUI, OpenClaw, Home Assistant, Python, etc. See Client Setup for detailed guides.

[!IMPORTANT] Requires: Android 12+ · arm64-v8a device · 6 GB RAM minimum · 8 GB+ recommended for multimodal models (see model table)


License

Licensed under the Apache License 2.0.

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.