{"data":{"slug":"nightmean-ollitert","name":"OlliteRT","tagline":"Turn your Android phone into an OpenAI-compatible LLM inference server, Fully local, private and Open Source","github_url":"https://github.com/NightMean/OlliteRT","owner":"NightMean","repo":"OlliteRT","owner_avatar_url":"https://avatars.githubusercontent.com/u/5726996?v=4","primary_language":"Kotlin","stars":135,"forks":14,"topics":["android","anthropic-api","gemma","home-assistant","kotlin-android","litert","litert-lm","llm","llm-inference","local-llm","on-device-ai","openai-api"],"archived":false,"github_pushed_at":"2026-07-13T20:04:31+00:00","maintenance_label":"Very active","url":"https://www.graphcanon.com/tools/nightmean-ollitert","markdown_url":"https://www.graphcanon.com/tools/nightmean-ollitert.md","api_url":"https://www.graphcanon.com/api/graphcanon/tools/nightmean-ollitert","graph_url":"https://www.graphcanon.com/api/graphcanon/graph?tool=nightmean-ollitert","description":"Turn your Android phone into an OpenAI-compatible LLM inference server — Fully local, private and Open Source","homepage_url":null,"license":"Apache-2.0","open_issues":3,"watchers":8,"ai_summary":null,"readme_excerpt":"## Quick Start\n\n1. **Download & install** the APK\n   <br><a href=\"https://github.com/NightMean/ollitert/releases/latest\"><img src=\"assets/Github/Download_Get_it_on_Github.png\" alt=\"Get it on GitHub\" height=\"45\" /></a>\n2. **Download a model** — **Gemma 4 E2B** is recommended for most devices (2.4 GB, runs on 8 GB RAM)\n3. **Start the server** — Tap the Start Server button on the downloaded model card\n4. **Configure your client** — Use the endpoint shown on the Status screen (e.g. `http://PHONE_IP:8000/v1`) with any OpenAI-compatible client — Open WebUI, OpenClaw, Home Assistant, Python, etc. See **[Client Setup](docs/CLIENT_SETUP.md)** for detailed guides.\n\n> [!IMPORTANT]\n> Requires: Android 12+ · **arm64-v8a** device · 6 GB RAM minimum · 8 GB+ recommended for multimodal models (see [model table](#available-models))\n\n---\n\n## License\n\nLicensed under the [Apache License 2.0](LICENSE).","github_created_at":"2026-04-06T18:29:37+00:00","created_at":"2026-07-15T11:02:18.707532+00:00","updated_at":"2026-07-15T11:02:21.965961+00:00","categories":[{"slug":"developer-tools","name":"Developer Tools","url":"https://www.graphcanon.com/categories/developer-tools","markdown_url":"https://www.graphcanon.com/categories/developer-tools.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/developer-tools"},{"slug":"inference-serving","name":"Inference & Serving","url":"https://www.graphcanon.com/categories/inference-serving","markdown_url":"https://www.graphcanon.com/categories/inference-serving.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/inference-serving"},{"slug":"llm-frameworks","name":"LLM Frameworks","url":"https://www.graphcanon.com/categories/llm-frameworks","markdown_url":"https://www.graphcanon.com/categories/llm-frameworks.md","api_url":"https://www.graphcanon.com/api/graphcanon/categories/llm-frameworks"}],"tags":[{"slug":"android","name":"android"},{"slug":"anthropic-api","name":"anthropic-api"},{"slug":"gemma","name":"gemma"},{"slug":"home-assistant","name":"home-assistant"},{"slug":"kotlin-android","name":"kotlin-android"},{"slug":"litert","name":"litert"},{"slug":"litert-lm","name":"litert-lm"},{"slug":"llm","name":"llm"}],"trust":{"provenance":{"is_fork":false,"github_id":1203116301,"owner_type":"User","methodology":"github_public_v1","parent_repo":null,"near_duplicate_slugs":[]},"computed_at":"2026-07-15T11:02:19.751Z","maintenance":{"label":"Very active","score":96,"methodology":"github_public_v1","releases_90d":3,"days_since_push":1,"last_release_at":"2026-06-06T13:00:39Z"},"security_summary":{"status":"no_lockfile","scanner":null,"low_count":0,"high_count":0,"last_scan_at":"2026-07-15T11:02:20.313Z","medium_count":0,"scan_profile":"none","critical_count":0}},"capability_facts":{"scan":{"source":"repo_scan","observed_at":"2026-07-15T11:02:19.506Z"},"languages":{"value":["kotlin"],"source":"github.language","observed_at":"2026-07-15T11:02:19.506Z"},"license_spdx":{"value":"Apache-2.0","source":"github.license","observed_at":"2026-07-15T11:02:19.506Z"}}}}