local-llms-on-android
Run local LLMs for offline chat and question answering on Android.
GraphCanon updated Aug 13, 2026 · GitHub synced Aug 13, 2026
32views this month
Decision brief
local-llms-on-android enables offline deployment and execution of large language models on Android devices using LiteRT and ONNX Runtime for applications requiring real-time conversation.
Good fit when
- To enable offline chat and question answering capabilities, particularly when Gemma, Qwen, or LLaMA are the preferred model architectures.
- When there is a need to ensure data privacy by processing user inputs locally without internet connectivity.
Avoid when
- If real-time connection with internet-based services is necessary for chatbot operation and interaction.
- In scenarios where the model's computational requirements exceed the capabilities of the target Android device, possibly leading to performance issues or excessive battery drain.
- Requirements:
- Supports deployment on Android devices using Kotlin programming language with LiteRT engine and ONNX Runtime for inference.
Observed Jul 17, 2026 · Source: enrich:decision_facts
Verify the decision
Maintenance and security
Full trust report- Maintenance
- Very active (1d since push)
- As of Aug 13, 2026
- Provenance
- Not a fork · Personal account
- As of Aug 13, 2026
- Security (OSV)
- No lockfile
- As of Jul 15, 2026
Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.
Install
git clone https://github.com/dineshsoudagar/local-llms-on-androidSimilar tools
Same-category neighbours. No typed graph edges are catalogued for this tool yet.
Evidence and technical details
Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.
Overview
Enables execution of Large Language Models such as Gemma, Qwen, and LLaMA on Android devices via LiteRT and ONNX Runtime for private use cases.
Capability facts
- Languages
- kotlin
Source: github.language · Aug 13, 2026
Categories
Tags
README
⚙️ Requirements Android Studio A physical Android device for deployment and testing 4 GB or more RAM for smaller models More RAM is recommended for larger models such as Gemma 4 E2B and Gemma 4 E4B A temporary internet connection for downloading models inside the app Real hardwar...
For agents
This page has a .md twin and JSON over the API.