Home/Inference & Serving/local-llms-on-android
local-llms-on-android logo

local-llms-on-android

dineshsoudagar/local-llms-on-android

Run local LLMs for offline chat and question answering on Android.

GraphCanon updated Sep 20, 2026 · GitHub synced Sep 20, 2026

419 stars53 forksLast push Aug 13, 2026 Kotlin MIT

Decision brief

Unverified catalog guidance: local-llms-on-android enables offline deployment and execution of large language models on Android devices using LiteRT and ONNX Runtime for applications requiring real-time conversation.

Good fit when

  • Unverified catalog guidance: To enable offline chat and question answering capabilities, particularly when Gemma, Qwen, or LLaMA are the preferred model architectures.
  • Unverified catalog guidance: When there is a need to ensure data privacy by processing user inputs locally without internet connectivity.

Avoid when

  • Unverified catalog guidance: If real-time connection with internet-based services is necessary for chatbot operation and interaction.
  • Unverified catalog guidance: In scenarios where the model's computational requirements exceed the capabilities of the target Android device, possibly leading to performance issues or excessive battery drain.
Requirements:
Supports deployment on Android devices using Kotlin programming language with LiteRT engine and ONNX Runtime for inference.

Observed Jul 17, 2026 · Source: enrich:decision_facts

Verify the decision

Maintenance and security

Full trust report
Maintenance
Steady (37d since push)
As of Sep 20, 2026
Provenance
Not a fork · Personal account
As of Sep 20, 2026
Security (OSV)
No lockfile
As of Jul 15, 2026

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

Package installation is not established from the available documentation. Check the source repository for setup instructions.

git clone https://github.com/dineshsoudagar/local-llms-on-android
Source repository

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

Enables execution of Large Language Models such as Gemma, Qwen, and LLaMA on Android devices via LiteRT and ONNX Runtime for private use cases.

Capability facts

Languages
kotlin

Source: github.language · Sep 20, 2026

Categories

Tags

README

⚙️ Requirements Android Studio A physical Android device for deployment and testing 4 GB or more RAM for smaller models More RAM is recommended for larger models such as Gemma 4 E2B and Gemma 4 E4B A temporary internet connection for downloading models inside the app Real hardwar...

For agents

This page has a .md twin and JSON over the API.

Was this helpful?

Anonymous feedback helps us improve pages and translations.