Home/Developer Tools/rkllama

rkllama

Enrichment pending

NotPunchnox/rkllama

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

GraphCanon updated today · GitHub synced today

571

Stars

97

Forks

59

Open issues

21

Watchers

5d

Last push

Python GPL-3.0Created Dec 30, 2024

Trust & integrity

Maintenance: Very active (4d since push); As of today · Source: github_public_v1
Provenance: Not a fork · Personal account; As of today · Source: github_public_v1
Security (OSV): No lockfile; As of today · Source: none

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

Capability facts

Languages: python
Source: github.language · Jul 11, 2026

Categories

Developer Tools Inference & Serving LLM Frameworks

Tags

ai client client-server ia llm llm-apps llm-inference npu

Explore

rkllama alternatives →Trust report →Developer Tools category →All comparisons Stack workflows Trending tools

Trust & health

MaintenanceVery active

AdoptionEmerging

Graph connectivityIsolated

SecurityNo lockfile

Provenance

Personal account (GitHub heuristic)
Computed today

Full trust report Trust report (JSON)

Methodology: public GitHub data (github_public_v1). Signals, not a guarantee. Trust methodology.

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

😎 Curated list of awesome topics including hardware resources

The agent harness performance optimization system for AI agents

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

AutoGPT is the vision of accessible AI for everyone, to use and to build on.

Get up and running with various large language models using Ollama.

Share, discover, and collect prompts from the community

Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models

Java Interview & Backend General Guide, covering computer basics, databases, distributed systems, high concurrency, system design, and AI application development

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

The agent engineering platform.

LLM inference in C/C++

Install

pip install rkllama

For agents

This page has a .md twin and JSON over the API.

/tools/notpunchnox-rkllama.md GET /api/graphcanon/tools/notpunchnox-rkllama GET /api/graphcanon/graph?tool=notpunchnox-rkllama