NanoLLM logo

NanoLLM

Enrichment pending
dusty-nv/NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

GraphCanon updated today · GitHub synced today

377
Stars
65
Forks
64
Open issues
9
Watchers
1y
Last push
Python MITCreated Mar 31, 2024

Trust & integrity

Full report
Maintenance
Dormant (631d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Personal account
As of today · Source: github_public_v1
Security (OSV)
No lockfile
As of today · Source: none

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

Capability facts

Languages
python

Source: github.language · Jul 11, 2026

Categories

Tags