sherpa-onnx logo

sherpa-onnx

Enrichment pending
k2-fsa/sherpa-onnx

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android

GraphCanon updated today · GitHub synced today

13k
Stars
1.5k
Forks
600
Open issues
117
Watchers
1d
Last push
C++ Apache-2.0Created Sep 1, 2022

Trust & integrity

Full report
Maintenance
Very active (1d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Organization account
As of today · Source: github_public_v1
Security (OSV)
No lockfile
As of today · Source: none

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

Capability facts

Languages
c++

Source: github.language · Jul 11, 2026

Categories

Compatibility

Sourced claims from the README excerpt - not unsourced marketing copy.

Node.js runtimeNode.js

Source: README excerpt (regex_v1, Jul 11, 2026)

- NodeJS
Source link
Python runtimePython

Source: README excerpt (regex_v1, Jul 11, 2026)

| 1. C++ | 2. C | 3. Python | 4. JavaScript |
Source link

Tags

README

Supported functions

Speech recognition[Speech synthesis][tts-url][Source separation][ss-url]
✔️✔️✔️
Speaker identification[Speaker diarization][sd-url]Speaker verification
✔️✔️✔️
[Spoken Language identification][slid-url][Audio tagging][at-url][Voice activity detection][vad-url]
✔️✔️✔️
[Keyword spotting][kws-url][Add punctuation][punct-url][Speech enhancement][se-url]
✔️✔️✔️

Supported platforms

ArchitectureAndroidiOSWindowsmacOSlinuxHarmonyOS
x64✔️✔️✔️✔️✔️
x86✔️✔️
arm64✔️✔️✔️✔️✔️✔️
arm32✔️✔️✔️
riscv64✔️

Supported programming languages

1. C++2. C3. Python4. JavaScript
✔️✔️✔️✔️
5. Java6. C#7. Kotlin8. Swift
✔️✔️✔️✔️
9. Go10. Dart11. Rust12. Pascal
✔️✔️✔️✔️

It also supports WebAssembly.

Supported NPUs

[1. Rockchip NPU (RKNN)][rknpu-doc][2. Qualcomm NPU (QNN)][qnn-doc][3. Ascend NPU][ascend-doc]
✔️✔️✔️
[4. Axera NPU][axera-npu]
✔️

Join our discord

Introduction

This repository supports running the following functions locally

  • Speech-to-text (i.e., ASR); both streaming and non-streaming are supported
  • Text-to-speech (i.e., TTS)
  • Speaker diarization
  • Speaker identification
  • Speaker verification
  • Spoken language identification
  • Audio tagging
  • VAD (e.g., [silero-vad][silero-vad])
  • Speech enhancement (e.g., [gtcrn][gtcrn], DPDFNet)
  • Keyword spotting
  • Source separation (e.g., [spleeter][spleeter], [UVR][UVR])

on the following platforms and operating systems:

  • x86, x86_64, 32-bit ARM, 64-bit ARM (arm64, aarch64), RISC-V (riscv64), RK NPU, Ascend NPU
  • Linux, macOS, Windows, openKylin
  • Android, WearOS
  • iOS
  • HarmonyOS
  • NodeJS
  • WebAssembly
  • [NVIDIA Jetson Orin NX][NVIDIA Jetson Orin NX] (Support running on both CPU and GPU)
  • [NVIDIA Jetson Nano B01][NVIDIA Jetson Nano B01] (Support running on both CPU and GPU)
  • [Raspberry Pi][Raspberry Pi]
  • [RV1126][RV1126]
  • [LicheePi4A][LicheePi4A]
  • [VisionFive 2][VisionFive 2]
  • [旭日X3派][旭日X3派]
  • [爱芯派][爱芯派]
  • [RK3588][RK3588]
  • [SpacemiT-K1][SpacemiT-K1]
  • [SpacemiT-K3][SpacemiT-K3]
  • etc

with the following APIs

  • C++, C, Python, Go, C#
  • Java, Kotlin, JavaScript
  • Swift, Rust
  • Dart, Object Pascal

Links for Huggingface Spaces

You can visit the following Huggingface spaces to try sherpa-onnx without installing anything