Speech & Audio

transformers

🤗 Transformers: state-of-the-art machine learning models for text, vision, audio, and multimodal models

LocalAI

Open-source AI engine for running various models on any hardware

whisper.cpp

C++ port of OpenAI's Whisper model for speech-to-text

screenpipe

AI that records and analyzes everything you do, say, hear locally

FunASR

Industrial-grade speech recognition toolkit

pydantic-ai

Python AI SDK with typed, extensible agent loop

meetily

Privacy first AI meeting assistant with local processing

ODS

Transform personal computers into AI servers.

dograh

Self-hosted open source voice AI platform

speechbrain

A PyTorch-based Speech Toolkit

nuclear

Streaming music player that finds free music for you

OGAM

Swiss Army Knife of Offline AI

OmniVoice-Studio

The open-source ElevenLabs alternative for local voice cloning and related tasks

cactus

Low-latency AI engine for mobile devices & wearables

CosyVoice

Multi-lingual large voice generation model with full-stack abilities for inference, training and deployment.

ailia-models

Repository of pre-trained AI models for ailia SDK

openwhispr

Voice-to-text dictation app with local and cloud models

openless

AI-polished text from voice input for macOS and Windows

mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library on Apple's MLX framework.

bootcamp

Dealing with all unstructured data including reverse image search, audio search, molecular search, video analysis, and question-answer systems.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

SmartSub

A desktop subtitle tool supporting ASR and translation

VoxCPM

Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

ChatTTS

A generative speech model for daily dialogue.

espnet

End-to-End Speech Processing Toolkit

ChatGPT-On-CS

智能对话客服工具，支持多平台接入和多种AI模型

GPT-SoVITS

Voice Cloning and Text-to-Speech with Minimal Voice Data

EmotiVoice

A Multi-Voice and Prompt-Controlled TTS Engine

speech-to-speech

Build local voice agents with open-source models

Handy

Free, open source speech-to-text application for offline use

awesome-whisper

Curated resources for Whisper speech recognition system

Speech

A scalable generative AI framework for Speech AI

argmax-oss-swift

On-device Speech AI for Apple Silicon

Kokoro-FastAPI

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model

FunClip

A video transcription and subtitle generation tool with LLM-assisted functionality.

pyvideotrans

Translate video language and embed dubbing & subtitles

WhisperLive

A nearly-live implementation of OpenAI's Whisper for real-time voice recognition

vosk-api

Offline speech recognition API

faster-whisper

Faster Whisper transcription with CTranslate2

FluidAudio

CoreML audio models for text-to-speech, speech-to-text, voice activity detection and speaker diarization in Swift.

MOSS-TTS

An open-source speech and sound generation model family designed for high-fidelity scenarios including multi-speaker dialogue。

SenseVoice

Multilingual speech understanding toolkit with ASR, emotion recognition, and audio event detection.

sherpa-onnx

Speech-to-text and related audio processing tools using ONNX with cross-platform support

DiffSinger

Singing Voice Synthesis via Shallow Diffusion Mechanism

Applio

A simple high-quality voice conversion tool focused on ease of use and performance

LLPlayer

Media player for language learning featuring dual subtitles, AI-generated subtitles and real-time translation

Open-LLM-VTuber

Voice interaction with LLMs and Live2D visuals

pluely

Privacy-first AI assistant for meetings and interviews

whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

RealtimeSTT

Realtime speech-to-text library with advanced voice activity detection and wake word activation

Foundry-Local

SDK and CLI for local AI inference with GPU acceleration, supporting speech-to-text models like Whisper.

parlor

On-device real-time multimodal AI for voice and vision

index-tts

A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech

whisperX

WhisperX for automatic speech recognition with word-level timestamps and diarization

espeak-ng

Open source speech synthesizer supporting more than hundred languages and accents

WhisperJAV

ASR/STT subtitle generator using Qwen3-ASR and Whisper

abogen

Generate audiobooks from EPUBs, PDFs and text with synchronized captions.

silero-models

Silero Models provide simple access to pre-trained text-to-speech models

VieNeu-TTS

Vietnamese TTS with instant voice cloning, on-device and real-time CPU inference

Home-AssistantConfig

Home Assistant configuration and documentation for smart home setup.