Speech & Audio

transformers

Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models

LocalAI

Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

whisper.cpp

Port of OpenAI's Whisper model in C/C++ for speech-to-text inference

screenpipe

AI that records and analyzes everything you do, say, hear locally

FunASR

Industrial-grade speech recognition toolkit

mastra

Modern TypeScript framework for AI-powered applications and agents

CosyVoice

Multi-lingual large voice generation model with full-stack abilities for inference, training and deployment.

nuclear

Streaming music player that finds free music for you

cactus

Low-latency AI engine for mobile devices & wearables

ChatTTS

A generative speech model for daily dialogue

bootcamp

Dealing with all unstructured data including reverse image search, audio search, molecular search, video analysis, and question-answer systems.

speechbrain

A PyTorch-based Speech Toolkit

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

dograh

Self-hosted open source voice AI platform

ODS

Transform personal computers into AI servers.

py-gpt

Desktop AI Assistant powered by multiple LLMs and various functionalities

meetily

Privacy first, AI meeting assistant with local processing

mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library on Apple's MLX framework.

Kokoro-FastAPI

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model

Speech

A scalable generative AI framework for Speech AI

argmax-oss-swift

On-device Speech AI for Apple Silicon

openwhispr

Voice-to-text dictation app with local and cloud models

WhisperLive

A nearly-live implementation of OpenAI's Whisper for real-time voice recognition

SmartSub

A desktop subtitle tool supporting ASR and translation

SenseVoice

Multilingual speech understanding toolkit with ASR, emotion recognition, and audio event detection.

MOSS-TTS

An open-source speech and sound generation model family designed for high-fidelity scenarios including multi-speaker dialogue。

DiffSinger

Singing Voice Synthesis via Shallow Diffusion Mechanism

espnet

End-to-End Speech Processing Toolkit

VoxCPM

Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

ChatGPT-On-CS

智能对话客服工具，支持多平台接入和多种AI模型

ailia-models

Repository of pre-trained AI models for ailia SDK

GPT-SoVITS

Voice Cloning and Text-to-Speech with Minimal Voice Data

Handy

Free, open source speech-to-text application for offline use

openless

AI-polished text from voice input for macOS and Windows

parlor

On-device real-time multimodal AI for voice and vision

FunClip

A video transcription and subtitle generation tool with LLM-assisted functionality.

speech-to-speech

Build local voice agents with open-source models

pyvideotrans

Translate video language and embed dubbing & subtitles

vosk-api

Offline speech recognition API

abogen

Generate audiobooks from EPUBs, PDFs and text with synchronized captions.

faster-whisper

Faster Whisper transcription with CTranslate2

sherpa-onnx

Speech-to-text and related audio processing tools using ONNX with cross-platform support

FluidAudio

CoreML audio models for text-to-speech, speech-to-text, voice activity detection and speaker diarization in Swift.

supertonic

Lightning-Fast On-Device Multilingual TTS via ONNX

Applio

A simple high-quality voice conversion tool focused on ease of use and performance

LLPlayer

Media player for language learning featuring dual subtitles, AI-generated subtitles and real-time translation

Open-LLM-VTuber

Voice interaction with LLMs and Live2D visuals

pluely

Privacy-first AI assistant for meetings and interviews

TTS-WebUI

A comprehensive WebUI for multiple TTS systems

MockingBird

Clone a voice in 5 seconds to generate arbitrary speech in real-time

OmniVoice-Studio

The open-source ElevenLabs alternative for local voice cloning and related tasks

Foundry-Local

SDK and CLI for local AI inference with GPU acceleration, supporting speech-to-text models like Whisper.

AudioNotes

Quickly extracts audio and video content into structured markdown notes

espeak-ng

Open source speech synthesizer supporting more than hundred languages and accents

index-tts

A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speech

whisperX

WhisperX for automatic speech recognition with word-level timestamps and diarization

silero-models

Silero Models provide simple access to pre-trained text-to-speech models

Home-AssistantConfig

Home Assistant configuration and documentation for smart home setup.

awesome-generative-ai

A comprehensive list of generative AI resources

voice-pro

Gradio WebUI for TTS and voice cloning with audio processing capabilities