Home/Computer Vision/TalkingHead

TalkingHead

met4citizen/TalkingHead

A JavaScript class for real-time lip-sync using full-body 3D avatars

GitHub

GraphCanon updated 3w · GitHub synced 3w

1.4k stars327 forksLast push 2mo JavaScript MIT

Decision brief

TalkingHead is a JavaScript framework for real-time lip-sync with full-body 3D avatars in web apps.

Good fit when

For projects that require real-time lip-sync functionality using 3D avatars in browser-based applications
When integrating custom text-to-speech and artificial intelligence capabilities, such as GPT-3.5 or OpenAI's Whisper, for dynamic AI-driven avatar interactions

Avoid when

If the project requires real-time speech-to-speech features using OpenAI Realtime API due to high cost
For applications where WebGPU support is not available since TalkingHead integrates with other tools that rely on this technology

Observed Jul 17, 2026 · Source: enrich:decision_facts

TalkingHead alternatives Trust report

Verify the decision

Adoption

Package downloads where a registry match exists. GitHub stars (1,440) are secondary evidence.

npm downloads (30d): 22,641·npm downloads API·3w

Maintenance and security

Full trust report

Maintenance: Steady (57d since push); As of 3w
Provenance: Not a fork · Personal account; As of 3w
Security (OSV): No criticals; As of 1mo

Public GitHub metadata and optional OSV scans. Signals, not a guarantee. Trust methodology.

Install

npm install TalkingHead

npm

Similar tools

Same-category neighbours. No typed graph edges are catalogued for this tool yet.

VoxCPM

Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning

34k★

dia

A TTS model for generating ultra-realistic dialogue

19k★

Open-LLM-VTuber

Voice interaction with LLMs and Live2D visuals

13k★

Evidence and technical details

Sourced facts, taxonomy, compatibility claims, README excerpt, and machine-readable endpoints.

Overview

The TalkingHead repository offers a JavaScript framework enabling real-time lip-sync functionality with full-body 3D avatars in web applications.

Capability facts

MCP server: No MCP server detected
Source: repo_scan · Jul 30, 2026
Languages: javascript
Source: github.language+package.json · Jul 30, 2026

README

Talking Head (3D)

Demo Videos

All the demo videos are real-time screen captures from a Chrome browser running the TalkingHead test web app without any post-processing.

Video	Description
	Having a good hair day! – A two-part introduction to the TalkingHead's dynamic bones feature 🦴🦴 and built-in physics engine. Using custom models with rigged hair and two different hairstyles. See Appendix E for more details.
	I chat with Jenny and Harri. The close-up view allows you to evaluate the accuracy of lip-sync in both English and Finnish. Using GPT-3.5 and Microsoft text-to-speech.
	A short demo of how AI can control the avatar's movements. Using OpenAI's function calling and Google TTS with the TalkingHead's built-in viseme generation.
	Michael lip-syncs to two MP3 audio tracks using OpenAI's Whisper and TalkingHead's `speakAudio` method. He kicks things off with some casual talk, but then goes all out by trying to tackle an old Meat Loaf classic. 🤘 Keep rockin', Michael! 🎤😂
$$\color{transparent}{\rule{200px}{0px}}$$	Julia and I showcase some of the features of the TalkingHead class and the test app including the settings, some poses and animations.

Use Case Examples

Some featured videos, apps, and projects using the TalkingHead class:

Video/App	Use Case
	Human-AI group conversations. Researchers from UVA, Google, Northeastern, Google DeepMind, and Google Research developed DialogLab, a toolkit to author, simulate and test human-AI group conversations. 🤖🤖🤖
	Low-latency AI speech over WebRTC. Speech-to-speech in realtime over WebRTC using OpenAI Realtime API. Learn more about the audio-driven lip-sync module at HeadAudio. Note: Realtime speech-to-speech usage is much more expensive than standard AI text tokens, so please check OpenAI pricing for `gpt-realtime-mini` before use.
	Video conferencing. A video conferencing solution with real-time transcription, contextual AI responses, and voice lip-sync. The app and demo, featuring Olivia, by namnm 👍
	Fully in-browser AI you can talk to. Uses TalkingHead, HeadTTS (with Kokoro), whisper-web, and WebLLM (with Llama 3.2). No APIs, no accounts. For best performance and WebGPU support, use a desktop version of Chrome or Edge: 👉 EdgeSpeaker.com
	Recycling Advisor 3D. Snap a photo and get local recycling advice from a talking avatar. My entry for the Gemini API Developer Competition 2024.
	Live Twitch adventure. Evertrail is an infinite, real-time generated world where all of your choices shape the outcome. Video clip and the app by [JPhilipp]

For agents

This page has a .md twin and JSON over the API.

/tools/met4citizen-talkinghead.md GET /api/graphcanon/tools/met4citizen-talkinghead GET /api/graphcanon/graph?tool=met4citizen-talkinghead