GraphCanon
Home/LLM Frameworks/TalkingHead
TalkingHead logo

TalkingHead

Enrichment pending
met4citizen/TalkingHead

Talking Head (3D): A JavaScript class for real-time lip-sync using full-body 3D avatars.

GitHub

GraphCanon updated today · GitHub synced today

1.4k
Stars
319
Forks
7
Open issues
25
Watchers
1mo
Last push
JavaScript MITCreated Aug 14, 2023

Trust & integrity

Full report
Maintenance
Steady (39d since push)
As of today · Source: github_public_v1
Provenance
Not a fork · Personal account
As of today · Source: github_public_v1
Security (OSV)
No criticals
As of today · Source: osv@v1

Public GitHub metadata and optional OSV dependency scans. Signals, not a guarantee. Trust methodology.

Overview

Talking Head (3D): A JavaScript class for real-time lip-sync using full-body 3D avatars.

Capability facts

MCP server
No MCP server detected

Source: repo_scan · Jul 11, 2026

Languages
javascript

Source: github.language+package.json · Jul 11, 2026

Categories

LLM FrameworksComputer VisionSpeech & Audio

Tags

lip-sync3d-avatartalking-headtext-to-speechjavascripttalking-avatar

README

Talking Head (3D)

Demo Videos

All the demo videos are real-time screen captures from a Chrome browser running the TalkingHead test web app without any post-processing.

VideoDescription

Having a good hair day! – A two-part introduction to the TalkingHead's dynamic bones feature 🦴🦴 and built-in physics engine. Using custom models with rigged hair and two different hairstyles. See Appendix E for more details.
I chat with Jenny and Harri. The close-up view allows you to evaluate the accuracy of lip-sync in both English and Finnish. Using GPT-3.5 and Microsoft text-to-speech.
A short demo of how AI can control the avatar's movements. Using OpenAI's function calling and Google TTS with the TalkingHead's built-in viseme generation.
Michael lip-syncs to two MP3 audio tracks using OpenAI's Whisper and TalkingHead's speakAudio method. He kicks things off with some casual talk, but then goes all out by trying to tackle an old Meat Loaf classic. 🤘 Keep rockin', Michael! 🎤😂
$$\color{transparent}{\rule{200px}{0px}}$$Julia and I showcase some of the features of the TalkingHead class and the test app including the settings, some poses and animations.

Use Case Examples

Some featured videos, apps, and projects using the TalkingHead class:

Video/AppUse Case
Human-AI group conversations. Researchers from UVA, Google, Northeastern, Google DeepMind, and Google Research developed DialogLab, a toolkit to author, simulate and test human-AI group conversations. 🤖🤖🤖
Low-latency AI speech over WebRTC. Speech-to-speech in realtime over WebRTC using OpenAI Realtime API. Learn more about the audio-driven lip-sync module at HeadAudio.
Note: Realtime speech-to-speech usage is much more expensive than standard AI text tokens, so please check OpenAI pricing for gpt-realtime-mini before use.
Video conferencing. A video conferencing solution with real-time transcription, contextual AI responses, and voice lip-sync. The app and demo, featuring Olivia, by namnm 👍
Fully in-browser AI you can talk to. Uses TalkingHead, HeadTTS (with Kokoro), whisper-web, and WebLLM (with Llama 3.2). No APIs, no accounts. For best performance and WebGPU support, use a desktop version of Chrome or Edge: 👉 EdgeSpeaker.com
Recycling Advisor 3D. Snap a photo and get local recycling advice from a talking avatar. My entry for the Gemini API Developer Competition 2024.
Live Twitch adventure. Evertrail is an infinite, real-time generated world where all of your choices shape the outcome. Video clip and the app by [JPhilipp]