Discover Wawa-Lipsync: A FREE, open-source JavaScript library for real-time lipsync in web-based 2D/3D games and AI chatbots! 💋

Tired of slow and expensive lipsync solutions like Azure or Rhubarb? In this video, I introduce Wawa-Lipsync, a fast, TypeScript-based library that works with any JS framework (Three.js, React Three Fiber, and more). 

Learn how to create convincing talking characters for your games or AI projects for free!


🚀 Learn React Three Fiber with the Ultimate Guide to 3D Web Development ✨
https://wawasensei.dev/courses/react-three-fiber/

Demo 🔗
https://wawa-lipsync.wawasensei.dev/

Wawa Lipsync Library 🔗
https://github.com/wass08/wawa-lipsync

#lipsync #js #opensource

▬▬▬▬▬▬ Useful L I N K S  🔗  ▬▬▬▬▬▬ 

AI Girlfriend tutorial
https://youtu.be/EzzcEL_1o9o

Oculus Lipsync Viseme reference
https://developers.meta.com/horizon/documentation/unity/audio-ovrlipsync-viseme-reference/

Analyser Node
https://developer.mozilla.org/en-US/docs/Web/API/AnalyserNode

React Three Fiber
https://r3f.docs.pmnd.rs/getting-started/introduction

Threejs
https://threejs.org/


▬▬▬▬▬▬ Support the channel 🙏   ▬▬▬▬▬▬ 

Become a member to get access to awesome perks:
https://www.youtube.com/channel/UCBH-5ctALmmOrm4kczL3urQ/join

▬▬▬▬▬▬ Connect with me 👋   ▬▬▬▬▬▬ 

💻 The Discord Community
https://discord.gg/2wBhwchcWu

📸 Instagram : 
https://instagram.com/wawa.sensei

🎎 Facebook :
https://www.facebook.com/wawasenseiyt

🐦Twitter : 
https://twitter.com/wawasensei

🐦TikTok : 
https://www.tiktok.com/@wawasensei08


▬▬▬▬▬▬ T I M E S T A M P S ⏰  ▬▬▬▬▬▬

00:00:00 Introduction
00:00:42 Azure TTS
00:01:09 Rhubarb lipsync library
00:02:08 AI Chatbots
00:02:38 Introducing Wawa-Lipsync
00:03:07 Visemes detection
00:05:15 How to use it
00:06:07 Going further
00:06:33 Conclusion


▬▬▬▬▬▬ CREDITS  ▬▬▬▬▬▬
Song: Blue Boi
Composer: Lakey Inspired
Website: https://www.youtube.com/LakeyInspired
License: Creative Commons (BY-NC 3.0) https://creativecommons.org/licenses/by-nc/3.0/
Music powered by BreakingCopyright: https://breakingcopyright.com

Wawa Sensei

Wawa-Lipsync is a new open-source JavaScript library that enables real-time lip synchronization for web applications. Unlike existing solutions that are either expensive or slow, this library analyzes audio frequencies in real-time to generate visemes (visual representations of phonemes) that can animate 2D or 3D characters. The library works by using the browser's analyzer node to detect audio patterns and deduce mouth movements, making it suitable for AI chatbots, games, and interactive web experiences without server-side processing delays.

Real-Time Lipsync for Web: Build AI Chatbots & Games with Wawa-Lipsync (Free & Open-Source!)

<p>This is super helpful, thanks for sharing! 🚀</p>
