<p>Alibaba has introduced a revolutionary AI system called EMO (Emote Portrait Alive) that has the ability to bring portraits to life by making them talk and sing. By combining images and audio, EMO generates realistic videos that are indistinguishable from real people. It can work on various styles of images and even recognize tonal variations to make avatars speak different languages. This groundbreaking technology has been open-sourced by Alibaba, allowing developers to create their own avatar videos that sing naturally. EMO utilizes a direct audio-to-video synthesis strategy and relies on the Stable Diffusion model, ensuring a natural and lively effect. Unlike other methods, EMO does not require the use of 3D models or facial landmarks, making it even more convenient to use. The capabilities of EMO are truly impressive and pave the way for new possibilities in the world of AI-generated content.</p>


Collections

Alibaba introduces EMO, an AI system that brings portraits to life by making them talk and sing. EMO generates realistic videos without the need for 3D models or facial landmarks.

Alibaba's EMO: Turning Photos into Realistic Talking and Singing Videos