EMO (Emotive Portrait Alive) is a new generative AI researched by Alibaba's Institute of Intelligent Computing (IIC) with the ability to "magically" transform any image into being able to speak and sing realistically.
In other words, Alibaba's AI can turn a static reference image and voice audio into a video that can speak and sing with natural expressions.
Previous AIs only morphed the mouth and part of the face, while EMO can create facial expressions, natural mouth expressions, precise lip synchronization, move eyebrows, frown eyes or even sway to the music.
Alibaba has released a few videos showing how images will turn into videos and sing imported songs on the fly. EMO supports English, Chinese, and many other languages.
Alibaba revealed that in order for EMO to be able to create realistic facial expressions, it was trained with a large amount of image, audio, and video data through its own diffusion model called Audio2Video.
To address the current major challenge of realism and expressiveness in video generation from images and sounds, the research team focused on the relationship and nuances between audio signals and facial movements, bypassing the intermediate 3D model linkage or facial landmarks, seamlessly transitioning frames, and preserving consistency in the video.
Alibaba has not revealed when it will release this AI to the public, but has published EMO's data on Github, and research papers posted on ArXiv.
Long-distance travel can involve heavy traffic, changing weather conditions, and rider fatigue. If you are also dealing with the responsibilities of moving home, such as packing belongings or coordinating accommodation, a long ride may add unnecessary pressure to an already busy schedule.
Tired of Microsoft Teams shortcut error preventing you from opening the app? Follow our expert, step-by-step guide with the latest fixes for instant resolution. Works on Windows, Mac & web – no tech skills needed!
Tired of Microsoft Teams Task Management Sync Error halting your workflow? Follow our proven, step-by-step fixes to resolve sync issues fast and restore seamless task collaboration. No tech expertise needed!
Struggling with Microsoft Teams Wiki Error Formatting? This step-by-step guide reveals proven fixes for common wiki tab issues, ensuring smooth editing and collaboration in Teams. Get back to productive wikis fast!
Struggling with Microsoft Teams installation error on Linux? Discover step-by-step fixes for Ubuntu, Fedora & more. Resolve dependency issues, crashes, and errors quickly with our ultimate guide. Get Teams running smoothly today!
Struggling with Microsoft Teams "Error Page" not loading? Get step-by-step fixes for desktop, web, and mobile. Solve Microsoft Teams Error Page issues quickly and resume seamless teamwork today.
Tired of Microsoft Teams "Error Screenshot" blocking your workflow? Get proven, step-by-step solutions to resolve screenshot errors in Teams instantly and boost productivity. No tech skills needed!
Tired of Microsoft Teams "Error U" User blocking your chats? Get proven, step-by-step fixes to clear cache, reset, and restore seamless collaboration instantly.
Unlock the precise locations of Microsoft Teams registry keys on Windows 11. Step-by-step guide to find, access, and safely tweak them for optimal performance and troubleshooting. Essential for IT pros and Teams enthusiasts.
Tired of Microsoft Teams "Training Error" Video Lag ruining your meetings? Follow our step-by-step guide with the latest fixes for smooth video calls—no more frustration!
