Alibabas AI Turns Still Photos into Talking and Singing

EMO (Emotive Portrait Alive) is a new generative AI researched by Alibaba's Institute of Intelligent Computing (IIC) with the ability to "magically" transform any image into being able to speak and sing realistically.

In other words, Alibaba's AI can turn a static reference image and voice audio into a video that can speak and sing with natural expressions.

Previous AIs only morphed the mouth and part of the face, while EMO can create facial expressions, natural mouth expressions, precise lip synchronization, move eyebrows, frown eyes or even sway to the music.

Alibaba has released a few videos showing how images will turn into videos and sing imported songs on the fly. EMO supports English, Chinese, and many other languages.

Alibaba revealed that in order for EMO to be able to create realistic facial expressions, it was trained with a large amount of image, audio, and video data through its own diffusion model called Audio2Video.

To address the current major challenge of realism and expressiveness in video generation from images and sounds, the research team focused on the relationship and nuances between audio signals and facial movements, bypassing the intermediate 3D model linkage or facial landmarks, seamlessly transitioning frames, and preserving consistency in the video.

Alibaba has not revealed when it will release this AI to the public, but has published EMO's data on Github, and research papers posted on ArXiv.

Leave a Comment

How to Fix Microsoft Teams Update Error Loop

How to Fix Microsoft Teams Update Error Loop

Frustrated with the endless Microsoft Teams Update Error loop? Discover step-by-step fixes to resolve stuck updates, clear cache, reinstall, and more. Get back to seamless collaboration fast!

How to Fix Microsoft Teams Download Error on Phone

How to Fix Microsoft Teams Download Error on Phone

Encountering Microsoft Teams "Download Error" on your phone? Get instant fixes for Android & iOS. Clear cache, update apps, and more—back to chatting in minutes without frustration!

Solving Microsoft Teams VOIP Connection Error

Solving Microsoft Teams VOIP Connection Error

Struggling with Microsoft Teams VOIP connection error? Discover step-by-step fixes to solve Microsoft Teams VOIP connection error instantly. Network tweaks, cache clears, and more for seamless video calls.

Solving Microsoft Teams Unexpected Error on Startup

Solving Microsoft Teams Unexpected Error on Startup

Tired of the frustrating Microsoft Teams 'Unexpected Error' on startup? Discover step-by-step fixes, from clearing cache to advanced resets, to get Teams running smoothly again. Quick, reliable solutions for Windows and Mac users.

How to Fix Microsoft Teams Download Error Unexpected

How to Fix Microsoft Teams Download Error Unexpected

Tired of Microsoft Teams "Download Error" Unexpected blocking your workflow? Follow our expert, step-by-step guide with quick fixes and advanced tips to resolve it instantly. No reinstall needed!

Causes of oil heater noise, oil leakage and no heating when in use

Causes of oil heater noise, oil leakage and no heating when in use

Oil heaters make noise, leak oil, and do not heat up. These are all problems that arise when using a heater. So what are the causes of these problems? Read our article below!

How to Assign Participants to Breakout Rooms in Microsoft Teams

How to Assign Participants to Breakout Rooms in Microsoft Teams

Master how to assign participants to breakout rooms in Microsoft Teams with this step-by-step guide. Boost meeting engagement, automate assignments, and troubleshoot like a pro for seamless virtual collaboration.

How to Fix Microsoft Teams Giá Error Pricing Update

How to Fix Microsoft Teams Giá Error Pricing Update

Struggling with Microsoft Teams "Price Error" after the latest pricing update? Discover step-by-step fixes to resolve it quickly, restore seamless collaboration, and avoid subscription headaches. Updated with the newest solutions.

Solving Microsoft Teams Background Error Transparency

Solving Microsoft Teams Background Error Transparency

Struggling with Microsoft Teams Background Error Transparency? Discover proven step-by-step fixes for blurry, glitchy virtual backgrounds. Restore perfect transparency in Teams meetings effortlessly. Updated with the latest solutions.

How to Fix Microsoft Teams Đăng nhập Error (Login)

How to Fix Microsoft Teams Đăng nhập Error (Login)

Struggling with Microsoft Teams "Đăng nhập" login error? Discover step-by-step fixes for smooth sign-in. Clear cache, update app, and more – no tech skills needed! Works on Windows, Mac, and web.

Solving Microsoft Teams Web Error 503 Service Unavailable

Solving Microsoft Teams Web Error 503 Service Unavailable

Tired of Microsoft Teams Web Error 503 Service Unavailable blocking your meetings? Discover quick, step-by-step fixes to resolve the 503 error fast – no tech skills needed! Clear cache, check status, and get back to collaborating seamlessly.

Troubleshooting Microsoft Teams Update Error 0x80070002

Troubleshooting Microsoft Teams Update Error 0x80070002

Stuck with Microsoft Teams Update Error 0x80070002? Discover proven troubleshooting steps to resolve this frustrating issue quickly and get your Teams app updated seamlessly for uninterrupted collaboration.

Solving Microsoft Teams Error AADSTS50020: User Account Conflict

Solving Microsoft Teams Error AADSTS50020: User Account Conflict

Tired of Microsoft Teams Error AADSTS50020 blocking your sign-in? Discover step-by-step fixes for user account conflicts, backed by the latest Azure AD solutions. Get back to work fast!

How to Fix Microsoft Teams Microphone Error No Sound

How to Fix Microsoft Teams Microphone Error No Sound

Tired of Microsoft Teams microphone error with no sound? Discover quick, step-by-step fixes for Teams mic not working on Windows, Mac, and more. Restore crystal-clear audio in minutes!

How to Fix Microsoft Teams Task Management Error

How to Fix Microsoft Teams Task Management Error

Tired of the Microsoft Teams "Task Management" Error disrupting your workflow? Discover proven fixes like clearing cache, updating Teams, and troubleshooting permissions to get back to seamless collaboration in minutes. Updated with the latest solutions.