Meta Unveils AI-Powered Dubbing Tool for Reels with Lip Syncing

Meta has introduced an innovative tool that utilizes artificial intelligence (AI) to automatically dub Reels into other languages, complete with lip syncing. This feature was showcased at the annual Meta Connect Livestream Event, led by CEO Mark Zuckerberg.

During his keynote, Zuckerberg demonstrated the tool’s capabilities, which not only translate content but also “simulate the voice of a person speaking another language and sync their lips.” Although it was a pre-recorded demo, the technology’s potential was evident.

The feature will initially roll out to select creators’ videos in English and Spanish in the U.S. and Latin America. While Meta hasn’t provided a specific timeline, it has confirmed that more languages will be added soon.

This AI-powered dubbing tool is just one of the many AI-driven features showcased at Meta Connect. The company’s AI platform now enables voice chat with celebrity voices, allowing users to interact with their favorite personalities. Additionally, Meta AI has introduced new image features, enabling users to alter and edit photos based on text instructions within Instagram, Messenger, and WhatsApp.

Meta’s AI technology has the potential to revolutionize the way we interact with content, making it more accessible and engaging for users worldwide. With its ability to simulate voices and sync lips, this tool can help break language barriers and open up new opportunities for creators and users alike.

Key Features of Meta’s AI-Powered Dubbing Tool:

• Automatically dubs Reels into other languages with lip syncing
• Simulates the voice of a person speaking another language
• Syncs lips with the translated audio
• Initially available for select creators’ videos in English and Spanish
• More languages to be added soon