Meta Expands Translation Feature for Reels to Hindi and Portuguese
Meta has broadened its AI-powered translation feature for Reels to now incorporate Hindi and Portuguese. This enhancement allows more creators and audiences to connect across language barriers on Instagram and Facebook. This update follows the initial launch in August that supported English and Spanish.
Feature Overview
The feature automatically translates a creator’s voice and captions in Reels into alternative languages while matching lip-syncing to align with the speech. By supporting Hindi and Portuguese, Meta aims to solidify its global footprint, particularly in two of its largest creator regions, India and Brazil.
Insights from Instagram Leadership
Instagram head Adam Mosseri shared that there are numerous talented creators who may have potential audiences that do not share the same language. By facilitating outreach to these audiences who communicate in different languages, Meta hopes to aid creators in growing their followings and extracting more value from Instagram and the platform.
How to Activate the Translation Feature
Creators have the option to activate this translation feature by selecting “Translate your voice with Meta AI” before publishing a Reel. They can subsequently review the translated version, determine which languages to include, and refine the video’s dubbing and lip-syncing prior to posting.
Benefits for Viewers
For viewers, this latest update ensures automatic translation of Reels into their chosen language, making it easier to comprehend videos that were originally produced in different languages.
Future Developments
Meta has indicated that it is also in the process of developing further AI-driven translation tools that will be introduced shortly. Facebook Reels currently supports multi-speaker translations, and Meta has confirmed that Instagram will receive a similar function in a forthcoming update.
Text and Caption Translation
In addition to voice translations, the company is set to introduce capabilities for translating on-screen text and captions. The upcoming “Translate text on Reels” function will enable users to translate stickers or captions, which is particularly beneficial for those watching videos without sound.
Enhanced Dubbing and Synchronisation
Meta is also enhancing its dubbing technology with a new voice-preservation feature that ensures the creator’s original tone remains intact. Additionally, the company is working on a more advanced lip-syncing system to provide a more natural visual alignment.
Competition with YouTube
This expansion occurs as YouTube is also bolstering its own translation tools. Just last month, YouTube upgraded its auto-dubbing feature, achieving improved lip-sync accuracy across 20 languages.
