Youtube unveils game-changing AI dubbing tool ‘Aloud’ for creators
YouTube is collaborating with Aloud, an AI-powered dubbing service, to test a new tool that assists creators in automatically dubbing their videos into multiple languages.
artificial intelligence
Highlights
- This tool aims to make the dubbing process more efficient and cost-effective for creators
- It will allow creators to dub both new and existing videos
- It will help creators to reach a wider international audience
- The creators have the option to review and edit the transcription before Aloud generates the dub
YouTube has announced that it is currently testing a new tool designed to assist creators in automatically dubbing their videos into different languages using artificial intelligence (AI). The collaboration involves YouTube and Aloud, an AI-powered dubbing service incubated within California-based tech giant Google's Area 120.
Earlier this year, YouTube introduced support for multi-language audio tracks, enabling creators to add dubbing to both new and existing videos, thereby expanding their reach to a broader international audience. According to reports, since June 2023, creators have already dubbed over 10,000 videos in more than 70 languages.
YouTube is using AI to make it easier to dub videos in different languages. They're using an AI tool from Google called Aloud. This tool does three things: it transcribes, translates, and then dubs the video. pic.twitter.com/ynpF6ktmVQ
— Adepto (@AdeptoAI) June 26, 2023
Previously, creators had to engage third-party dubbing providers directly, which was a time-consuming and expensive process. Aloud, however, allows creators to dub their videos at no additional cost.
Future updates and implementations
Aloud, which was first introduced by Google in 2022, employs AI technology to transcribe a video in real time, translate it, and produce a dubbed version. The creators have the option to review and edit the transcription before Aloud generates the dub.
At VidCon, YouTube's VP of Creator Products, Amjad Hanif, informed the audience that the tool is currently being tested with hundreds of creators and will soon be made available to all creators. Currently, Aloud supports English, Spanish, and Portuguese, but more languages, including Hindi and Bahasa Indonesian, will be offered in the future.
Hanif also revealed that YouTube is striving to make the translated audio tracks sound like the creator's own voice, with enhanced expression and lip sync. YouTube confirmed that future developments in generative AI would enable Aloud to introduce features such as voice preservation, improved emotion transfer, and lip reanimation.
COMMENTS 0