Deepdub, Israeli dubbing startup with artificial intelligence has begun to get serious. The company has struck a deal to translate the movie "Every Time I Die", which is currently streaming on UK Netflix for the Americas.
Deepdub will use its AI speech synthesis technology for dubbing the film in Latin American Spanish and Brazilian Portuguese. The resulting versions will contain voices that sound exactly like those of the original actors.
A revolution in dubbing
"We will accurately capture the vocal style and voice attributes of the original actors, and they will be matched to the target language," explains Oz Krakowski, CEO of Deepdub. "In this case, the dubbing in Latin American Spanish and Brazilian Portuguese require different adaptations."
Some information on Deepdub, the technology that can transform the world of dubbing (and even movies) with artificial intelligence:
- Deepdub it came out quietly in December offering AI-powered voice acting for commercials and other projects in six target languages.
- Dubbing a full movie takes more time. For Krakowski, the process could take up to eight weeks. "We have incorporated advanced manual and automatic quality control procedures," he says. "The process includes a dubbing director and a language expert reviewing the final result. Their comments are fed back into the machine to improve the results and refine the automated process in future projects."
- Needless to say, AI is much cheaper than manual dubbing. Risks for the voice acting profession? Yes and no. Opportunities for independent producers to reach a wider audience for their works? Yes of course.
And on the other hand MiLa Media itself, which produced "Every Time I Die", benefited from this possibility. Ohad Ashkenazi, the CEO of MiLa Media, intends to turn to Netflix to distribute versions with dubbing in other languages as well, but is also dealing directly with several large distributors in the Latin American market.
This is the first time that AI has doubled an entire film
It could be the first time for the entire industry. And even if Netflix doesn't later stream the dubbed versions, it's only a matter of time before a movie or TV show on this streaming service gets AI dubbing. In a few years, this technology could upset movies as we know them.
The most famous foreign actors will speak in our language with the same timbre of voice they have in their language. The lip movement will probably change one day (the technology is already being studied).
