deepdub, Israeli dubbing startup with artificial intelligence has started to get serious. The company has struck a deal to translate the film “Every Time I Die,” which is currently streaming on English Netflix, for the Americas.
Deepdub will use its AI speech synthesis technology for dubbing the film in Latin American Spanish and Brazilian Portuguese. The resulting versions will contain voices that sound exactly like those of the original actors.
A revolution in dubbing
“We will accurately capture the vocal style and voice attributes of the original actors, and they will be tailored to the target language,” explains Oz Krakowski, CEO of Deepdub. “In this case, dubbing into Latin American Spanish and Brazilian Portuguese require different adaptations.”
Some information on Deepdub, the technology that can transform the world of dubbing (and also films) with artificial intelligence:
- Deepdub it came out quietly in December offering AI-powered voice acting for commercials and other projects in six target languages.
- Dubbing a complete film takes more time. For Krakowski, the process could take up to eight weeks. “We have incorporated advanced manual and automatic quality control procedures,” he says. “The process includes a dubbing director and a language expert reviewing the final result. Their comments are fed back into the machine to improve the results and refine the automatic process in future projects.”
- Needless to say, AI is much cheaper than manual dubbing. Risks for the dubbing profession? Yes and no. Opportunities for independent producers to reach a wider audience for their works? Yes of course.
And on the other hand MiLa Media itself, which produced “Every Time I Die”, benefited from this possibility. Ohad Ashkenazi, the CEO of MiLa Media, intends to turn to Netflix to distribute versions with dubbing in other languages as well, but is also dealing directly with several large distributors in the Latin American market.
It is the first time that artificial intelligence has dubbed an entire film
It could be a first for the entire industry. And even if Netflix doesn't end up streaming dubbed versions, it's only a matter of time before a movie or TV show on this streaming service has AI dubbing. In a few years this technology could revolutionize films as we know them.
The most famous foreign actors will speak in our language with the same timbre of voice they have in their language. The lip movement will probably change one day (the technology is already being studied).
