Near future
Contact us
  • Home
  • Tech
  • Health
  • Environment
  • Architecture
  • energia
  • Transportation
  • Spazio
  • AI
  • concepts
  • Gadgets
  • Italy Next
  • H+
June 29 2022

Coronavirus / Russia-Ukraine

Near future

News to understand, anticipate, improve the future.

No Result
View All Result

News to understand, anticipate, improve the future.

Read in:  Chinese (Simplified)EnglishFrenchGermanItalianJapanesePortugueseRussianSpanish

A new algorithm puts other words into people's mouths in videos by editing the transcript of the text.

A collaboration between technological giants allows to alter the speech in a video simply by changing the text transcription: the person in the movie changes the words and movements of the lips.

Gianluca Ricciodi Gianluca Riccio
in Technology
Share531Pin16Tweet45SendShare12ShareShare9
A new algorithm puts other words into people's mouths in videos by editing the transcript of the text.

Male vlogger recording content for his video blog. Young man in focus on digital camera screen.

June 6 2019
⚪ Reads in 2 minutes
A A

It's becoming extremely easy (and I don't think it's only good) to alter a video, and the latest developments in AI are truly impressive.

A collaboration between giants (Stanford University and Princeton plus the Max Planck Institute for Informatics and Adobe) makes it possible to alter the speech in a video simply by modifying the textual transcription, and without creating the “dubbing” effect.

In other words, the person who is speaking on video will literally change the words of his speech, also modifying the lip movements.

Maybe you are also interested

Marilyn Monroe cover girl again, yet another 'digital resurrection'

Video conferencing, AI startup offers deepfake suits to look perfect

Instant NERF: from a few to instantly created 3D scenes: Nvidia amazes

10 superpowers of artificial intelligence that can destroy us

To achieve this somewhat disturbing result, the algorithm “learns” the phonemes and their pronunciation from the subject in the video and creates an accurate 3D model of his face, capable of replicating all sounds and movements: at that point just edit the text of the speech and the algorithm will replace the original sentence.

Currently the algorithm needs at least 40 minutes of video to "train" to replicate a person in a video.

Here is a video demonstrating how the system works:

Huge ethical doubts

It is clear that this mechanism creates the possibility that anyone can modify a discourse (perhaps of political figures or public figures) by inserting elements of hatred, or disinformation, and spreading them as original and natural: this only increases concerns about the spread of systems based on deepfake.

On the other hand, there are some positive sides, and it is in the enormous savings that the editing will achieve by avoiding re-shooting entire scenes due to small pronunciation errors.

For the rest, I am sure that other "anti-counterfeiting" methods will also be developed for videos: dynamic watermarks or watermarks that make the work of artificial intelligence even more complex, in a competition between reality and manipulation that already seems destined to characterize the next years.

More info on research here

tags: AIAlgorithmdeepfakevideo.
Previous post

Metal foam stops bullets better than steel

Next Post

A German circus uses holograms instead of animals

COLLABORATE

To submit articles, disclose the results of a research or scientific discoveries write to the editorial staff

    archive

    Have a look here:

    Airbus unveils new details on ZeroE, a hydrogen plane powered by "capsules".
    Environment

    Airbus unveils new details on ZeroE, a hydrogen plane powered by "capsules".

    Within 5 years, Airbus will have to choose the single platform for the creation of the first commercial hydrogen aircraft: among the ...

    Read More
    biodegradable

    All about the new biodegradable plastic that decomposes in the open air

    A "Super sponge" made with mussel scraps can give us a clean sea

    A "Super sponge" made with mussel scraps can give us a clean sea

    interactive map

    An interface of the future? The interactive map

    blood proteins

    Are two blood proteins the key to a long and healthy life?

    The daily tomorrow

    Futuroprossimo.it provides news on the future of technology, science and innovation: if there is something that is about to arrive, here it has already arrived. FuturoProssimo is part of the network ForwardTo, studies and skills for future scenarios.

    Subscribe to our newsletter

    Environment
    Architecture
    Artificial intelligence
    Gadgets
    concepts
    Design

    Staff
    Archives
    Advertising
    Privacy Policy

    Medicine
    Spazio
    Robotica
    Work
    Transportation
    energia

    To contact the FuturoProssimo editorial team, write to [email protected]

    Chinese Version
    Édition Française
    Deutsche Ausgabe
    Japanese version
    English Edition
    Edição Portuguesa
    Русское издание
    Spanish edition

    This work is distributed under license Creative Commons Attribution 4.0 International.
    © 2021 Futuroprossimo

    No Result
    View All Result
    • Home
    • Tech
    • Health
    • Environment
    • Architecture
    • energia
    • Transportation
    • Spazio
    • AI
    • concepts
    • Gadgets
    • Italy Next
    • H+