Near future
Contact us
  • Home
  • Tech
  • Health
  • Environment
  • Architecture
  • energia
  • Transportation
  • Spazio
  • AI
  • concepts
  • Gadgets
  • Italy Next
  • H+
July 6 2022

Coronavirus / Russia-Ukraine

Near future

News to understand, anticipate, improve the future.

No Result
View All Result

News to understand, anticipate, improve the future.

Read in:  Chinese (Simplified)EnglishFrenchGermanItalianJapanesePortugueseRussianSpanish

LIBS, the AI ​​that can read people's lips in videos

LIBS is a new AI system that can read the lip better than anyone else, human and otherwise. It will help the deaf (and global snoops).

Gianluca Ricciodi Gianluca Riccio
in Technology
Share76Pin15Tweet42SendShare12ShareShare8
LIBS, the AI ​​that can read people's lips in videos
December 5 2019
⚪ Reads in 3 minutes
A A

Artificial intelligence and machine learning algorithms that can read lips from videos are nothing extraordinary, actually.

In 2016, researchers from Google and the University of Oxford detailed a system that could lip-read and annotate movies with 46,8% accuracy. Does it seem little to you? It already outclassed the 12,4% accuracy of a professional human lip reader. And there was no LIBS yet.

However, 46,8% are not up to par with the capabilities that artificial intelligence can show today. State-of-the-art systems struggle to overcome ambiguities in lip movements, which prevent their performance from surpassing that of audio-based speech recognition.

In search of a more performing system, researchers from Alibaba, Zhejiang University and Stevens Institute of Technology they devised a method dubbed Lip by Speech (LIBS), which uses features extracted from speech recognitions to serve as complementary clues. The system raises the bar by a further 8%, and can still improve.

Maybe you are also interested

AAA wanted algorithm of happiness

Mr.Shadow, the song composed by the AI, I like it a little and it worries me a little

Microsoft will (without haste) withdraw its technology that reads emotions

Petvation: door with facial recognition for pets

LIBS and other similar solutions may help hearing impaired people to follow videos without subtitles. It is estimated that 466 million people worldwide suffer from hearing loss, which is about 5% of the world's population. By 2050, the number could rise to over 900 million, according to the World Health Organization.

LIBS, the AI ​​that can read the lip better than anyone else

The AI ​​method for reading the lip

LIBS derives useful audio information from several factors: Like a skilled cryptographer, AI hunts for understandable words. At that point he compares them with the labial correspondence and goes to look for all similar labile. But it doesn't stop there: it also compares the video frequency of those frames, and other technical clues, refining the search to read the lip even in words incomprehensible to our ear.

If it seems complicated, try again, but I don't promise anything.

I quote from Technology presentation paper. “Both the speech recognition and LIBS lip reader components are based on an attention-based sequence-sequence architecture, a method of machine translation that maps an input to a sequence (audio or video)."

Researchers trained AI on a first database containing over 45.000 phrases spoken by the BBC, and CMLR, the largest Chinese corpus available for Mandarin Chinese lip reading, with over 100.000 natural phrases.

The fields of application are not limited to help for the deaf. The custom of attributing a "socially noble" use to each technology must never make us forget that the main use of these technologies is in the military or security sector.

Nobody has thought that this system can make the surveillance of security even more infallible and pervasive amazing new security cameras, or new satellite systems?

With the AI ​​now become a omniscient eye it will be a joke to listen (or rebuild) our whispers even from an orbiting satellite.

Shut up! (Until he reads his thoughts too) Big Brother listens to you!

tags: AIBig Brotherartificial intelligenceSorveglianza
Previous post

Developed hydrogel which becomes firmer with increasing heat

Next Post

The birth control pill comes to be taken once a month

COLLABORATE

To submit articles, disclose the results of a research or scientific discoveries write to the editorial staff

    archive

    Have a look here:

    Here is the gun for the disabled and elderly
    Society

    Here is the gun for the disabled and elderly

    The "defensive" (laugh) Palm .38 SPL pistol, specially designed for people with reduced muscle capacity, osteoporosis or rheumatoid arthritis, as well as ...

    Read More
    Great Green Wall against desertification

    Africa, the Great Green Wall finally hits desertification

    Bicycles will be smart in the future

    Bicycles will be smart in the future

    More and more Americans are starting to use the Dark Web

    More and more Americans are starting to use the Dark Web

    Neural bypass: a paraplegic can walk again

    Neural bypass: a paraplegic can walk again

    The daily tomorrow

    Futuroprossimo.it provides news on the future of technology, science and innovation: if there is something that is about to arrive, here it has already arrived. FuturoProssimo is part of the network ForwardTo, studies and skills for future scenarios.

    Subscribe to our newsletter

    Environment
    Architecture
    Artificial intelligence
    Gadgets
    concepts
    Design

    Staff
    Archives
    Advertising
    Privacy Policy

    Medicine
    Spazio
    Robotica
    Work
    Transportation
    energia

    To contact the FuturoProssimo editorial team, write to [email protected]

    Chinese Version
    Édition Française
    Deutsche Ausgabe
    Japanese version
    English Edition
    Edição Portuguesa
    Русское издание
    Spanish edition

    This work is distributed under license Creative Commons Attribution 4.0 International.
    © 2021 Futuroprossimo

    No Result
    View All Result
    • Home
    • Tech
    • Health
    • Environment
    • Architecture
    • energia
    • Transportation
    • Spazio
    • AI
    • concepts
    • Gadgets
    • Italy Next
    • H+