Near future
Contact us
  • Home
  • Tech
  • Health
  • Environment
  • Architecture
  • Energy
  • Transportation
  • Spazio
  • AI
  • concepts
  • Gadgets
  • Italy Next
  • H+
August 8 2022

Coronavirus / Russia-Ukraine

Near future

News to understand, anticipate, improve the future.

No Result
View All Result

News to understand, anticipate, improve the future.

Read in:  Chinese (Simplified)EnglishFrenchGermanItalianJapanesePortugueseRussianSpanish

LipType, lip reading system that allows you to send protected messages

LipType is a lip reading system equipped with AI that allows you to send messages by moving your lips without emitting sounds.

Gianluca Ricciodi Gianluca Riccio
in Technology
Share34Pin9Tweet22SendShare6ShareShare4
lip software
March 19 2021
⚪ Reads in 3 minutes
A A

A computer lab working on simplifying human-computer interaction for people of all abilities has developed a digital lip reader with its own machine learning system to help the user understand better.

LipType is an invention of Professor Ahmed Sabbir Arif and his laboratory. In short: read the lip movement. It reads it so well that it allows people to send text messages or emails on PCs and smartphones, and to have contactless interactions with public devices such as ATMs or other kiosks. without speaking aloud.

There are other lip-reading devices, but they are not widely used because they are slow and often faulty.

The article continues after the related links

Cobi, 'Transformer' wheelchair that becomes a cane and walker

Kenguru, an electric minicar that can be driven in a wheelchair

T'ROI and the simple things that change the world

EyeHarp, an instrument that makes paralyzed people play with their eyes

A leap forward

There are a lot of mistakes in dictation, especially in noisy places. People with language problems also have problems making themselves understood, perhaps because of the accent. LipType works for anyone. People may need to send a private message while in a public space, or in a meeting, and with LipType they can just move their lips without making a sound.

Arif his students have added various filters with different algorithms artificial intelligence to allow lip reading in different lighting conditions. They then introduced an error corrector based on different language models and found that LipType was significantly faster than other existing devices.

The lip reading test

To accompany the software test, Arif's lab conducted a social study to see if people would use such a technology. They contacted students and people from the community, including people with disabilities, and conducted an online survey. The reactions were enthusiastic.

The results of the software tests were also outstanding. "LipType performed 58% faster than other models," says the researcher Laxmi Pandey. “The device has proven itself at the cutting edge in various real-world contexts, with low light and noise. The success of LipType makes me believe that it can revolutionize our interaction with each other and with IT devices ”.

The social study and the LipType lip reader study have been accepted for publication and presentation at the leading international conference on human-computer interaction.

The possible applications of the LipType lip reader

There are several possible applications for this lip reading system. Obviously LipType can bring people with disabilities very close to digital tools. In many cases it could be useful for law enforcement, to understand what happens in scenarios in which they cannot access by listening. Car interfaces can also be useful, so you can write messages while listening to music. There is a design philosophy for everything: the limit is the imagination.

Does it need to be said? Or to move your lips to say it? :)

tags: disabilitylabial
Previous post

Stad Ship Tunnel, ready to start the ambitious "naval tunnel" in Norway

Next Post

Facebook prepares the wrist controller for augmented reality: ready?

COLLABORATE

To submit articles, disclose the results of a research or scientific discoveries write to the editorial staff
  • Sentient or not? It is the least of the problems that AI will give us. Watch out for functions

    Sentient or not? It is the least of the problems that AI will give us. Watch out for functions

    172 Shares
    Share 69 Tweet 43
  • New hardware from MIT with analog synapses: 1 million faster than the human brain

    134 Shares
    Share 53 Tweet 33
  • Nuclear, for Goldman Sachs is not a transformative technology

    85 Shares
    Share 34 Tweet 21
  • Transforming dead spiders into robots: a few words on necrobotics

    61 Shares
    Share 24 Tweet 15
  • PIX-L7, the boomerang vehicle for impossible adventures

    40 Shares
    Share 16 Tweet 10

archive

Have a look here:

After the medical one, the coronavirus will lead to a mental health crisis
Medicine

After the medical one, the coronavirus will lead to a mental health crisis

For many, the stress of the coronavirus will turn into a diagnosable mental health problem. Here's dimensions of the problem and ...

Read More
gift box graphic book

The IKEA catalog will no longer be printed.

pfizer covid-19 vaccine

Pfizer: "our Covid-19 vaccine prevents 90% of infections" but ...

passive solar greenhouse

This passive greenhouse grows vegetables all year round without fossil fuels

A genetic Noah's ark in space

A genetic Noah's ark in space

The daily tomorrow

Futuroprossimo.it provides news on the future of technology, science and innovation: if there is something that is about to arrive, here it has already arrived. FuturoProssimo is part of the network ForwardTo, studies and skills for future scenarios.

Subscribe to our newsletter

Environment
Architecture
Artificial intelligence
Gadgets
concepts
Design

Staff
Archives
Advertising
Privacy Policy

Medicine
Spazio
Robotica
Work
Transportation
Energy

To contact the FuturoProssimo editorial team, write to [email protected]

Chinese Version
Édition Française
Deutsche Ausgabe
Japanese version
English Edition
Edição Portuguesa
Русское издание
Spanish edition

This work is distributed under license Creative Commons Attribution 4.0 International.
© 2021 Futuroprossimo

No Result
View All Result
  • Home
  • Tech
  • Health
  • Environment
  • Architecture
  • Energy
  • Transportation
  • Spazio
  • AI
  • concepts
  • Gadgets
  • Italy Next
  • H+