Near future
Contact us
  • Home
  • Tech
  • Health
  • Environment
  • Architecture
  • energia
  • Transportation
  • Spazio
  • AI
  • concepts
  • Gadgets
  • Italy Next
  • H+
June 26 2022

Coronavirus / Russia-Ukraine

Near future

TEO, the robot that speaks sign language

Research from the University of Madrid allowed TEO, a humanoid robot, to "learn" to communicate in sign language. The applications are endless

Gianluca Riccio di  Gianluca Riccio
July 9 2019
in Robotica
Send to FacebookPin on PinterestSend on TwitterSend on Whatsappon Linkedin

Scientists from the Charles III University of Madrid (UC3M) have published a paper with the results of a research on the integration between robots and people with disabilities.

Beyond the interesting data, a part of the study stands out, which involved the planning of TEO, a humanoid robot, which has "learned" to communicate in sign language.

TEO (Task Environment Operator) is the result of a previous research carried out by the Robotics Lab, and has served as a "student" for this study.

To acquire this ability, a robot must be able to combine different areas: AI, neural networks, artificial vision, and express them through appropriately engineered robotic hands.

Maybe you are also interested

Kenguru, an electric minicar that can be driven in a wheelchair

T'ROI and the simple things that change the world

EyeHarp, an instrument that makes paralyzed people play with their eyes

Air4All, an airplane seat that becomes a wheelchair for people with disabilities

“One of the major new developments in this research is the union of two broad areas of robotics. Complex systems (hands or robotic arms) and communication / social interaction skills ". He explains it Juan Víctores, one of the Robotics Lab researchers in the Systems Engineering and Automation Department at UC3M.

In fact, the first activity carried out as part of this research was to instruct TEO. Through a simulation, the robot received indications on the specific position of each phalanx to express each element of the sign language.

The attempt to make the robot reproduce positions and movements very similar to those performed by a human being can already be said to be largely successful.

“The goal is to look natural. Various types of neural networks have been used to achieve this adaptation. The mix of gestures and breadth that can be understood by the people who communicate with this language ", clarifies the research.

In the last test phase, the scientists verified the functioning of TEO by making it interact with real users. "Those who came into contact with the robot gave 80% positive feedback, a more than satisfactory answer", says another of the researchers, Jennifer J. Gago.

It is true that the conversation developed by TEO is less than basic. The robot has dedicated itself to reproducing one by one the letters of the sign language alphabet and a limited dictionary of words related to familiar objects. He did it well, but it obviously must be considered a starting point. The challenge of this system is now to synthesize more complex gestures, entire sentences, coding criteria.

What TEO can do

When the process is complete, TEO will play a very important role in the relationship with the more than 13000 people in Spain who use sign language, and with others in the world.

TEO and sign language will be able to replace Google Home or Alexa as a virtual assistant that communicates directly with gestures. Not only that: considering the fact that TEO has the ability to iron (I'm not kidding, it's one of the “learned” skills), fold clothes, serve food and interact with users who use other languages.

TEO can become a sign language interpreter to be hired in every public building to allow everyone to access the services of a municipality.

The really important thing about these studies is their destination in society: and technology thus becomes a tool of true inclusion.

More info: Jennifer J. Gago et al. Sign Language Representation by TEO Humanoid Robot

tags: robotic armdisabilitysign languageLISrobotic hand

Maybe you are also interested in:

millirobot
Robotica

Dawn of the Millirobot Planet: Here are 6 truly incredible ones

CRAB ROBOT
Robotica

A tiny remote-controlled crab is the smallest walking robot in the world

Millirobot lungs intestine
Medicine

A 'millirobot' climbs through the intestines to administer drugs

COLLABORATE

To submit articles, disclose the results of a research or scientific discoveries write to the editorial staff
  • solar paint

    Solar paint: where are we?

    378 Shares
    Share 151 Tweet 94
  • BrintØ, an artificial island to produce green hydrogen

    148 Shares
    Share 59 Tweet 37
  • Move objects with thought? Telekinesis is a matter of technology

    141 Shares
    Share 56 Tweet 35
  • Meta shows the impact of the Metaverse in its new campaign

    371 Shares
    Share 148 Tweet 93
  • New 3D batteries: electric vehicles over 98% charged in less than 10 minutes

    1335 Shares
    Share 534 Tweet 334

archive

Have a look here:

Technology

The Pentagon laser also identifies people with covered faces

According to an article in the MIT magazine, the US Department of Defense has a laser device that can identify a ...

Read More
musk die

“Dying is better,” says Elon Musk. That's why for me he is dead wrong.

Celiac Disease

Celiac disease: in the past 25 years it has doubled in children

Unexplained area discovered on the surface of Mars

Pinching, spray skin to repair wounds and burns

The daily tomorrow

Futuroprossimo.it provides news on the future of technology, science and innovation: if there is something that is about to arrive, here it has already arrived. FuturoProssimo is part of the network ForwardTo, studies and skills for future scenarios.

Subscribe to our newsletter

Environment
Architecture
Artificial intelligence
Gadgets
concepts
Design

Staff
Archives
Advertising
Privacy Policy

Medicine
Spazio
Robotica
Work
Transportation
energia

To contact the FuturoProssimo editorial team, write to [email protected]ossimo.it

Chinese Version
Édition Française
Deutsche Ausgabe
Japanese version
English Edition
Edição Portuguesa
Русское издание
Spanish edition

The daily tomorrow

Futuroprossimo.it provides news on the future of technology, science and innovation: if there is something that is about to arrive, here it has already arrived. FuturoProssimo is part of the network ForwardTo, studies and skills for future scenarios.

Chinese Version
Édition Française
Deutsche Ausgabe
Japanese version
English Edition
Edição Portuguesa
Русское издание
Spanish edition

Staff
Archives
Advertising
Privacy Policy

Subscribe to our newsletter

To contact the FuturoProssimo editorial team, write to [email protected]

Categories

This work is distributed under license Creative Commons Attribution 4.0 International.
© 2021 Futuroprossimo

No Result
View All Result
  • Home
  • Tech
  • Health
  • Environment
  • Architecture
  • energia
  • Transportation
  • Spazio
  • AI
  • concepts
  • Gadgets
  • Italy Next
  • H+