advertisement

Hearing management

Updated 06 December 2017

Computers better at lip-reading

A new study by the University of East Anglia (UEA) suggests computers are now better at lip-reading than humans.

0

A new study by the University of East Anglia (UEA) suggests computers are now better at lip-reading than humans.

The peer-reviewed findings will be presented for the first time at the eighth International Conference on Auditory-Visual Speech Processing (AVSP) 2009, held at the University of East Anglia from September 10-13.

A research team from the School of Computing Sciences at UEA compared the performance of a machine-based lip-reading system with that of 19 human lip-readers. They found that the automated system significantly outperformed the human lip-readers scoring a recognition rate of 80%, compared with only 32% for human viewers on the same task.

Furthermore, they found that machines are able to exploit very simplistic features that represent only the shape of the face, whereas human lip-readers require full video of people speaking.

The study also showed that rather than the traditional approach to lip-reading training, in which viewers are taught to spot key lip-shapes from static (often drawn) images, the dynamics and the full appearance of speech gestures are very important.

New video-based training system
Using a new video-based training system, viewers with very limited training significantly improved their ability to lip-read monosyllabic words, which in itself is a very difficult task. It is hoped this research might lead to novel methods of lip-reading training for the deaf and hard of hearing.

"This pilot study is the first time an automated lip-reading system has been benchmarked against human lip-readers and the results are perhaps surprising," said the study's lead author Sarah Hilder.

"With just four hours of training it helped them improve their lip-reading skills markedly. We hope this research will represent a real technological advance for the deaf community."

Agnes Hoctor, campaigns manager at the RNID, said: "This research confirms how difficult the vital skill of lip-reading is to learn and why RNID is campaigning for people who are deaf or hard of hearing to have improved access to classes. We would welcome the development of video-based or online training resources to supplement the teaching of lip-reading. Hearing loss affects 55 per cent of people over 60 so, with the ageing population, demand to learn lip-reading is only going to increase." – (EurekAlert, September 2009)

Read more:
Humans develop bat-like radar

 

Read Health24’s Comments Policy

Comment on this story
0 comments
Comments have been closed for this article.

Ask the Expert

Hearing Expert

Dr Kara Hoffman graduated from UCT in 2004, thereafter she completed her year of community service in Durban. In 2010 she completed her Masters Degree in Paediatric Aural Rehabilitation from UKZN. In 2016, she became a Doctor of Audiology through the University of Arizona (ATSU). Dr Hoffman and her partner Lauren Thompson opened a fully diagnostic audiology practice called Thompson & Hoffman Audiology Inc. In 2011 with world-class technology and equipment to be able to offer the broad public all hearing-related services including hearing testing for adults and babies, vestibular (balance) assessments and rehabilitation, industrial audiology, hearing devices, central auditory processing assessments for school-aged children, school screening, neonatal hearing screening programmes at Alberlito and Parklands Hospital, cochlear implants and other implantable devices, medicolegal assessments and advanced electroacoustic assessments of hearing. Thompson and Hoffman Audiology Inc. are based at Alberlito Hospital in Ballito, St Augustines Hospital in Durban and at 345 Essenwood Road, Musgrave. The practices are all wheelchair friendly. There are three audiologists that practice from Thompson & Hoffman – including Dr Kara Hoffman, Lauren Thompson & Minette Lister. The practice boasts professional, highly qualified, and extensive diagnostic services where all your hearing healthcare needs can be met. The additional licensing in vestibular assessment and rehabilitation, paediatric rehabilitation and cochlear implantation places this practice in one of the top specialist audiological positions in South Africa, with a wealth of experience in all clinical areas of audiology and is a very well respected and sought-after practice.

Still have a question?

Get free advice from our panel of experts

The information provided does not constitute a diagnosis of your condition. You should consult a medical practitioner or other appropriate health care professional for a physical exmanication, diagnosis and formal advice. Health24 and the expert accept no responsibility or liability for any damage or personal harm you may suffer resulting from making use of this content.

* You must accept our condition

Forum Rules