Lip Reading Robots ComingCategory: Science & Technology
Posted: September 10, 2012 01:05PM
A lot can be said for nonverbal communication as it conveys emotions behind words that the words themselves, if written out or just heard, would be lacking. Nonverbal cues can be so important that researchers have taught computers how to express them, to allow for more natural communication between the computer and a user. Unfortunately, getting computers to understand the same cues is not as easy, but researchers at Manipal International University in Selangor, Malaysia have made an important step forward, as reported by Inderscience Publishers.
The new system the researchers created examines lip patterns to detect emotions. First it isolates the upper and lower lip into separate ellipses and then compares them to six common expressions: a neutral expression, happiness, sadness, anger, fear, disgust, and surprise. The software uses a genetic algorithm that enables it to learn and improve itself over time.
Potentially this and similar technology will be utilized in future computers and robots to improve communications between man and machine. Also it could be used with patients who are unable to speak as a means to improve their communication with devices such as voice synthesizers.