Hand-Controlled Voice Synthesizer CreatedCategory: Science & Technology
Posted: February 28, 2012 02:36PM
Researchers at the University of British Columbia have created a system that can allow a person to talk with their hands. This was accomplished by connecting a voice synthesizer to gloves which are tracked by 3D position sensors. The resulting sounds may not always be discernible as words, depending on the dexterity of the wearer, but the sounds are definitely word-like enough for singing.
The two gloves are given different controls, with vowel and consonant sounds on the right hand, and stopping sounds on the left hand, such as the letter B. When the right hand is open, this tells the synthesizer to produce a vowel sound, and the spatial position of the glove determines what sound is produced. Same control system for consonant sounds, but the hand is closed for those.
Currently this technology has been used for seven international duet performances. Each piece has been specifically written for the instrument, but still requires 100 hours for the performer to learn the song. Definitely gives new meaning to talking with your hands.