Watch As Kinect Interprets Sign Language
Kinect 2.0 – the updated motion control system that will be rolling out with the Xbox One – has some great new features such as being able to detect your heart rate. However, the current unit is still capable of some interesting things. Microsoft has released a video showing the current Kinect interpreting sign language. The system is presently only competent in American and Chinese (Cantonese or Mandarin?).
“Kinect, with its ability to provide depth information and color data simultaneously, makes it easier to track hand and body actions more accurately—and quickly.
- You’ll Be Able To Play (Expensive) PS2 Games On Your PS4 Now | 2 months ago
- Jessica Jones Disempowers Its Male Characters And The Effect Is Refreshing | 2 months ago
- Hell Is 30 000 Deathclaws Tearing Through Boston And It’s Glorious | 2 months ago
- Sony Santa Monica Is Teasing Something Truly Strange | 2 months ago
In this project—which is being shown during the demofest portion of faculty summit 2013, which brings more than 400 academic researchers to Microsoft headquarters to share insight into impactful research—the hand tracking leads to a process of 3-D motion-trajectory alignment and matching for individual words in sign language.
“The words are generated via hand tracking by the Kinect for Windows software and then normalized, and matching scores are computed to identify the most relevant candidates when a signed word is analyzed.”
It’s very impressive and could be something beneficial to hearing and speech impaired. How exactly it may be of help remains to be seen but the technology is certainly there and can be expanded to many more languages.