User interface detects tongue movement with Kinect

I must say, the Kinect system that was introduced to the world for use with the Xbox 360 console has certainly spawned far more hacks compared to the PS Move or the Nintendo Wiimote. Today, we shall look at yet another hack, where this particular one hails from a research group at The University of Electro-Communications, as this team has managed to develop an interface that is capable of detecting tongue movement using nothing but the Kinect alone. Needless to say, this particular interface is meant for training one’s oral muscles, including the tongue, targeting those who have oral motor function disorders which affect their ability to speak or swallow. There is also a suggestion by this research group to use it as a hygienic detection method, since there is no need to attach any device to the tongue. A further explanation of the system is available right after the jump.

“First of all, the face and eyes are detected using Kinect. When both eyes are recognized, the system can estimate the position of the nose, and based on the position of the nose, movement values are obtained. The minimum movement value indicates the tip of the nose. Based on that position, the system determines the mouth area. Based on the mouth area, movement values are obtained, like before. So finally, the position of the tongue is obtained. One way of training the tongue is to move it left and right. We’ve created a shooting game based on that motion. When you stick your tongue out, a bullet is shot from the player in the middle. The bullet’s trajectory depends on which way the tongue is pointing. That’s how you aim at the targets in this game.”

Read more about Kinect.

Take action: Like | G+ | Tweet | Pin | User Comments



You May Also Like

Kung-Fu For Kinect Will Be Arriving On The Xbox One Next Month

New Xbox One Experience Drops Kinect Gestures

Xbox One Kinect Bundle Goes On Promotion For A Limited Time Only

Kinect Widely Used For Biometric Sign-In, Not As Much For Gaming

Microsoft Reassures They Have Kinect Games In The Works

Microsoft Clarifies Kinect Requirement For Cortana On Xbox One

Cortana Will Be Coming To The Xbox One, Kinect Might Be Required

Music Conductor Integrates The Kinect Into His Performance

Most Shared

The Sega Saturn Has Finally Been Cracked After 20 Years

Lady Advertises Herself As A Pokemon GO Trainer For $20 An Hour

Samsung Galaxy Wide Officially Announced

LG To Restructure Mobile Division Following Poor LG G5 Sales

HTC ‘Marlin’ Nexus Specs Leaked

Some OnePlus 3 Users Complaining Of Yellowish Smudge On Their Screens

It Looks Like China Ripped Off Super Smash Bros. As Well

id Software Explains Why Quake Champions Is A PC-Only Game

Man Sues Apple For $10bn Alleging iOS Devices Infringed On His Ideas

Game Of Thrones Confirmed To Have 13 Episodes Left In The Series

Blizzard Wants To Help Combat Harassment On Twitch

Russian Embassy Tweets Image From Command & Conquer To Warn Of Terrorism

Fans Want Help Raising $20 Million To ‘Fix Dorne’ In Game Of Thrones

Hyperloop One’s First Public Speed Test Is A Success

Apple Hit With $2.8 Billion Lawsuit Over iMessage & FaceTime

Alleged iPhone 7 Dummy Unit Photo Surfaces