How to Control Your Windows Desktop With Kinect

Posted by


The Minority Report featured some incredible theoretical technologies, some of which have continued to interest geeks for years. One of these technologies was a system in which you are able to interact with the user-interface with a few hand gestures Now, imagine if you were able to control Windows 7 in much the same way. Wouldn’t that be a worthwhile project to check out?

LockerGnome community member Kevin Connolly has managed to recreate this using the Kinect SDK in a project he calls the KinectNUI (Natural User Interface). Currently, the project works with a single Kinect and any modern Windows PC.

With a swipe of your hand, you are able to switch between active windows, zoom in and out, more. While zoomed in, the Kinect will follow your movements as you walk around the room and allow you to scroll vertically using your left hand.

Future plans for the project include a pie menu to allow you to control your system in greater detail. This feature is expected to work in a similar manor to the pie menu featured in the Sims.

If you don’t like the computer responding to your every gesture, you can turn gestures on and off with a single vertical movement of your arms.

Without a doubt, this project (and others like it) have demonstrated the potential for relatively inexpensive devices like the Kinect to change the way we think about interacting with our computers.

What started as a device that took the principals of motion-controlled gaming to a new level by removing the need of a physical handheld controller is now beginning to bring to question whether or not this kind of device could actually replace the keyboard and mouse and change the landscape of computing as we know it today. While the physical technology may not be there just yet, it’s pretty interesting to think of what’s ahead.

More information about this project can be found on Kevin’s website as well as on his YouTube channel, Tsilb.