{"id":643669,"date":"2013-02-24T11:00:43","date_gmt":"2013-02-24T16:00:43","guid":{"rendered":"http:\/\/gigaom.com\/?p=613204"},"modified":"2013-02-24T11:00:43","modified_gmt":"2013-02-24T16:00:43","slug":"a-futuristic-gesture-pointgrab-aims-to-bring-remote-motion-control-to-ios-devices","status":"publish","type":"post","link":"https:\/\/mereja.media\/index\/643669","title":{"rendered":"A futuristic gesture: PointGrab aims to bring remote motion control to iOS devices"},"content":{"rendered":"

You can use remote gestures to control your laptop, your video game console and your TV. So why not the device you use more than any other?<\/p>\n

In a similar fashion to how Microsoft’s Kinect brought gesture controls to the Xbox, PointGrab<\/a>, using a different technology, is trying to bring hands-free, gesture-based control to iOS games and apps. Gestures can be easily learned and perhaps even more natural than learned input mechanisms like tap to zoom or pinch to enlarge, PointGrab CEO Assaf Gad argues.<\/p>\n

\u201cThe same way we as people interact with each other, we can allow devices to understand our body language,\u201d he told me via Skype from PointGrab\u2019s headquarters in Hod Hasharon, Israel last week.<\/p>\n

For example, he said, all children know the finger-to-lips \u201cshush\u201d gesture that means \u201cquiet down.\u201d So, rather than hunting for a button or volume menu to lower the volume, why can\u2019t our devices know that action means we want the sound muted?<\/p>\n

Motion control can be natural and fun — hands-free Angry Birds, anyone? — but occasionally necessary too: devices that understand remote gestures would let you, for example,\u00a0scroll down the recipe you have open on your iPad while your hands are still wet or covered in raw egg.<\/p>\n

How it works<\/h2>\n

PointGrab doesn\u2019t require additional hardware to make this happen — it uses the device\u2019s own camera. PointGrab\u2019s technology uses motion-detecting algorithms to identify the X and Y coordinates of a person\u2019s hand through the camera. Gad says the software can detect a single finger up to 17 feet away. Here’s a video Laptop Mag shot at CES 2013<\/a>\u00a0of a free app PointGrab created simply to demonstrate its technology on an iPhone or iPad.<\/p>\n

You can also download that app, called CamMe<\/a>, from the iOS App Store yourself. I tried it out and it works as promised\u00a0although it’s occasionally a bit slow: if you want a self-portrait or group photo but don’t have Inspector Gadget arms, you can use this by setting your device on something, raising your hand to turn on the camera from a couple feet away and closing your fist when you’re ready. The app counts down three seconds before snapping the photo. The downside is you’re using the front-facing camera, which isn’t as good as the iPhone’s rear camera.<\/p>\n

Gad emphasizes that this isn\u2019t supposed to replace a touchscreen altogether but is for use in certain cases: \u201cWe\u2019re extending a user interface for specific scenarios in mobile.\u201d<\/p>\n

A gesture-controlled future<\/h2>\n

But there\u2019s growing momentum in this space. In the living room, it\u2019s already moved from futuristic fantasy to Thing Normal People Use, thanks to Microsoft’s success with the Kinect<\/a>. And Samsung, the world\u2019s largest TV maker,\u00a0wants to replace your remote with your hand <\/a>when controlling its new smart TVs.<\/p>\n

\"CamMe_iPad\"<\/a>But the most high profile up-and-comer now trying to make gesture-based computing happen for a broader user segment is Leap Motion<\/a>, whose mission is to bring 3D motion control to computers. (Its website contains the rather cheeky phrase, “Typing? Seriously? That’s fine for writing a novel.”) It recently got $30 million in venture funding to try to pull this off.
<\/del><\/p>\n

PointGrab, meanwhile, has been around since 2008. Its gesture-control software has been in Fujitsu laptops since 2010, and the company has worked with Asus and Samsung on laptops too. But PointGrab is looking past laptops now; it wisely sees the future is more mobile and is attempting to get developers interested in using the technology in their iOS apps.<\/p>\n

The thing LeapMotion has going for it that PointGrab does not yet is active third-party developer interest — there are 12,000 developers working with LeapMotion\u2019s SDK. But PointGrab hopes to change that soon. This week at Mobile World Congress in Barcelona, PointGrab is for the first time opening up its SDK to anyone who wants to give it a whirl.<\/p>\n

Gad is particularly hoping for forward-thinking developers who aren’t satisfied with only touch or voice-based control of the iPhone or iPad. “I\u00a0think existing applications always try to find another way for interaction or another way to suggest new features to the user. I believe our technology will ad another capability.”<\/p>\n

PointGrab’s SDK will be free at first for those who have “good ideas” for how to apply the software to their apps.<\/p>\n

\"\"<\/p>\n

<\/a><\/p>\n

Related research and analysis from GigaOM Pro:<\/strong>
Subscriber content. Sign up for a free trial<\/a>.<\/p>\n