New AI powered wearable device can detect gestures

Image courtesy : Rabaey lab

Engineers at the University of California, Berkeley have developed a system that can recognize hand gestures based on electrical signals detected in the forearm. 

The system, which uses wearable biosensors with artificial intelligence (AI), could one day be used to control prosthetics or interact with almost any electronic device type.

“Prosthetics are one important application of this technology, but besides that, it also offers a very intuitive way of communicating with computers,” said Ali Moin, who helped design the device as a doctoral student at UC Berkeley’s Department of Electrical Engineering and Computer Sciences. 

Reading hand gestures is one way of improving human-computer interaction. And, while there are other ways of doing that, by, for instance, using cameras and computer vision, this is a good solution that also maintains an individual’s privacy.”

To create the hand gesture recognition system, the team collaborated with Ana Arias, an electrical engineering professor at UC Berkeley, to design a flexible armband that can read the electrical signals at 64 different points on the forearm.

The electrical signals are then fed into an electrical chip, which is programmed with an AI algorithm capable of associating these signal patterns in the forearm with specific hand gestures.

The team succeeded in teaching the algorithm to recognize 21 individual hand gestures, including a thumbs-up, a fist, a flat hand, holding up individual fingers, and counting numbers.

The new wearable device uses a type of advanced AI called a hyperdimensional computing algorithm capable of updating itself with new information.

Gesture recognition has seen some momentum in the past few years.

This year, we saw a new Apple Watch Band accessory called the Mudra band that lets users interact with their Apple Watch touch-free.

Mudra Band brings gesture control to Apple Watch

Apple has also been actively pursuing research on gesture-based user interfaces. 

The company’s research focused on detecting user’s motion and gesture input via arm or finger movements using myoelectric sensors.

It is unknown which of the leading wearable makers will unveil gesture recognition on their devices in 2021.

Still, given the rumors of a revamped Apple Watch, we could soon see thinner Apple Watches with gesture recognition.

Source: High Five or Thumbs-up? New device detects gestures

I am a technologist with years of experience with Apple and wearOS products and have a Bachelor’s degree in Computer Science. In my day job, I advise fortune 500 companies with their digital transformation strategies and also consult with numerous digital health startups in an advisory capacity. I'm VERY interested in exploring the digital health&fitness-tech evolution and keep a close eye on patents, FDA approvals, strategic partnerships and developments happening in the wearables and digital health sector. When I'm not writing or presenting, I run with my Apple Watch or Fossil Gen 5 LTE and keep a close eye on my HRV and other recovery metrics.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.