Magic Leap’s wearable system could be used to interpret Sign Language

Mixed reality maker Magic Leap was approved for a patent today that discusses how the company’s wearable system can be used for interpreting sign language. This new patent builds upon the existing magic leap wearable spatial computer by enhancing accessibility options.


The invention is for a sensory eyewear system for a mixed reality device that can facilitate user’s interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language and present the translated information to a user of the mixed reality device.

The wearable system can also recognize text in the user’s environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.

These embodiments advantageously may permit greater interaction among differently-abled persons.

A sign language primarily uses visual gestures (e.g., hand shapes; hand orientations; hand, arm, or body movements; or facial expressions) to communicate. There are hundreds of sign languages used around the world. Some sign languages may be used more often than others. For example, American sign language (ASL) is widely used in the U.S. and Canada. 

The basic idea is that many people do know or cannot interpret sign languages. 

Magic Leap wearable for sign language
Magic leap wearable spatial computer

A speech- or hearing-challenged person and a conversation partner may not be familiar with the same sign language. This can impede conversation with the hearing-challenged or the speech-challenged persons.

Accordingly, the wearable system that can image signs (e.g., gestures) being made by a conversation partner, convert the signs to text or graphics (e.g., graphics of sign language gestures in a sign language the system user understands), and then display information associated with the sign (e.g., a translation of the signs into a language understood by the user) would greatly help improve the communication between the user and the conversation partner.Magic Leap outward facing camera

Magic Leap’s plan is to utilize the outward-facing camera on the HMD (Head-mounted device) to capture the images of gestures being made, identify signs from these gestures, translate the signs and display it to the user. A machine learning algorithm is used for the detection and translation process.

The US Patent, 10,769,858 was filed on Feb 26,2020, and was approved today (Sept 8,2020).

The inventors on this accessibility enhancing wearable are Eric Browy, Michael Janusz Woods and Andrew Rabinovich. Andrew is currently the co-founder and CTO at InsideIQ. Eric used to be the Lead Optical Systems and prototype engineer and now leads the ‘Pathfinding’ team at Magic Leap.

Previous articleMacrotellect releases new Brainlink Dual to help users achieve peak mental fitness
Next articlePopular Sleep aid app Pzizz updated with new features
Sudz Niel Kar
I am a technologist with years of experience with Apple and wearOS products, have a BS in Computer Science and an MBA specializing in emerging tech, and owned the popular site AppleToolBox. In my day job, I advise Fortune 500 companies with their digital transformation strategies and also consult with numerous digital health startups in an advisory capacity. I'm VERY interested in exploring the digital health and fitness-tech evolution and keeping a close eye on patents, FDA approvals, strategic partnerships, and developments happening in the wearables and digital health sector. When I'm not writing or presenting, I run with my Apple Watch Ultra or Samsung Galaxy Watch and closely monitor my HRV and other recovery metrics.


Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.