What is Apple’s new Spatial Audio feature? Can it enhance future A/R and V/R use cases

Apple Spatial Audio settings for AirPods

Apple introduced a feature called Spatial Audio. Available as a setting on both your iPhone and iPad, this feature has been a source of some extensive debates among developers around the functionality and the direction.

As one user explained, “Spatial Audio works by using the iPhone’s or iPad’s and the AirPods Gyroscope to realize when you turn your head around and make it still seem like the sound is coming from the device itself so basically the audio shifts around you when you turn your head.” 

Others explain that Spatial audio is sort of a simulated surround sound. 


Is Apple’s spatial audio feature merely a surround sound type feature or is there more aspiration built into it?

Based on some digging around Apple’s recent tech filings, it is becoming clear that Apple’s aspirations around the new Spatial Audio feature are more than a simple surround sound design.Apple Spatial audio navigation

It is in fact a well-thought-out value proposition to enhance accessibility features on Apple devices. A recent filing approved showcases some of the thinking behind this feature.

Apple’s Spatial Audio Navigation

According to the invention, this could be used in a spatial audio navigation system that provides navigational information in audio form to direct users to target locations. 

The system is designed to use the directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real-world path between the user’s current location and the target location. 

The system will use directional audio played through Airpods to guide the user on the path from the current location to the target location. 

Spatial Audio’s connection to Apple Smart Glasses and A/R or V/R

Apple Spatial Audio and SmartGlasses
Patent Pub # US2020/0264006

According to the patent, spatial audio is also being designed to be used in V/R and A/R systems while the users interact with the immersive artificial environment.

Some of the Apple engineers involved in this technology filing such as Bruno Sommers appear to have been a part of Apple’s AR/VR platform development. Other inventor named in the patent, Rahul Nair is currently the prototyping engineer with the ARKit group at Apple.

“embodiments of a spatial audio navigation system may also be implemented in VR/MR systems implemented as head-mounted displays (aka Apple Smart glasses) that include location technology, head orientation technology, and binaural audio output; speakers integrated with the HMD may be used as the binaural audio device, or alternatively an external headset may be used as the binaural audio device. “ 

Broadly the idea is to implement the functionality in any device or system that includes binaural audio output and that provides head motion and orientation tracking. 

Apple also suggests the use of a spatial navigation system while users are using their automobiles.

The spatial audio system in this case will use the vehicle’s “surround” speaker system as the binaural audio device to output the directional sounds to guide the user while driving to a target location.

In either case, we should soon see the beginnings of spatial audio features as iOS 14 develops over these next few weeks, getting ready to be released this September.

Previous articleAmazfit partners up with Prudential Insurance to bring new products and services
Next articlePedal, lift, jump, and punch all from home with apartment-friendly fitness tech
Sudz Niel Kar
I am a technologist with years of experience with Apple and wearOS products, have a BS in Computer Science and an MBA specializing in emerging tech, and owned the popular site AppleToolBox. In my day job, I advise Fortune 500 companies with their digital transformation strategies and also consult with numerous digital health startups in an advisory capacity. I'm VERY interested in exploring the digital health and fitness-tech evolution and keeping a close eye on patents, FDA approvals, strategic partnerships, and developments happening in the wearables and digital health sector. When I'm not writing or presenting, I run with my Apple Watch Ultra or Samsung Galaxy Watch and closely monitor my HRV and other recovery metrics.


Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.