Spatial Audio Cues for Augmented Reality UI Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users often miss relevant user interface elements in augmented reality (AR) experiences due to not constantly viewing their AR interface, leading to a sub-optimal user experience.
Innovation Solution
Utilizing spatial audio cues through audio output devices, such as headphones or speakers, to notify users of UI elements by determining their location and orientation, and generating audio cues that indicate the direction and distance of hidden or obscured UI elements, allowing users to access them without constantly viewing the AR display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If users constantly view their AR interface to ensure they notice UI elements, then user awareness of UI elements is improved, but user convenience and natural interaction are worsened
Solution Approach 1:
The patent introduces spatial audio cues as an intermediary channel to convey UI element information. Instead of requiring users to visually check the AR interface, audio output devices provide directional audio signals that indicate the presence and location of UI elements, allowing users to maintain natural behavior while staying informed about available interactions
Solution Approach 2:
The patent replaces the visual-mechanical checking behavior (users needing to look at the AR display) with an acoustic signal system. The audio cues substitute for the visual feedback loop, using sound propagation and directional audio processing to convey spatial information about UI elements without requiring visual engagement with the AR interface
2Ease of operation
If users do not constantly view their AR interface, then user convenience is improved, but user awareness of UI elements deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously monitors user location and orientation, determines which UI elements are within the user's field of view, and provides real-time audio feedback about those elements. This closed-loop feedback ensures users are informed about UI elements without needing to actively search for them, maintaining awareness while preserving convenience
3Loss of information
If AR interface is designed to be always visible, then user awareness is improved, but device complexity and power consumption increase
Solution Approach 1:
The patent extracts the information delivery function from the visual AR interface and relocates it to the audio channel. By separating the notification function from the primary visual display, the system can provide UI element awareness without requiring the AR interface to be constantly visible or requiring complex visual attention management mechanisms
Data Source
AI summary
Systems and methods are provided herein for providing spatial audio cues for notifying a user of a user interface (“UI”) element in augmented reality (“AR”). This may be accomplished by a system determining a location and orientation of a device, and then determining an estimated augmented reality view using the location and orientation of the device. The system may then determine whether a UI element is within the augmented reality view. If the UI element is within the augmented reality view, the system can play an audio cue signaling a position of the UI element using audio spatialization. After hearing the audio cue, the user may then view the UI element in AR using the device.