Gaze-Based Audio Presentation in AR and VR Environments
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual and augmented reality systems fail to effectively manage audio presentation based on user gaze direction, leading to distractions from irrelevant audio sources and a lack of immersive experience.
Innovation Solution
A system that tracks a user's gaze direction to modify audio presentation dynamically, enhancing audio associated with focused virtual content and diminishing irrelevant audio, including ambient sounds, by using a combination of presentation devices, sensors, and machine-readable instructions to control audio output based on virtual and real-world content locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If audio content is presented from all virtual objects simultaneously, then complete audio information is provided, but user attention is scattered and immersion is reduced
Solution Approach 1:
The patent applies local quality by differentiating audio presentation based on user gaze direction. Audio content associated with virtual objects in the user's gaze direction is enhanced while audio from other objects is diminished. This creates spatially varying audio quality that matches the user's visual attention, resolving the contradiction between providing complete audio information and managing user attention effectively.
Solution Approach 2:
The system dynamically adjusts audio presentation in real-time based on tracked gaze direction. As the user moves their gaze between different virtual objects, the audio enhancement and diminishment dynamically follow the gaze direction. This dynamic adaptation allows the system to maintain audio information completeness while continuously optimizing attention management based on current user focus.
2Ease of operation
If gaze tracking and dynamic audio modification are implemented, then user immersion is enhanced, but system complexity increases
Solution Approach 1:
The patent integrates multiple functions into a unified system: gaze tracking, virtual object identification, audio content association, and dynamic audio modification all work together through a single integrated architecture. The system uses the existing gaze tracking capability multi-functionally to both identify user attention and control audio presentation, reducing overall system complexity despite the advanced features provided.
Solution Approach 2:
The system implements feedback by continuously monitoring user gaze direction and using this information to adjust audio presentation in real-time. The gaze tracking system provides feedback about user attention, which the audio modification component uses to enhance or diminish audio content. This closed-loop feedback mechanism enhances immersion while maintaining manageable system complexity through efficient information reuse.
Data Source
AI summary
A system configured to provide gaze-based audio presentation for interactive experiences. The interactive experiences may take place in an interactive space. An interactive space may include one or both of augmented reality (AR) environment, a virtual reality (VR) environment, and/or other interactive spaces. The interactive space may include audio content and/or virtual content. A user's gaze may be tracked. Based on the user's gaze indicating they are looking at a given virtual object, the audio content may be modified. The modification may include one or more of increasing audio content specifically associated with given virtual object, decreasing a volume of other audio content, and/or other modifications.