Dynamic Depth Visual Audio Representation in XR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing devices that display visual representations of audible data in XR environments often require users to shift their focus between different depths, leading to eye strain, as these representations are typically displayed at a fixed location or depth, not aligning with the user's point of interest.
Innovation Solution
A system and method that identify a region of interest within a 3D environment based on user gaze or audio signals, allowing visual representations to be displayed at the same depth and location as the user's focus, reducing eye strain by matching the depth-of-focus and adjusting font size accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If visual representations are displayed at a fixed location or depth in XR environment, then device complexity is reduced and implementation is simplified, but user comfort deteriorates due to eye strain from frequent focus adjustments
Solution Approach 1:
The patent implements dynamic display positioning where visual representations are rendered at varying depths corresponding to the distance of audio sources from the user. The system continuously adjusts the display location based on real-time audio spatial information, transforming a static fixed-location display into a dynamic adaptive display that moves with the audio scene, thereby eliminating eye strain while maintaining system simplicity
Solution Approach 2:
The system changes the depth parameter of visual representations based on the distance parameter of audio sources. By dynamically adjusting the depth parameter of displayed text or visual elements to match the spatial distance of corresponding audio sources, the system creates a consistent depth perception that reduces focus adjustments and improves user comfort without significantly increasing device complexity
2Device complexity
If visual representations are displayed at fixed depth, then rendering complexity is reduced, but information clarity deteriorates because representations do not align with user's point of interest
Solution Approach 1:
The patent extends the display from a two-dimensional fixed plane to a three-dimensional space by incorporating depth as a variable dimension. Visual representations are positioned at different depths along the z-axis corresponding to audio source distances, creating a spatially-aware display system that maintains information alignment with user interest points while adding dimensional richness without excessive rendering complexity
3Adaptability or versatility
If visual representations are displayed away from region of interest, then display layout flexibility is improved, but user attention efficiency deteriorates due to focus shifting requirements
Solution Approach 1:
The system creates an equipotential display experience by positioning visual representations at the same depth plane as the corresponding audio source. This eliminates depth differences that would require focus adjustments, allowing users to consume visual and auditory information simultaneously without attention efficiency losses, while maintaining flexible layout adaptability through spatial positioning
Data Source
AI summary
A method includes presenting a representation of a three-dimensional (3D) environment from a current point-of-view. The method includes identifying a region of interest within the 3D environment. The region of interest is located at a first distance from the current point-of-view. The method includes receiving, via the audio sensor, an audible signal and converting the audible signal to audible signal data. The method includes displaying, on the display, a visual representation of the audible signal data at a second distance from the current point-of-view that is a function of the first distance between the region of interest and the current point-of-view.