Spatial Audio Decorrelation Based on User Attention
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing spatial audio technologies fail to effectively reduce the distractiveness of sound sources that are not the focus of a user's attention, as they only rely on volume control or low-pass filtering, lacking a method to decorrelate sound based on user attention.
Innovation Solution
A method that determines a user's attention to sound sources through sensors and applies decorrelation filters, causing sound sources outside the user's focus to be perceived as more spread out, while maintaining a concise point of origin for attended sound sources, using frequency-dependent phase shifts and time delays in the spatial audio environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If volume control or low-pass filtering is used to reduce distractiveness of non-focused sound sources, then the distractiveness is reduced, but the spatial audio quality and clarity of sound sources deteriorate
Solution Approach 1:
The patent applies different spatial rendering qualities to different sound sources based on user attention. Focused sound sources maintain high spatial quality with precise location cues, while non-focused sound sources receive decorrelation processing to reduce distractiveness. This local differentiation resolves the contradiction by applying quality reduction only where needed without affecting overall spatial audio performance.
Solution Approach 2:
The system dynamically adjusts the spatial rendering characteristics of sound sources in real-time based on detected user attention. When a sound source transitions from non-focused to focused status, the system transitions from decorrelated rendering to precise spatial rendering. This dynamic adaptation allows the system to optimize between distractiveness reduction and spatial quality maintenance as conditions change.
2Object-affected harmful factors
If decorrelation filters are applied to all sound sources, then distractiveness of non-focused sources is reduced, but spatial localization accuracy for focused sources deteriorates
Solution Approach 1:
The system applies decorrelation filters selectively only to non-focused sound sources while maintaining standard spatial rendering for focused sources. This localized application of the decorrelation effect reduces distractiveness without compromising the spatial localization accuracy of attended sound sources, directly resolving the contradiction between these two requirements.
Solution Approach 2:
The spatial rendering parameters are dynamically adjusted based on real-time attention detection. The system continuously monitors user attention and switches the rendering mode of each sound source accordingly - applying decorrelation when a source is non-focused and maintaining precision when focused. This dynamic control ensures that localization accuracy is preserved for attended sources while reducing distractiveness for unattended sources.
3Adaptability or versatility
If continuous spatial rendering with precise location cues is used, then spatial audio experience is enhanced, but user distractiveness from multiple sound sources increases
Solution Approach 1:
The system maintains high-quality spatial rendering with precise location cues for focused sound sources while applying decorrelation to non-focused sources. This creates a differentiated audio experience where the user enjoys immersive spatial audio for attended content without being distracted by unattended sound sources, resolving the contradiction between spatial experience quality and user distractiveness.
Solution Approach 2:
The spatial rendering characteristics are dynamically adapted based on user attention state. When a sound source becomes the focus of attention, the system switches to precise spatial rendering to enhance the spatial audio experience. When sources are non-focused, the system applies decorrelation to reduce distractiveness. This dynamic adaptation allows the system to optimize both spatial experience and user engagement simultaneously.
Data Source
AI summary
A method includes determining a measure of a user's attention to a sound source in a spatial audio environment. Based on the measure of the user's attention to the sound source, one or more filters for decorrelating the sound source are determined. The sound source is spatially rendered, including applying the one or more filters to the sound source.