Extended Reality Audio Scaling With Playback-Origin Offsets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality systems face challenges in accurately scaling audio sources due to incorrect origin definition, leading to improper localization and immersive experience issues, particularly when the playback location differs from the source location.
Innovation Solution
The extended reality system calculates an offset based on the audio element reference origin, an identified anchor point, and the listener's location to adjust the origin, enabling accurate rescaling and improved audio reproduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the extended reality system uses a global origin for rescaling audio elements, then the rescaling process can be simplified, but the audio localization accuracy deteriorates when the playback location differs from the source location
Solution Approach 1:
The patent introduces an offset parameter as an intermediary element between the global origin and the actual audio element origin. This offset acts as a mediator that adjusts the rescaling calculation to account for differences between source and playback locations, thereby maintaining localization accuracy without significantly complicating the overall rescaling process.
Solution Approach 2:
The patent modifies the rescaling parameters by incorporating an offset value that adjusts the origin point. Instead of using a fixed global origin, the system dynamically adjusts the origin parameter based on the relationship between source location, playback location, and audio element position, thereby improving localization accuracy.
2Productivity
If the extended reality system performs rescaling without considering the playback location geometry, then the processing speed can be maintained, but the immersive experience quality deteriorates
Solution Approach 1:
The patent performs preliminary calculations of the offset value during the audio element initialization stage, before the actual rescaling operation. This preliminary action prepares the necessary transformation parameters in advance, allowing the main rescaling process to execute quickly without compromising the quality of audio localization or immersive experience.
3Measurement precision
If the extended reality system requires one-to-one correspondence between source location and playback location, then the audio reproduction accuracy can be maintained, but the system adaptability deteriorates
Solution Approach 1:
The patent introduces dynamic adaptability by allowing the offset parameter to be calculated based on the specific relationship between source location, playback location, and audio element position. This dynamic approach enables the system to automatically adjust to different spatial configurations without requiring one-to-one correspondence, thereby improving both accuracy and adaptability.
Solution Approach 2:
The patent changes the origin parameter dynamically based on the playback location and audio element characteristics. By adjusting the offset parameter according to the specific spatial relationship, the system maintains audio reproduction accuracy while adapting to various playback environments, eliminating the need for strict one-to-one location correspondence.
Data Source
AI summary
In general, techniques are described that enables offsets for scaling audio sources in extended reality systems within tolerances. A device comprising a memory and processing circuitry may be configured to perform the techniques. The memory may store metadata specified for an audio element decoded from a bitstream, where the metadata includes a source geometry of the audio element captured at the source location that defines a source origin for reproduction in a virtual environment representative of the source location. The processing circuitry may implement a renderer initializer that performs an audio renderer initialization stage, where the renderer initializer is configured to obtain, based on the source origin, an offset for the playback location. The processing circuitry may reproduce, based on the offset, the audio element to obtain an output audio signal.