Extended Audio Object Modeling for Lower-Complexity 6 DoF Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio rendering systems struggle with high computational complexity in rendering 6 DoF audio experiences due to the complex interplay between changing listening positions and audio object extents, particularly when considering significant translational movements of listeners, which existing techniques fail to address effectively.
Innovation Solution
A method and apparatus for modeling extended audio objects that adaptively model spatial extent based on user positions, using simplified parameters to determine virtual audio sources, reducing the need for detailed information about audio object form, position, and user movement, thereby simplifying 6 DoF rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If detailed modelling of audio object extent and position is performed for 6 DoF rendering, then spatial accuracy and realism are improved, but computational complexity increases significantly
Solution Approach 1:
The patent transforms the complex spatial modelling problem by changing parameters from detailed geometric representations to simplified extent parameters (minimum and maximum extent values) that can be efficiently processed. The audio object extent is modeled using minimal parameters (extent_min, extent_max) rather than full geometric descriptions, reducing computational load while maintaining spatial accuracy for 6 DoF rendering
Solution Approach 2:
The patent segments the audio rendering process into distinct components: spatial positioning of audio objects, determination of extent parameters, and rendering calculation. This segmentation allows each component to be optimized independently, with extent parameters pre-calculated and stored, reducing real-time computational complexity during rendering
2Ease of operation
If existing audio rendering systems are used, then implementation simplicity is maintained, but they fail to address larger translational movements of listeners in 6 DoF environments
Solution Approach 1:
The patent introduces dynamic adaptation by calculating audio object extent parameters based on the listener's current position and orientation in 6 DoF space. The extent parameters are not fixed but are dynamically determined relative to the listener's viewpoint, enabling the system to adapt to larger translational movements while maintaining a relatively simple implementation framework that builds upon existing 3 DoF rendering concepts
Solution Approach 2:
The patent introduces extent parameters as an intermediary layer between the audio object's geometric representation and the final rendering calculation. These intermediate parameters (extent_min, extent_max) simplify the complex interaction between listener position and audio object geometry, providing a bridge that maintains implementation simplicity while enabling 6 DoF translational movement handling
Data Source
Figure 1~2(a)
Figure 2(b)~3
Figure 4~5(a)
AI summary
A method of modelling extended audio objects for audio rendering in a virtual or augmented reality environment is described. The method comprises obtaining an extent representation indicative of a geometric form of an extended audio object and information relating to one or more first audio sources that are associated with the extended audio object. Furthermore, the method comprises obtaining a relative point on the geometric form of the extended audio object based on a user position in the virtual or augmented reality environment. The method also comprises determining an extent parameter for the extent representation based on the user position and the relative point and determining positions of one or more second audio sources, relative to the user position, for modelling the extended audio object. In addition, the method comprises outputting a modified representation of the extended audio object for modelling the extended audio object.