Multi-Path Sound Diffraction Rendering With Multi-Layer Raster Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR/VR systems face challenges in accurately simulating sound diffraction in real-time due to limitations in modeling sound wave propagation, leading to audible artifacts when users move around occluding objects.
Innovation Solution
The use of multi-layer raster maps to encode and decode information on multiple sound wave propagation paths, including diffraction and reflection, to generate accurate audio output signals, using audio and metadata decoders/encoders and signal generators.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If only the shortest propagation path is considered in diffraction simulation, then real-time rendering is achieved, but audible artifacts occur when users move around occluding objects
Solution Approach 1:
The patent segments the sound propagation paths by introducing multiple path types (direct path, reflected paths, and diffracted paths) instead of relying on a single shortest path. This segmentation allows the system to maintain real-time performance while improving audio realism by selecting appropriate path types based on listener position relative to occluding objects.
2Reliability
If multiple sound propagation paths are simulated, then audio realism is improved, but computational complexity increases
Solution Approach 1:
The patent implements dynamic path selection based on the listener's position. The system dynamically determines whether to use direct paths, reflected paths, or diffracted paths by evaluating the listener's position relative to occluding objects. This dynamic approach maintains audio realism while controlling computational complexity by activating only the necessary path types for each scenario.
Solution Approach 2:
The patent introduces an intermediary selection mechanism that chooses between different path types based on geometric conditions. This intermediary layer (the path selection logic) simplifies the overall computational complexity by avoiding the need to calculate all possible paths simultaneously, while still providing multiple path options to maintain audio realism.
3Productivity
If geometric acoustic approaches are used for low latency rendering, then real-time performance is achieved, but accuracy in simulating sound wave phenomena is reduced
Solution Approach 1:
The patent changes the parameters of the geometric acoustic model by incorporating multiple path types (direct, reflected, diffracted) with different propagation characteristics. This parameter expansion allows the system to maintain the efficiency of geometric acoustic approaches while improving the accuracy of sound propagation simulation by selecting the appropriate path type based on the acoustic scenario.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces audible artifacts by providing detailed sound wave propagation paths, enhancing the realism of audio-visual environments in AR/VR systems.
Implementation Method 1
The auralization process simulates the sound propagation in the virtual environment by taking into account acoustic effects like occlusion, reflection, and diffraction of sound waves
Implementation Method 2
The auralization process simulates the sound propagation in the virtual environment by taking into account acoustic effects like occlusion, reflection, and diffraction of sound waves
Data Source
AI summary
An apparatus for decoding according to an embodiment is provided. The apparatus comprises an audio signal decoder for decoding an encoding of an audio object signal of an audio object. Moreover, the apparatus comprises a metadata decoder for decoding an encoding of metadata, wherein, for each of a plurality of listener positions, the metadata comprises information on two or more different sound wave propagation paths from a sound source position of the audio object to the listener position. Furthermore, the apparatus comprises a signal generator for generating one or more audio output signals depending on the audio object signal and depending on the information on the two or more different sound wave propagation paths from the sound source position to a current listener position of the plurality of listener positions.