Virtual Acoustic Obstacle Plane Processing for 6DoF Spatial Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In the context of 6DoF spatial sound technology, determining obstacles in complex virtual environments for real-time sound processing is resource-intensive and time-consuming, limiting the degree of freedom and immersion in virtual reality and augmented reality experiences.
Innovation Solution
A method and system where an encoder extracts and transmits candidate planes that may act as obstacles, allowing a decoder to determine whether they are obstacles based on received parameters, optimizing the processing of sound effects and reducing resource usage by applying sound adjustments and diffraction effects as necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the terminal determines obstacles with respect to each unit plane in a complex virtual environment, then the accuracy of obstacle detection is improved, but the processing time and computational resources increase significantly
Solution Approach 1:
The patent segments the obstacle detection process by dividing unit planes into candidate planes based on spatial relationships with sound sources and listeners. This segmentation reduces the number of planes that need to be evaluated in full detail, thereby maintaining detection accuracy while reducing processing time and computational resources.
Solution Approach 2:
The patent performs preliminary action by pre-identifying candidate planes that have the potential to be obstacles based on their spatial position relative to sound sources and listeners. This preliminary identification filters out planes that cannot be obstacles before the actual obstacle determination process, significantly reducing the computational burden while maintaining accuracy.
2Speed
If the terminal repeatedly performs obstacle determination in response to listener movement, then the real-time responsiveness is improved, but the computational load increases
Solution Approach 1:
The patent applies preliminary action by pre-processing spatial information to identify candidate planes before the listener moves. When the listener moves, the system only needs to re-evaluate these pre-identified candidate planes rather than analyzing all unit planes from scratch, enabling real-time responsiveness with reduced computational load.
Solution Approach 2:
The patent applies local quality by focusing computational resources only on candidate planes that are locally relevant to the current sound propagation paths. Instead of uniformly processing all planes, the system selectively processes only those planes that have the potential to affect the current audio scene, reducing overall computational load while maintaining real-time performance.
3Loss of information
If detailed information on all objects is transmitted to the terminal, then the completeness of spatial information is improved, but the transmission data volume increases
Solution Approach 1:
The patent extracts only the essential spatial information needed for obstacle determination from the complete object data. Instead of transmitting all detailed information about every object in the virtual environment, the system extracts and transmits only candidate plane information that is relevant to sound propagation, reducing transmission data volume while maintaining information completeness for audio processing.
Solution Approach 2:
The patent segments the spatial information transmission by dividing complete object data into candidate plane representations. This segmentation extracts only the geometric and positional information necessary for obstacle determination, excluding unnecessary detailed object properties, thereby reducing transmission data volume while preserving the completeness of information needed for accurate obstacle detection.
Data Source
AI summary
A method and system for processing an obstacle effect in a virtual acoustic space are disclosed. The method includes receiving a parameter for an obstacle candidate plane extracted from spatial information, determining, in response to the parameter, whether the obstacle candidate plane is an obstacle related to a path between a position of a virtual sound source and a position of a user, and applying a sound effect according to the obstacle to an audio signal when the obstacle candidate plane is the obstacle. The obstacle candidate plane is a plane of an object that may become the obstacle in a sound propagation path between the virtual sound source and the user.