Audio Object Rendering Conflict Resolution in Free-Viewpoint Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current free-viewpoint rendering systems lack a common framework for detecting and responding to user interactions with audio objects, particularly in cases of locational conflicts, leading to unrealistic or unpleasant audio experiences during user movement within virtual or augmented reality environments.
Innovation Solution
The system detects locational conflict abnormalities between the user and audio objects during free-viewpoint rendering and modifies the audio object rendering using predetermined abnormality modification parameters, such as location, scale, rotation, and amplification, based on the user's interaction, to provide a natural and intuitive audio response.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If free-viewpoint rendering allows user movement within virtual or augmented reality environments, then user interaction flexibility is improved, but locational conflict abnormalities occur between audio objects and user location
Solution Approach 1:
The system dynamically adjusts audio object rendering parameters based on real-time detection of locational conflicts. When a conflict is detected between audio object location and user location, the system modifies parameters such as position, scale, rotation, or amplification to resolve the conflict while maintaining natural audio perception during user movement.
Solution Approach 2:
The patent applies parameter changes by modifying audio object rendering properties (location, scale, rotation, amplification) in response to detected locational conflicts. These parameter adjustments allow the system to maintain audio realism while accommodating user movement and preventing unrealistic audio experiences.
2Reliability
If audio object rendering is modified during locational conflicts, then audio experience realism is improved, but system complexity increases
Solution Approach 1:
The system implements feedback by continuously monitoring user location and audio object positions, detecting locational conflicts, and automatically applying appropriate rendering modifications. This closed-loop approach maintains audio realism without requiring complex manual intervention, as the system self-adjusts based on detected conditions.
Solution Approach 2:
The patent applies preliminary action by pre-defining multiple abnormality modification parameters and selection criteria before runtime. When a locational conflict is detected, the system selects from pre-prepared modification options based on the specific conflict type, reducing real-time computational complexity while maintaining audio quality.
3Adaptability or versatility
If multiple abnormality modification parameters are used, then rendering flexibility is improved, but processing requirements increase
Solution Approach 1:
The system applies partial action by selectively modifying only the necessary audio object parameters based on the specific locational conflict detected. Rather than always applying all possible modifications, the system chooses the minimal set of parameter changes needed to resolve each conflict type, reducing processing overhead while maintaining rendering flexibility.
Data Source
AI summary
A method including, during a free-viewpoint rendering to a user, where the free-viewpoint rendering comprises rendering of an audio object, and during relative movement between a location of the user and the audio object in the free-viewpoint rendering, detecting a locational conflict abnormality between the audio object and the location of the user; and based upon the detecting of the locational conflict abnormality, changing the rendering of the audio object, where the changing is based upon at least one predetermined abnormality modification parameter.