Spatial Audio Rendering Extension for Distant Object Audibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing free-viewpoint audio technologies limit the user's ability to interact with and hear audio objects that are out of range or masked by closer objects, resulting in a less immersive and less interactive spatial audio experience.
Innovation Solution
The implementation of a spatial audio rendering point extension system that determines an extended spatial rendering point and area, allowing users to hear audio objects that would otherwise be inaudible or masked, through proxy-based interactions and secondary rendering points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If free-viewpoint rendering is implemented with standard spatial rendering, then users can move and rotate in the audio space, but audio objects that are out of range or masked by closer objects cannot be heard
Solution Approach 1:
The patent introduces an extended spatial rendering point as an intermediary between the user and distant audio objects. This intermediary point acts as a proxy that captures audio information from areas beyond the user's direct listening range, enabling the user to hear audio objects that would otherwise be masked or inaudible while maintaining free movement in the audio space.
Solution Approach 2:
The patent extends the spatial rendering beyond the traditional single user location by adding an extended spatial rendering point in a different spatial dimension. This creates a multi-point rendering system where audio from both the user's immediate location and the extended location are combined, effectively adding a spatial dimension to the rendering architecture.
2Ease of operation
If the user moves away from audio objects, then the user gains freedom of movement in the space, but the audio objects become inaudible or harder to hear
Solution Approach 1:
The system performs preliminary action by pre-positioning an extended spatial rendering point that anticipates the user's listening needs for distant audio objects. This extended point is established before the user moves, ensuring that audio information from distant objects is captured and made available regardless of the user's subsequent movement or positioning in the space.
Solution Approach 2:
The extended spatial rendering point serves multiple functions: it acts as a proxy for distant audio capture, provides additional spatial coverage, and enables interaction with audio objects that would otherwise be inaccessible. This multi-functional element enhances both user mobility and audio reliability simultaneously.
3Quantity of substance
If closer audio objects are present, then the audio scene is richer nearby, but distant audio objects are masked and become inaudible
Solution Approach 1:
The patent segments the audio rendering into multiple independent spatial points: the user's immediate location and an extended spatial rendering point. This segmentation allows distant audio objects to be captured at the extended point separately from closer objects at the user's location, preventing masking effects and enabling both near and distant audio to be heard simultaneously.
Solution Approach 2:
The system merges audio information from multiple spatial points (user location and extended rendering point) into a unified audio experience. This combination allows the user to hear both nearby audio objects captured at their immediate location and distant audio objects captured at the extended point, effectively combining the benefits of both proximity and distance listening.
Data Source
AI summary
A method including, determining, for a user located at a location corresponding to a free-viewpoint rendering, a spatial rendering point extension, where the spatial rendering point extension is spaced away from the location in the free-viewpoint rendering, and rendering to the user an audio object based upon the spatial rendering point extension, where without the spatial rendering point extension the audio object is either: not able to be heard by the user, or is heard differently by the user while the user is at the location, such that the rendering of the audio object based upon the spatial rendering point extension allows the user to hear the audio object while the user is at the location or allows the user to hear the audio object differently while the user is at the location.