Audio Apparatus Split Rendering Ambisonic Mix
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current approaches for rendering audio in Virtual/Augmented/Mixed/Extended Reality (XR) applications often result in suboptimal audio quality, response to user movement, resource usage, and complexity, particularly in split rendering scenarios where devices have limited computational resources.
Innovation Solution
An audio apparatus that receives a plurality of audio elements representing a three-dimensional audio scene, determines a listener pose, and designates audio objects as close or remote based on distance thresholds. It generates an Ambisonic audio mix for remote audio objects and includes close audio objects directly in the audio data signal, allowing for improved rendering and distribution of audio signals across devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If all audio objects are included in the audio data signal for close audio objects, then audio quality is improved, but data transmission complexity and bandwidth requirements increase
Solution Approach 1:
The patent segments audio objects into two categories: close audio objects (included individually in the audio data signal) and remote audio objects (included in the Ambisonic audio mix). This segmentation allows the system to transmit only necessary audio data at high quality while reducing overall data complexity and bandwidth requirements.
Solution Approach 2:
The patent applies different quality levels to different audio objects based on their spatial relationship to the listener. Close audio objects receive individual processing and higher quality transmission, while remote audio objects are processed as part of the Ambisonic mix. This local quality approach optimizes audio quality where needed while reducing overall system complexity.
2Measurement precision
If audio rendering is performed entirely at the end device, then audio quality and responsiveness are improved, but device complexity and computational resources increase
Solution Approach 1:
The patent segments the audio rendering process into two parts: Ambisonic audio mix generation (performed at the edge device with less computational demand) and individual audio object processing (performed at the end device for close objects). This segmentation enables quality audio rendering while distributing computational load appropriately.
Solution Approach 2:
The patent introduces an Ambisonic audio mix as an intermediary representation that carries spatial audio information from the edge device to the end device. This intermediary format allows the end device to perform simpler rendering operations while maintaining high audio quality and spatial accuracy.
3Adaptability or versatility
If multiple audio representations are used to reflect different types of audio sources, then adaptability is improved, but processing complexity increases
Solution Approach 1:
The patent changes the representation parameter of audio objects based on their spatial characteristics. Close audio objects are represented as individual discrete objects with full spatial information, while remote audio objects are represented in the Ambisonic format. This parameter change approach maintains versatility in representing different audio sources while reducing processing complexity through format optimization.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An audio apparatus comprises a receiver (301) receiving audio elements including a number of audio objects linked with a position in an audio scene. A listener pose receiver (303) receives an indication of a listener pose and a designator (305) designates audio objects as close or remote audio objects depending on a comparison of a distance measure indicative of a distance between a pose of the first audio object and the listener pose to a threshold. An audio mix generator (307) generates an Ambisonic audio mix from a first plurality of the audio elements that includes one or more audio objects designated as remote audio object. A data generator (311) generates an audio data signal comprising the Ambisonic audio mix and which further includes audio objects that are designated as close audio objects. The audio apparatus may be an edge device operating with an audio end device to provide split rendering of audio across the devices.