Scene Configuration Packets for Dynamic Spatial Audio Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to provide a high-definition, immersive audio experience for VR and AR applications while efficiently managing bandwidth and decoding/rendering data.
Innovation Solution
Utilizing a three-packet system comprising scene configuration, scene update, and scene payload packets to efficiently transmit, store, and update metadata for dynamic audio scenes, allowing for precise reconstruction and rendering of audio environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple data structures are used to represent different types of cells (e.g., wideband cell, subband cell, tone pair cell) in an OFDM signal, then the audio signal can be more accurately represented and decoded, but the complexity of the decoder increases due to the need to handle multiple cell types and their associations
Solution Approach 1:
The patent segments the audio frequency spectrum into different cell types (wideband cells covering multiple subbands, subband cells covering single subbands, and tone pair cells covering two adjacent subbands). Each cell type is represented by a dedicated data structure, allowing the decoder to process different spectral representations independently and efficiently, thereby managing complexity while maintaining accuracy.
Solution Approach 2:
The patent introduces a scene configuration packet as an intermediary data structure that defines associations between multiple cell types and their relationships. This intermediary layer organizes the complex multi-type cell data into a structured format, enabling the decoder to navigate and process different cell types systematically without directly managing the full complexity of all cell associations.
2Device complexity
If a single data structure is used to represent all cell types in an OFDM signal, then the decoder complexity is reduced, but the ability to accurately represent different types of cells (wideband, subband, tone pair) is compromised
Solution Approach 1:
Instead of using a single generic data structure, the patent segments the representation into multiple specialized data structures, each optimized for a specific cell type. This segmentation allows each data structure to capture the unique characteristics of wideband cells, subband cells, and tone pair cells, thereby maintaining high representation accuracy while keeping individual data structure designs simple and manageable.
Solution Approach 2:
The patent applies local quality by tailoring the data structure properties to match the specific requirements of each cell type. For example, wideband cell data structures include fields for multi-subband energy distribution, while tone pair cell structures include fields for stereo coupling information. This localized optimization ensures that each cell type is represented with the precise quality needed for accurate audio decoding.
3Adaptability or versatility
If multiple cell types with different data structures are used to represent the OFDM signal, then the audio coding flexibility and adaptability are improved, but the difficulty of detecting and measuring cell associations increases
Solution Approach 1:
The scene configuration packet serves as an intermediary that explicitly defines cell associations and relationships. Rather than requiring the decoder to infer complex associations between multiple cell types, the scene configuration packet provides a structured map of these relationships, significantly reducing the difficulty of detecting and measuring cell associations while preserving coding flexibility.
Solution Approach 2:
The patent performs preliminary action by pre-defining cell associations and configurations in the scene configuration packet before the actual audio decoding process. This preliminary organization of cell relationship information allows the decoder to quickly reference and process cell associations without performing complex real-time detection, thereby reducing measurement difficulty while maintaining adaptability.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Embodiments according to the invention are related to an audio decoder, for providing a decoded audio representation on the basis of an encoded audio representation, wherein the audio decoder is configured to spatially render one or more audio signals; wherein the audio decoder is configured to receive a plurality of packets of different packet types, the packets comprising one or more scene configuration packets providing a renderer configuration information defining a usage of scene objects and/or a usage of scene characteristics, the packets comprising one or more scene update packets defining a update of scene metadata for the rendering, the packets comprising one or more scene payload packets comprising definitions of one or more of the scene objects and/or definitions of one or more of the scene characteristics; wherein the audio decoder is configured to select definitions of one or more scene objects and/or definitions of one or more scene characteristics, which are in included in the scene payload packets, for the rendering in dependence on the renderer configuration information; and wherein the audio decoder is configured to update one or more scene metadata in dependence on a content of the one or more scene update packets. Further embodiments are related to encoders, methods and bitstreams. Further embodiments are related to decoders, encoders, methods and bitstreams with scene update packets with update conditions, with scene configuration packets providing a renderer configuration information defining a temporal evolution of a rendering scenario and with a timestamp information and/or with subscene cell information, wherein the cell information defines an association between the one or more cells and respective one or more data structures.