Audio Rendering Parameter Conversion for Adaptive Spatial Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Decoders are unable to generate output signals that match the number of available output channels and cannot change the spatial characteristics of audio signals, such as shifting a listener's virtual position or assigning a virtual position to specific source signals, using rendering parameters generated by encoders.
Innovation Solution
The method involves converting object parameters, including level information, using control parameters that consider device information and control information to generate rendering parameters, which are then applied to downmix signals to produce output signals that match the available output channels and modify spatial characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If rendering parameters generated by the encoder are used directly for rendering, then the decoding process is simple, but the decoder cannot generate output signals matching the number of available output channels or change spatial characteristics
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing multiple rendering parameters corresponding to different virtual listener positions and output channel configurations during encoding. The encoder generates a plurality of rendering parameters in advance, allowing the decoder to directly select and use the appropriate parameters without performing complex real-time calculations, thus maintaining decoding simplicity while achieving adaptability to different spatial characteristics and channel configurations.
2Adaptability or versatility
If rendering parameters are converted to match device information and control information, then output signals can match available output channels and spatial characteristics can be modified, but calculation complexity increases
Solution Approach 1:
The patent resolves the calculation complexity issue by performing the computationally intensive parameter conversion work in advance during the encoding stage. The encoder generates and stores multiple pre-converted rendering parameters for different virtual listener positions and channel configurations. During decoding, the system simply selects from these pre-prepared parameters rather than performing real-time conversions, thus achieving adaptability without increasing decoder complexity.
Solution Approach 2:
The patent creates multiple copies of rendering parameters, each corresponding to different virtual listener positions and output channel configurations. Instead of performing complex real-time transformations, the decoder selects from these pre-generated parameter copies that already match the desired output characteristics. This copying approach eliminates the need for complex calculation while maintaining full adaptability.
3Adaptability or versatility
If spatial characteristics are given to output signals after generation, then the output can be adjusted, but the quantity of calculation increases considerably
Solution Approach 1:
The patent applies preliminary action by incorporating spatial characteristic adjustments into the rendering parameter generation process during encoding. Virtual listener positions and spatial characteristics are built into the rendering parameters in advance, so that when the decoder applies these parameters, the spatial characteristics are already embedded in the output signal generation process itself, eliminating the need for separate post-processing calculation steps.
Data Source
AI summary
An apparatus for decoding a signal and method thereof are disclosed, by which the audio signal can be controlled in a manner of changing/giving spatial characteristics (e.g., listener's virtual position, virtual position of a specific source) of the audio signal. The present invention includes receiving an object parameter including level information corresponding to at least one object signal, converting the level information corresponding to the object signal to the level information corresponding to an output channel by applying a control parameter to the object parameter, and generating a rendering parameter including the level information corresponding to the output channel to control an object downmix signal resulting from downmixing the object signal.