Spatial Cue Rendering During Decoding of Multi-Object Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for rendering multi-object or multi-channel audio signals lack flexibility in controlling the spatial positioning of audio signals during decoding, relying on fixed spatial cues that do not allow for user-defined or external system-controlled adjustments.
Innovation Solution
An apparatus and method that includes a decoder and a spatial cue renderer, which processes spatial cue information such as Channel Level Difference (CLD) to control the rendering of multi-object or multi-channel audio signals, allowing for flexible positioning by extracting and adjusting power gains based on control information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional SAC decoding is used, then audio signals can be decoded from down-mixed signals, but the spatial positioning of audio signals is fixed and cannot be controlled
Solution Approach 1:
The decoding system is segmented into independent functional modules: a decoder that processes down-mixed signals and a separate spatial cue renderer that independently controls spatial positioning. This segmentation allows the spatial rendering function to be adjusted without affecting the core decoding process, enabling flexible spatial positioning control while maintaining a relatively simple overall structure.
Solution Approach 2:
The patent introduces dynamic control of spatial cues by allowing the spatial cue renderer to adjust rendering parameters in real-time based on control information. This transforms the previously static spatial positioning into a dynamic, controllable process, enabling adaptability in spatial audio presentation without requiring complete redesign of the decoder architecture.
2Ease of operation
If spatial cue information is transmitted from encoder, then sound quality is improved, but flexibility in controlling audio signal positions is lost
Solution Approach 1:
The encoder performs preliminary extraction and transmission of spatial cue information (such as CLD values) before decoding. This preliminary action preserves the essential spatial positioning information in a compressed form that can be later expanded and controlled by the spatial cue renderer, preventing information loss while enabling subsequent flexibility in spatial control.
Solution Approach 2:
The spatial cue renderer acts as an intermediary between the transmitted spatial cue information and the final audio output. It receives compact spatial cue data from the encoder and transforms it into controlled spatial positioning in the rendered output, mediating between the limited transmitted information and the desired flexible spatial control without losing essential spatial characteristics.
Data Source
AI summary
The present research relates to controlling rendering of multi-object or multi-channel audio signals. The present research provides a method and apparatus for controlling rendering of multi-object or multi-channel audio signals based on spatial cues in a process of decoding the multi-object or multi-channel audio signals. To achieve the purpose, the method suggested in the research controls rendering in a spatial cue domain in the process of decoding the multi-object or multi-channel audio signals.