Object-Based Audio Rendering from Downmix and Spatial Side Information
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multi-channel and object-based audio encoding and decoding techniques face challenges in accurately localizing sound images for each object audio signal, leading to inefficiencies in sound reproduction and increased complexity in processing.
Innovation Solution
The proposed method involves an audio decoding apparatus that extracts a downmix signal and object-based side information, generates rendering information based on control data, and creates spatial information to accurately localize sound images by allocating object signals to specific positions in a multi-channel space, reducing complexity through adaptive decoding and mixing/rendering operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If object-based audio encoding and decoding techniques are used to treat object signals as basic elements, then sound image localization precision is improved, but processing complexity increases
Solution Approach 1:
The audio signal is segmented into distinct object signals, each representing a separate sound source. This segmentation allows independent processing and localization of each object, improving sound image localization precision while managing complexity through modular object-based processing rather than holistic channel processing
Solution Approach 2:
The patent introduces spatial dimension parameters (panning position, distance, elevation) to object signals, transforming the audio representation from traditional channel-based to object-based with spatial attributes. This dimensional enhancement enables precise sound image localization in three-dimensional space while organizing complexity through structured spatial parameter management
2Productivity
If multiple channel signals are downmixed into fewer channel signals, then data transmission efficiency is improved, but sound reproduction quality deteriorates
Solution Approach 1:
The patent introduces object-based side information as an intermediary element that carries spatial and temporal characteristics of original object signals. This side information acts as a mediator between the downmixed signal and the final sound reproduction, enabling high-quality reconstruction without transmitting all original channel data, thus improving transmission efficiency while maintaining sound reproduction quality
Solution Approach 2:
The patent transforms the audio representation by changing parameters from channel-based amplitude and phase to object-based spatial parameters (position, distance, elevation) and temporal parameters. This parameter transformation allows efficient downmixing while preserving essential perceptual information through compact parameter encoding rather than full signal transmission
3Adaptability or versatility
If sound images are localized at any desired position for each object audio signal, then adaptability is improved, but processing complexity increases
Solution Approach 1:
The patent implements dynamic spatial positioning of object signals, allowing sound images to be localized at any desired position in three-dimensional space. The spatial parameters (panning, distance, elevation) are dynamically adjustable, providing high adaptability for different playback environments and listener positions while managing complexity through parameter-based control rather than fixed processing
Data Source
AI summary
Provided are an audio encoding method and apparatus and an audio decoding method and apparatus in which audio signals can be encoded or decoded so that sound images can be localized at any desired position for each object audio signal. The audio decoding method includes extracting a downmix signal and object-based side information from an input audio signal; generating rendering information based on input control data; and generating spatial information based on the rendering information and the object-based side information.