Object-Based Audio Downmixing for Precise Sound Image Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio encoding and decoding techniques struggle to effectively localize sound images for each object audio signal, as they often require complex processing and increased computational resources, especially when dealing with multiple object signals that need to be allocated in a multi-channel space.
Innovation Solution
The proposed method involves generating a third downmix signal by combining first and second downmix signals, and third object-based side information by combining first and second object-based side information, which is then converted into channel-based side information to generate a multi-channel audio signal, reducing the complexity of decoding and mixing/rendering operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If object-based audio encoding and decoding techniques are used to localize sound images for each object signal, then sound image localization precision is improved, but device complexity increases due to complex decoding and mixing/rendering operations
Solution Approach 1:
The patent segments the audio signal processing into distinct object-based units, where each object signal is independently decoded and rendered. This allows precise sound image localization for each object while managing complexity through modular processing stages (decoding, mixing, rendering) that can be handled separately rather than as a monolithic complex operation
Solution Approach 2:
The patent introduces spatial dimension parameters (azimuth, elevation, distance) to describe object signal positions in three-dimensional space. By adding these spatial dimensions to the audio processing framework, the system achieves precise sound image localization without increasing temporal or spectral processing complexity
2Adaptability or versatility
If multiple object signals are processed to achieve flexible sound image positioning, then adaptability is improved, but computational resources increase
Solution Approach 1:
The patent performs preliminary actions by pre-calculating and storing spatial parameters (azimuth, elevation, distance) for each object signal during the encoding phase. This preliminary preparation allows flexible sound image positioning during playback without requiring intensive real-time computational resources, as the spatial transformation parameters are already determined
Solution Approach 2:
The patent achieves adaptability by changing spatial parameters (azimuth angle, elevation angle, distance) of object signals to position sound images flexibly in three-dimensional space. By modifying these parameters rather than reprocessing the entire audio signal, the system maintains versatility while controlling computational resource consumption
Data Source
AI summary
Provided are an audio encoding method and apparatus and an audio decoding method and apparatus in which audio signals can be encoded or decoded so that sound images can be localized at any desired position for each object audio signal. The audio decoding method generating a third downmix signal by combining a first downmix signal extracted from a first audio signal and a second downmix signal extracted from a second audio signal; generating third object-based side information by combining first object-based side information extracted from the first audio signal and second object-based side information extracted from the second audio signal; converting the third object-based side information into channel-based side information; and generating a multi-channel audio signal using the third downmix signal and the channel-based side information.