Object-Based Audio Decoding with Combined Downmix Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio encoding and decoding techniques struggle to accurately localize sound images for each object audio signal, as they often require complex processing and increased computational resources, especially when dealing with multiple object signals that need to be allocated in a multi-channel space.
Innovation Solution
The method involves generating a third downmix signal by combining first and second downmix signals, and third object-based side information by combining first and second object-based side information, which is then converted into channel-based side information to produce a multi-channel audio signal, allowing for efficient localization of sound images by reducing the complexity of decoding and mixing/rendering operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If object-based audio encoding and decoding techniques are used to treat each object signal as an independent entity, then sound image localization precision for each object is improved, but device complexity and computational resources increase
Solution Approach 1:
The patent combines multiple object-based audio signals into a single multi-channel audio signal by integrating downmix signals and their corresponding side information. This merging process reduces the number of independent processing streams, thereby simplifying device complexity while preserving the ability to localize sound images for each object through the combined side information parameters.
Solution Approach 2:
The patent creates a universal decoding framework that handles both object-based audio signals and multi-channel audio signals through a unified process. The decoding apparatus can process different types of audio inputs using the same downmixing and side information combination mechanisms, reducing the need for separate specialized processing paths and thereby lowering overall device complexity.
2Manufacturing precision
If multiple object signals are processed independently to achieve accurate sound image localization, then audio reproduction quality is improved, but processing time and computational resources increase
Solution Approach 1:
The patent performs downmixing operations and generates side information parameters in advance during the encoding phase. By pre-processing the object signals into downmix signals and extracting localization parameters beforehand, the decoding phase requires minimal computational effort, significantly reducing processing time while maintaining audio reproduction quality through the preserved side information.
Solution Approach 2:
The patent extracts essential localization parameters (such as inter-channel level difference and inter-channel time difference) from the object signals and stores them as side information. This extraction separates the critical localization data from the full audio signals, allowing rapid decoding by simply combining downmix signals with the pre-extracted parameters, thereby reducing processing time while maintaining reproduction quality.
3Measurement precision
If complex decoding and mixing operations are performed to allocate multiple object signals in multi-channel space, then sound image localization accuracy is improved, but computational resources and energy consumption increase
Solution Approach 1:
The patent uses simplified downmix signals that can be rapidly processed and discarded after decoding, replacing the need for continuous complex object-based processing. The downmix signals serve as efficient proxies that retain essential localization information, allowing energy-efficient decoding operations while maintaining localization accuracy through the accompanying side information parameters.
Data Source
AI summary
Provided are an audio encoding method and apparatus and an audio decoding method and apparatus in which audio signals can be encoded or decoded so that sound images can be localized at any desired position for each object audio signal. The audio decoding method generating a third downmix signal by combining a first downmix signal extracted from a first audio signal and a second downmix signal extracted from a second audio signal; generating third object-based side information by combining first object-based side information extracted from the first audio signal and second object-based side information extracted from the second audio signal; converting the third object-based side information into channel-based side information; and generating a multi-channel audio signal using the third downmix signal and the channel-based side information.