Hierarchical Audio Coding for Multichannel Lossless Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current immersive audio technologies face challenges in preserving artistic intention, particularly in multichannel content, due to constraints in existing lossless audio coding methods and the need for efficient storage and transmission of multiple audio versions.
Innovation Solution
A hierarchical lossless audio reconstruction process is implemented, which reconstructs each unconstrained audio mix in the hierarchy based on a previous mix, except for the first mix, allowing for efficient coding and preservation of artistic intention across different audio formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If standard lossless audio coding is used for each multichannel mix separately, then audio quality is preserved, but bitrate requirements increase and storage efficiency decreases
Solution Approach 1:
The audio content is segmented into a hierarchical structure with a core mix and additional unconstrained mixes. The core mix is encoded separately while the additional mixes are encoded as differences relative to the core, reducing overall bitrate while preserving audio quality through selective segmentation of audio streams.
Solution Approach 2:
The patent implements a nested encoding structure where additional unconstrained mixes are embedded within the core mix framework. Each additional mix is encoded as a residual or difference signal nested within the core mix representation, allowing efficient storage and transmission while maintaining lossless quality for all mixes.
2Adaptability or versatility
If multiple versions of the same content are sent, then adaptability to different listening setups is improved, but data transmission volume increases
Solution Approach 1:
The content is segmented into a universal core mix that works across all listening setups and additional unconstrained mixes that provide optimized experiences for specific configurations. This segmentation allows receivers to selectively decode only the necessary components based on their capabilities, reducing data transmission volume while maintaining adaptability.
Solution Approach 2:
The core mix serves as a universal representation that can be decoded and played back on any listening setup, while additional unconstrained mixes provide enhanced functionality for specific configurations. This multi-functionality approach allows a single encoded package to serve multiple purposes across different playback environments.
3Adaptability or versatility
If legacy content is remixed to new formats, then versatility is improved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary encoding of the core mix and additional unconstrained mixes during the content creation stage, establishing a hierarchical structure that simplifies subsequent playback. This preliminary action pre-processes the content into a format-ready structure, reducing the complexity of format adaptation during distribution and playback.
Solution Approach 2:
The encoding process utilizes parameter changes in the hierarchical structure, where the core mix and additional mixes are represented with different encoding parameters. This allows flexible format adaptation by selectively decoding and reparameterizing only the necessary components for the target format, reducing overall processing complexity compared to complete remixing.
Data Source
AI summary
One embodiment provides a computer-implemented method that includes providing a hierarchical lossless audio reconstruction process including a hierarchy of unconstrained audio mixes for an audio content. Using the hierarchical lossless audio reconstruction process, each unconstrained audio mix in the hierarchy for the audio content is reconstructed, except a first unconstrained mix in the hierarchy, based on a previous unconstrained audio mix in the hierarchy.