Joint Residual Audio Decoding for Low-Bitrate 3D Multichannel Sound

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio encoding and decoding technologies struggle to efficiently handle three-dimensional audio scenes, particularly in encoding and decoding of multi-channel audio signals, with a desire for improved coding efficiency and quality.

Innovation Solution

An audio decoder and encoder system that utilizes residual-signal-assisted multi-channel decoding to derive multiple audio channel signals from a jointly encoded representation, exploiting similarities and dependencies between residual signals to enhance decoding quality and reduce bit rate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional multi-channel audio encoding is used, then audio quality can be maintained, but bit rate increases and coding efficiency decreases

Engineering Contradiction:
Improveaudio qualityVSAvoidbit rate
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent merges the encoding of multiple residual signals by exploiting their temporal and spectral similarities. Instead of encoding each residual signal independently, the system combines them into a joint residual signal that captures common information, thereby reducing the total bit rate while maintaining audio quality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal residual signal that serves multiple audio channels simultaneously. This joint residual signal functions as a common correction term for multiple downmixed signals, allowing a single encoded representation to improve the quality of multiple channels without requiring separate residual encodings for each channel.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If traditional multi-channel audio encoding is used, then audio quality can be maintained, but coding efficiency decreases

Engineering Contradiction:
Improveaudio qualityVSAvoidcoding efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent merges the encoding operations for multiple residual signals into a single unified encoding process. By combining the temporal and spectral information from multiple channels into one joint residual signal, the system reduces computational complexity and improves coding efficiency while preserving audio quality.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If residual signals are encoded separately for each channel, then channel independence is maintained, but bit rate increases

Engineering Contradiction:
Improvechannel independenceVSAvoidbit rate
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent merges separate residual signal encodings into a single joint encoding process that exploits correlations between channels. By identifying and encoding only the unique information in each residual signal while sharing common information, the system maintains effective channel independence while significantly reducing the total bit rate required.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20260024535A1Audio encoder, audio decoder, methods and computer program using jointly encoded residual signals
Publication Date: 2026.01.22 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US20260024535A1 patent drawing
  • US20260024535A1 patent drawing
  • US20260024535A1 patent drawing

AI summary

An audio decoder for providing at least four audio channel signals on the basis of an encoded representation is configured to provide a first residual signal and a second residual signal on the basis of a jointly encoded representation of the first residual signal and of the second residual signal using a multi-channel decoding. The audio decoder is configured to provide a first audio channel signal and a second audio channel signal on the basis of a first downmix signal and the first residual signal using a residual-signal-assisted multi-channel decoding. The audio decoder is configured to provide a third audio channel signal and a fourth audio channel signal on the basis of a second downmix signal and the second residual signal using a residual-signal-assisted multi-channel decoding. An audio encoder is based on corresponding considerations.