Spatial Audio Coherence Signalling for Low-Bit-Rate Codecs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio encoding technologies struggle to efficiently convey the spatial properties of sound fields, particularly in loudspeaker surround mixes, due to the high metadata requirements of transmitting the full covariance matrix, which is impractical for low-bit-rate codecs.

Innovation Solution

A method and apparatus that utilize spatial audio parameters, including direction, energy ratio, and coherence parameters, to efficiently encode and decode spatial audio, using orientation and sector codes to convey spatial coherence, reducing metadata while maintaining audio quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the full covariance matrix is transmitted to convey spatial properties, then the accuracy of spatial reproduction is improved, but the metadata size and bit rate increase significantly

Engineering Contradiction:
Improvespatial reproduction accuracyVSAvoidmetadata size
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential spatial parameters from the full covariance matrix. Specifically, it identifies and transmits only the dominant eigenvalues and eigenvectors that capture the most significant spatial information, discarding redundant data. This extraction approach maintains spatial reproduction accuracy while dramatically reducing metadata size for low-bit-rate coding.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality by differentiating the treatment of different spatial parameters. Rather than uniformly encoding all covariance matrix elements, it applies higher precision to dominant spatial components (those with significant eigenvalues) and lower or no precision to minor components. This selective precision approach optimizes the balance between spatial accuracy and data reduction.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If more spatial parameters are encoded, then the reproduction quality is improved, but the complexity of the encoding system increases

Engineering Contradiction:
Improvespatial parameter accuracyVSAvoidencoding system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the spatial parameter encoding into distinct components: direction parameters, energy ratio parameters, and coherence parameters. Each segment is processed and encoded independently using optimized methods suitable for its characteristics. This segmentation reduces overall system complexity by breaking down the complex task of full covariance matrix encoding into manageable, specialized sub-tasks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the original covariance matrix representation into a different parameter space consisting of direction vectors, energy ratios, and coherence values. This parameter transformation simplifies the encoding process by converting complex matrix operations into more manageable vector and scalar operations, reducing computational complexity while preserving spatial information.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If the covariance matrix is reduced for low-bit-rate coding, then the bit rate is decreased, but the spatial coherence information is lost

Engineering Contradiction:
Improvebit rateVSAvoidspatial coherence information
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent introduces coherence parameters as intermediary representations that bridge the full covariance matrix and its reduced form. These coherence parameters specifically capture the spatial relationship and correlation information between different audio channels, serving as a compact mediator that preserves essential spatial coherence properties while enabling low-bit-rate transmission.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent performs preliminary analysis of the covariance matrix to identify and extract coherence information before the actual encoding process. By pre-processing the spatial data to isolate and emphasize coherence-related parameters, the system ensures that this critical information is preserved in the reduced representation, preventing information loss during compression.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3803857B1Signalling of spatial audio parameters
Publication Date: 2025.07.30 NOKIA TECHNOLOGIES OY
  • EP3803857B1 patent drawingFigure 1
  • EP3803857B1 patent drawingFigure 2
  • EP3803857B1 patent drawingFigure 3

AI summary

Apparatus comprising means for: determining, for two or more speaker channel audio signals (102), at least one spatial audio parameter (108, 310) for providing spatial audio reproduction; determining between the two or more speaker channel audio signals (102) at least one audio signal relationship parameter (112), the at least one audio signal relationship parameter (112) being associated with at least one coherence parameter (112), in such a way that the at least one coherence parameter (112) provides at least one interchannel coherence information between the two or more speaker channel audio signals (102) for at least two frequency bands, so as to reproduce the two or more speaker channel audio signals (102) based on the at least one spatial audio parameter (108, 310) and the at least one audio signal relationship parameter (112); and transmitting the at least one spatial audio parameter (108, 310) and at least one information (112) associated with the at least one inter-channel coherence using at least one determined value.