Spatial Audio Decoder Robustness via Spherical Harmonic Transforms

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for decoding spatial audio data, such as Ambisonic formats, are not robust with respect to speaker position and require accurate setup, especially at higher frequencies, and lack stability when speakers move inadvertently.

Innovation Solution

A method and system for processing spatial audio signals that apply transforms based on predefined speaker layouts and rules, allowing for selective modification of sound characteristics depending on direction, and decoding spatial audio signals using spherical harmonic representations to generate speaker outputs that maintain a sharp sense of direction and are robust to speaker setup and movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing methods for decoding spatial audio data are used, then directional characteristics can be reproduced, but the system requires accurate speaker setup and is not robust to speaker position changes

Engineering Contradiction:
Improverobustness to speaker positionVSAvoidspeaker setup accuracy
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent applies preliminary action by pre-defining speaker layouts and encoding directional information in a format that anticipates various speaker configurations. The spatial audio data is encoded with spherical harmonic representations that can be decoded according to predefined rules for different speaker arrangements, eliminating the need for precise manual setup during operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent utilizes parameter changes by representing spatial audio data using spherical harmonic coefficients that can be transformed according to different speaker configurations. The encoding format allows the directional characteristics to be reproduced by adjusting parameters based on predefined speaker layouts rather than requiring fixed precise positioning.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If spherical harmonic representation is used for spatial audio data, then directional accuracy is improved, but the data requires more channels and increases complexity

Engineering Contradiction:
Improvedirectional accuracyVSAvoidnumber of audio channels
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies universality by using spherical harmonic representations that can serve multiple functions: they provide accurate directional information while being decodable for various speaker configurations. The same encoded data structure works across different playback scenarios, making the system versatile without requiring separate processing paths for each configuration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If ambisonic formats with more channels are used, then soundfield reproduction accuracy is improved, but the processing burden on the audio system increases

Engineering Contradiction:
Improvesoundfield reproduction accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent reduces processing burden through preliminary action by pre-defining decoding rules for various speaker layouts. The spatial audio data is encoded once with spherical harmonic coefficients, and the decoding process simply applies predefined transformations based on the desired speaker configuration, avoiding complex real-time calculations during playback.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10490200B2Sound system
Publication Date: 2019.11.26 FURSE RICHARD
  • US10490200B2 patent drawing
  • US10490200B2 patent drawing
  • US10490200B2 patent drawing

AI summary

Embodiments of the invention relate to methods and systems for processing audio data, such as spatial audio data. One or more sound characteristics of a given component of a spatial audio signal are modified in dependence on a relationship between a direction characteristic of the given component and a defined range of direction characteristics. In some embodiments, a spatial audio in a format using a spherical harmonic representation of sound components is decoded by performing a transform on the spherical harmonic representation, in which the transform is based on a predefined speaker layout and a predefined rule, the predefined rule indicating a speaker gain of each speaker arranged according to the predefined layout, when reproducing sound incident form a given direction. In some embodiments, a plurality of matrix transforms is combined into a combined transform, and the combined transform is performed on an audio signal.