Higher Order Ambisonics Encoding Using PCA and Quantization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital audio technologies face challenges in efficiently reducing bitrate for higher order ambisonics (HOA) data transmission over limited bandwidth communication links while maintaining sound quality, as current codec techniques require significant bandwidth for transmitting raw HOA data.

Innovation Solution

The implementation of principal components analysis (PCA) and dynamic transition between PCA with and without mean vector transmission, along with spatial descriptor quantization techniques, to encode and decode HOA data, reducing the need for bandwidth by selectively transmitting the mean vector and optimizing spatial descriptor components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If raw or uncompressed HOA data is transmitted over a communication link, then sound quality is maintained, but bandwidth requirements become excessive for real-time playback

Engineering Contradiction:
Improvesound qualityVSAvoidbandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts and transmits only the most critical components of HOA data - specifically the mean vector and quantized spatial descriptors - rather than transmitting the complete raw HOA data. This selective extraction enables bandwidth reduction while preserving essential spatial audio information needed for accurate sound field reconstruction at the decoder

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies quantization to spatial descriptors and uses principal components analysis to transform HOA data into a more efficient representation. By changing the parameter representation from raw spherical harmonic coefficients to quantized spatial descriptors with mean vectors, the system achieves significant bitrate reduction while maintaining perceptual sound quality

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If spatial descriptors are quantized to reduce bitrate, then bandwidth is reduced, but synthesis accuracy at the decoding side may be compromised

Engineering Contradiction:
ImprovebitrateVSAvoidsynthesis accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent performs principal components analysis and identifies the mean vector before quantization and transmission. By pre-computing and transmitting the mean vector separately, the system establishes a reference framework that enables accurate reconstruction of the sound field even when spatial descriptors are heavily quantized, thus maintaining synthesis accuracy despite bitrate reduction

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the mean vector is transmitted to the decoding side, then accurate synthesis is achieved, but codec bandwidth requirements increase

Engineering Contradiction:
Improvesynthesis accuracyVSAvoidcodec bandwidth
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent transmits the mean vector with reduced precision compared to full HOA data requirements. By applying partial action - transmitting only the essential mean vector information and using quantized spatial descriptors for the remaining details - the system achieves adequate synthesis accuracy for perceptual purposes while significantly reducing codec bandwidth consumption

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20230360655A1Higher order ambisonics encoding and decoding
Publication Date: 2023.11.09 APPLE INC
  • US20230360655A1 patent drawing
  • US20230360655A1 patent drawing
  • US20230360655A1 patent drawing

AI summary

Encoding and decoding of higher order ambisonics, HOA, data for purposes of bitrate reduction. One aspect uses principal components analysis to produce spatial descriptors. Other aspects include various spatial descriptor quantization techniques.