Spatial Acoustic Transfer Function Compression via Spherical Harmonics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for representing spatial acoustic transfer functions are inefficient, particularly for real-time applications and storage, as they do not provide a compact representation, which is necessary for effective communication and memory usage in spatial audio applications.

Innovation Solution

The method employs Shifted Component Modeling (SCM) combined with Spherical Harmonics Analysis (SHT) to compress spatial transfer functions, achieving lossy compression ratios greater than 1:250 while preserving 99% of the data variation, allowing for efficient communication and storage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional methods are used to represent spatial acoustic transfer functions, then complete accuracy is maintained, but data size and storage requirements become excessively large

Engineering Contradiction:
Improveaccuracy of transfer function representationVSAvoiddata size
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent transforms the transfer function data from time-domain impulse responses to frequency-domain representations using Fourier transforms. This parameter transformation enables the subsequent application of spherical harmonics decomposition, which reorganizes the data into a compact spectral form that maintains accuracy while dramatically reducing storage requirements through selective truncation of higher-order components.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent decomposes the spatial transfer functions into spherical harmonics components of different orders. By segmenting the data into these hierarchical components, the method allows selective retention of only the most significant lower-order terms that capture the essential spatial characteristics, while discarding or compressing higher-order terms that contribute minimally to overall accuracy.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If detailed transfer function data is stored and transmitted, then high fidelity is achieved, but communication efficiency and network bandwidth usage deteriorate

Engineering Contradiction:
Improvefidelity of spatial audio dataVSAvoidcommunication efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The transformation to spherical harmonics spectral domain representation enables efficient compression by converting detailed time-domain data into a compact frequency-spectral format. This parameter change allows the system to transmit only the essential spectral coefficients needed for high-fidelity reconstruction, significantly reducing bandwidth requirements while maintaining audio quality.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent extracts and transmits only the most significant spherical harmonics coefficients that capture the essential spatial audio information. By taking out and transmitting only these critical components rather than the complete original data set, the system achieves high communication efficiency while preserving sufficient fidelity for practical applications.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If complete transfer function data is kept in memory, then processing accuracy is maintained, but device memory burden and storage requirements increase

Engineering Contradiction:
Improveprocessing accuracyVSAvoidmemory burden
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms the memory storage requirement from storing complete time-domain impulse responses to storing compact spherical harmonics spectral coefficients. This parameter transformation in the data representation fundamentally reduces the memory footprint while preserving the essential information needed for accurate spatial audio processing operations.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

By segmenting the transfer function into spherical harmonics components, the system can store only the essential lower-order coefficients in memory, loading higher-order details only when needed for specific processing tasks. This segmentation approach dramatically reduces the baseline memory burden on audio processing devices.

Inventive Principle:
Principle #1Segmentation

4Reliability

If real-time filter design is performed with full transfer function data, then optimal filter performance is achieved, but computational complexity and processing time increase

Engineering Contradiction:
Improvefilter performanceVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The transformation to spherical harmonics spectral domain enables more efficient computational operations for filter design. By working with the compact spectral coefficients rather than complete time-domain data, the system can perform real-time filter optimization with reduced computational complexity while maintaining the ability to achieve optimal filter performance through the preserved essential spatial characteristics.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11252525B2Compressing spatial acoustic transfer functions
Publication Date: 2022.02.15 APPLE INC
  • US11252525B2 patent drawing
  • US11252525B2 patent drawing
  • US11252525B2 patent drawing

AI summary

Transfer functions can describe responses of microphones or ears to sounds at different locations on a sphere. The transfer functions can be compressed by determining, based on transfer functions, a) one or more basis transfer functions, and b) spherical harmonics coefficients that describe variations of the transfer functions with respect to spherical coordinates. Other aspects are described and claimed.