Ambisonic Encoder for Real-Time Reflection Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Ambisonic encoding of sound sources with reflections is computationally intensive, making real-time processing challenging, especially on mobile devices, due to the complexity of calculating ambisonic coefficients and increased power consumption.

Innovation Solution

An ambisonic encoder that transforms sound waves, calculates spherical harmonics based on source and obstacle positions, and applies filtering with parameterized acoustic coefficients and delays to reduce complexity and power consumption, allowing for real-time processing of multiple reflections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If real-time ambisonic encoding is performed with multiple sound sources and reflections, then spatial audio quality and immersion are improved, but computational complexity and power consumption increase

Engineering Contradiction:
Improvespatial audio qualityVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The sound field is segmented into spherical harmonic components of different orders. The encoder processes and transmits coefficients for each order separately, allowing the receiver to reconstruct the spatial audio field with the desired level of detail. This segmentation enables quality control by adjusting which spherical harmonic orders are processed and transmitted, thereby managing computational complexity while maintaining spatial audio quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The encoder dynamically adjusts the maximum spherical harmonic order M based on available computational resources and desired quality. By changing this parameter, the system can adapt between high-quality encoding (higher M) and low-complexity encoding (lower M), resolving the contradiction between spatial audio quality and computational complexity.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the maximum spherical harmonic order M is increased to improve spatial resolution, then directional accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improvedirectional accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The spherical harmonic decomposition is divided into multiple orders (0 to M). Each order corresponds to a different level of directional detail. By segmenting the processing this way, the system can achieve high directional accuracy by including higher orders when needed, while having the option to use fewer orders when computational resources are limited.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The encoder can process only the necessary number of spherical harmonic orders required for acceptable directional accuracy rather than computing all possible orders. This partial action approach achieves sufficient directional precision without the excessive computational complexity of processing the full infinite series.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If ambisonic encoding is performed on mobile devices with limited processing power, then portability and accessibility are improved, but real-time encoding capability deteriorates

Engineering Contradiction:
ImproveportabilityVSAvoidreal-time encoding capability
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The encoding process is segmented into discrete spherical harmonic orders that can be processed incrementally. Mobile devices can process lower orders first to provide immediate encoding capability, then progressively process higher orders if computational resources allow. This segmentation enables real-time encoding on mobile devices by breaking down the complex task into manageable chunks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The encoder can process spherical harmonic orders in periodic batches rather than all at once. This periodic processing allows mobile devices to perform encoding in intervals, maintaining real-time capability by processing a subset of orders within each time frame, thereby achieving portability without completely sacrificing real-time encoding capability.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11062714B2Ambisonic encoder for a sound source having a plurality of reflections
Publication Date: 2021.07.13 MIMI HEARING TECHNOLOGIES GMBH
  • US11062714B2 patent drawing
  • US11062714B2 patent drawing
  • US11062714B2 patent drawing

AI summary

The present invention relates to an ambisonic encoder for a sound wave having a plurality of reflections. The ambisonic encoder according to the invention makes it possible to improve the sensation of immersion in a 3D audio scene. The complexity of encoding of the reflections of sound sources for an ambisonic encoder according to the invention is less than the complexity of encoding of the reflections of sound sources of an ambisonic encoder according to the prior art. The ambisonic encoder according to the invention makes it possible to encode a greater number of reflections of a sound source in real time. The ambisonic encoder according to the invention makes it possible to reduce the power consumption related to ambisonic encoding, and to increase the life of a battery of a mobile device used for said application.