Audio Signal Processing Apparatus for Higher Order Ambisonics Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Higher order ambisonics (HOA) signals face challenges in accurately representing sound object positions within an audio scene, leading to deterioration in rendering performance and sound localization, especially in immersive applications like virtual reality.

Innovation Solution

An audio signal processing method and apparatus that separates input signals into object and residual components, using singular value decomposition to extract position vector information for object-based rendering and channel-based rendering, with binaural techniques to enhance sound localization and quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If higher order ambisonics (HOA) technique is used to reproduce entire audio scene, then immersive sound quality is improved, but performance of accurately representing positions of individual sound objects deteriorates

Engineering Contradiction:
Improveimmersive sound qualityVSAvoidsound object position accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent segments the HOA signal into two distinct components: object signals (individual sound sources) and residual signals (ambient audio scene). This segmentation is achieved through matrix decomposition of the HOA coefficients, allowing separate processing of object and ambient components. The object-based rendering preserves position accuracy while channel-based rendering maintains immersive quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different rendering techniques are applied to different signal components: object-based rendering is used for object signals to preserve position accuracy, while channel-based rendering is used for residual signals to maintain immersive sound quality. This local differentiation of processing methods resolves the contradiction between the two performance requirements.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If object-based rendering is performed on all HOA components, then sound object position accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improvesound object position accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the HOA signal to identify only the object signal components that require position-accurate rendering. By separating object signals from residual signals through matrix decomposition, computational resources are focused only on the necessary components, reducing overall complexity while maintaining position accuracy where needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of applying computationally intensive object-based rendering to all HOA components, the patent applies it only partially to the object signal components identified through decomposition. The residual components use simpler channel-based rendering, achieving adequate performance with reduced computational burden.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If channel-based rendering is used for residual signals, then computational efficiency is improved, but sound localization performance deteriorates

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidsound localization performance
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies different rendering quality levels to different signal components: object signals receive high-quality object-based rendering with accurate localization, while residual signals use efficient channel-based rendering. This local differentiation maintains sound localization performance for important objects while achieving computational efficiency for the overall system.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10419867B2Device and method for processing audio signal
Publication Date: 2019.09.17 GAUDI AUDIO LAB
  • US10419867B2 patent drawing
  • US10419867B2 patent drawing
  • US10419867B2 patent drawing

AI summary

The present invention relates to an apparatus and a method for processing an audio signal, and more particularly, to an apparatus and a method for efficiently rendering a higher order ambisonics signal. To this end, provided are an audio signal processing apparatus, including: a pre-processor configured to separate an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal and extract position vector information corresponding to the first component from the input audio signal; a first rendering unit configured to perform an object-based first rendering on the first component using the position vector information; and a second rendering unit configured to perform a channel-based second rendering on the second component and an audio signal processing method using the same.