Spatially Extended Sound Source Synthesis Using Cue Information

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for reproducing spatially extended sound sources in audio processing require a large number of decorrelated signals, leading to high computational complexity and potential timbre alterations, which limits their effectiveness in applications like virtual and augmented reality where listener movement is involved.

Innovation Solution

The method synthesizes spatially extended sound sources using a limited spatial range indication, processing audio signals with only two or three channels that have specific cues derived from cue information items, such as inter-channel correlation values and phase differences, to efficiently reproduce the spatial extent without the need for numerous peripheral sound sources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a large number of decorrelated signals are used to reproduce spatially extended sound sources, then the spatial extent and realism are improved, but the computational complexity increases significantly

Engineering Contradiction:
Improvespatial extent reproduction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential spatial cues (inter-channel correlation, phase differences, level differences) from the complex multi-signal approach, using just two or three channels to represent the spatially extended sound source. This extraction of key features maintains spatial realism while dramatically reducing computational requirements compared to using many decorrelated signals.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the representation parameters from multiple independent decorrelated signals to a compact set of spatial cue parameters (correlation values, phase differences, level differences) applied to fewer channels. This parameter transformation achieves equivalent spatial reproduction with reduced computational complexity.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If multiple decorrelated signals are used to increase source width, then the spatial distribution is improved, but the original timbre is altered

Engineering Contradiction:
Improvespatial distribution accuracyVSAvoidtimbre preservation
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent introduces spatial cue parameters as intermediaries between the audio signal and the spatial reproduction process. Instead of directly using multiple decorrelated signals that alter timbre, the cues (correlation, phase, level differences) mediate the spatial effect while preserving the original signal's timbral characteristics.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If numerous peripheral sound sources are used to reproduce spatial extent, then the spatial realism is improved, but the processing requirements increase

Engineering Contradiction:
Improvespatial realismVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent creates a simplified copy of the spatially extended sound source using only two or three channels with applied spatial cues, rather than reproducing the full complexity of multiple peripheral sound sources. This copy maintains the essential spatial realism while being computationally efficient to process.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12185079B2Apparatus and method for synthesizing a spatially extended sound source using cue information items
Publication Date: 2024.12.31 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US12185079B2 patent drawing
  • US12185079B2 patent drawing
  • US12185079B2 patent drawing

AI summary

An apparatus for synthesizing a spatially extended sound source includes: a spatial information interface for receiving a spatial range indication indicating a limited spatial range for the spatially extended sound source within a maximum spatial range; a cue information provider for providing one or more cue information items in response to the limited spatial range; and an audio processor for processing an audio signal representing the spatially extended sound source using the one or more cue information items.