Audio Rendering Method Selection for Sound Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio rendering technologies face challenges in achieving high sound image localization reproducibility with minimal computational resources, particularly when audio objects are near the listener, as they struggle to accurately account for differences in sound wave arrival times and require significant calculations for head-related transfer function processing.

Innovation Solution

A signal processing device and method that selectively choose between panning processing and head-related transfer function processing based on the audio object's position, using a rendering method selection unit to determine the appropriate rendering method for each audio object, thereby optimizing sound image localization with reduced computational load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If head-related transfer function processing is used for audio objects near the listener, then sound image localization accuracy is improved, but computational load increases significantly

Engineering Contradiction:
Improvesound image localization accuracyVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent changes the rendering method parameter based on the distance parameter between the audio object and the listener. When the distance is below a threshold, head-related transfer function processing is applied for high accuracy; when the distance is above the threshold, panning processing is used for lower computational load. This parameter-based conditional switching resolves the contradiction between localization accuracy and computational load.

Inventive Principle:
Principle #35Parameter changes

2Power

If panning processing is used for all audio objects, then computational load is reduced, but sound image localization accuracy deteriorates for audio objects near the listener

Engineering Contradiction:
Improvecomputational loadVSAvoidsound image localization accuracy
Core Design Contradiction:
PowerVSMeasurement precision

Solution Approach 1:

The patent applies different rendering qualities to different spatial regions. Audio objects near the listener (within threshold distance) receive high-quality head-related transfer function processing, while audio objects farther away receive standard panning processing. This local differentiation of processing quality resolves the contradiction by providing high accuracy only where necessary.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If head-related transfer function processing is applied to all audio objects regardless of position, then sound image localization accuracy is improved uniformly, but the amount of calculation increases for all objects including those far from the listener

Engineering Contradiction:
Improvesound image localization accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies the computationally intensive head-related transfer function processing only partially - specifically to audio objects within the threshold distance from the listener. For audio objects beyond this threshold, standard panning processing suffices. This partial application of the high-accuracy method improves overall processing efficiency while maintaining adequate localization accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11838742B2Signal processing device and method, and program
Publication Date: 2023.12.05 SONY GROUP CORP
  • US11838742B2 patent drawing
  • US11838742B2 patent drawing
  • US11838742B2 patent drawing

AI summary

The present technology relates to a signal processing device and method, and a program for improving reproducibility of a sound image with a small amount of calculation.A signal processing device includes a rendering method selection unit configured to select one or more methods of rendering processing of localizing a sound image of an audio signal in a listening space from among a plurality of methods, and a rendering processing unit configured to perform the rendering processing for the audio signal by the method selected by the rendering method selection unit. The present technology can be applied to a signal processing device.