Virtual-Speaker VBAP Gain Control for Stable Sound Image Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional sound image localization techniques using VBAP can result in unstable sound image positioning, especially when users move, leading to a narrower optimal listening range due to the reliance on fewer speakers outputting sound.

Innovation Solution

A sound processing apparatus with four or more sound outputting units, utilizing a gain calculating unit to determine and adjust output gains based on positional relationships among combinations of sound outputting units, ensuring all speakers contribute to maintaining a stable sound image localization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If three-dimensional VBAP is used with three speakers, then the sound image can be localized at the target position, but only two speakers output sound in some cases leading to unstable localization when the user moves

Engineering Contradiction:
Improvesound image localization accuracyVSAvoidlocalization stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines the output of multiple speakers (four or more) to produce the sound image, rather than relying on only two or three speakers. By merging the sound outputs from all surrounding speakers with non-zero gains, the system achieves both accurate localization and stable performance when users move, as the combined sound fields from multiple sources provide more robust spatial positioning.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system dynamically adjusts the gain values for each speaker based on the target localization position and continuously updates the sound output. By calculating and adjusting gains in real-time for all speakers in the combination, the system adapts to user movement and maintains stable localization, transforming the static VBAP approach into a dynamic system that responds to changing conditions.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If only two speakers output sound in three-dimensional VBAP, then the system simplifies operation, but the sweet spot range becomes narrower and localization becomes unstable

Engineering Contradiction:
Improvesystem operation simplicityVSAvoidsweet spot range
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent segments the sound output task across four or more speakers instead of concentrating it in only two speakers. By dividing the sound production function among multiple speakers and assigning appropriate gain values to each, the system expands the sweet spot range and improves localization stability while maintaining operational simplicity through automated gain calculation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system makes all four or more speakers potentially active and functional in the sound production process, rather than limiting functionality to only two speakers. Each speaker can contribute to the sound image localization depending on its positional relationship with the target position, making the system more versatile and robust while simplifying operation through unified gain management.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11272306B2Sound processing apparatus and sound processing system
Publication Date: 2022.03.08 SONY GROUP CORP
  • US11272306B2 patent drawing
  • US11272306B2 patent drawing
  • US11272306B2 patent drawing

AI summary

The present technology relates to a sound processing apparatus and a sound processing system for enabling more stable localization of a sound image.A virtual speaker is assumed to exist on the lower side among the sides of a tetragon having its corners formed with four speakers surrounding a target sound image position on a spherical plane. Three-dimensional VBAP is performed with respect to the virtual speaker and the two speakers located at the upper right and the upper left, to calculate gains of the two speakers at the upper right and the upper left and the virtual speaker, the gains being to be used for fixing a sound image at the target sound image position. Further, two-dimensional VBAP is performed with respect to the lower right and lower left speakers, to calculate gains of the lower right and lower left speakers, the gains being to be used for fixing a sound image at the position of the virtual speaker. The values obtained by multiplying these gains by the gain of the virtual speaker are set as the gains of the lower right and lower left speakers for fixing a sound image at the target sound image position. The present technology can be applied to sound processing apparatuses.