Sound Image Localization Precision in 3D Mesh Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing sound image localization techniques, such as vector base amplitude panning (VBAP), struggle to achieve high-precision localization of sound images outside the mesh formed by loudspeakers on a spherical surface or arc, requiring significant movement and large-scale calculations to position sound images within the mesh boundaries.

Innovation Solution

The proposed method determines whether a sound image is outside all meshes before moving it onto the boundary of the closest mesh in the vertical direction, minimizing movement and reducing calculation complexity by using specific formulas to calculate the movement destination position and gain adjustments for each loudspeaker.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If VBAP is used to localize sound images, then sound image localization is achieved, but high-precision localization cannot be achieved for sound images outside the mesh formed by loudspeakers

Engineering Contradiction:
Improvesound image localization precisionVSAvoidlocalization range
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent extends traditional 2D VBAP to 3D space by introducing vertical direction angles and spherical coordinate transformations. This allows sound images to be localized in three-dimensional space around the listener, not just on a two-dimensional arc, thereby expanding the localization range while maintaining precision through the additional spatial dimension.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent divides the 3D space into multiple spherical triangles (meshes) formed by loudspeaker positions. By segmenting the spatial domain into discrete triangular regions, the system can determine which mesh contains the target sound image position and apply appropriate gain calculations for that specific region, enabling precise localization across the entire spherical surface.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If sound image position is moved into the mesh range, then localization within mesh is achieved, but significant movement and large-scale calculations are required

Engineering Contradiction:
Improvesound image localization precisionVSAvoidcalculation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-calculates and stores spherical triangle mesh data including vertex positions, edge connections, and gain coefficients for each mesh. This preliminary preparation allows the system to quickly determine the target mesh and retrieve pre-computed gain values without performing large-scale real-time calculations, significantly reducing processing time while maintaining localization precision.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different gain calculation methods for different spatial regions. By identifying which spherical triangle contains the target sound image position, the system applies localized gain adjustments specific to that mesh rather than performing global calculations, thereby reducing computational complexity while achieving precise localization.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3026936B1Information processing device and method, and program
Publication Date: 2020.04.29 SONY GROUP CORP
  • EP3026936B1 patent drawingFigure 1
  • EP3026936B1 patent drawingFigure 2
  • EP3026936B1 patent drawingFigure 3

AI summary

The present technology relates to an information processing device and method for allowing a sound image to be localized with higher precision, and a program. When a target sound image is outside a mesh, the target sound image is moved in a vertical direction while a position in a horizontal direction of the target sound image remains fixed, so that the target sound image is present on a boundary of the mesh. Specifically, a mesh detection unit detects a mesh including a position in the horizontal direction of the target sound image. A candidate position calculation unit calculates a position that is a movement target of the target sound image, based on loudspeaker positions that are at opposite ends of an arc of the detected mesh that is a destination, and the position in the horizontal direction of the target sound image. As a result, the target sound image can be moved onto a boundary of the mesh. The present technology is applicable to a sound processing device.