Mobile Terminal Spatial Audio Simulation Using Directional Beamforming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for simulating three-dimensional sound fields on mobile terminals using beamforming technology result in a two-dimensional sound field experience, with a more noticeable difference between left and right directions than between front and rear, leading to poor sound quality.

Innovation Solution

A sound signal processing method and apparatus that uses at least three microphones on a mobile terminal to acquire sound signals from multiple directions, calculate the time difference of arrival, and generate spatial audio signals by adjusting gain parameters based on the sound source's direction, effectively simulating a three-dimensional sound field by enhancing the difference between front and rear directions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If beamforming technology for two-dimensional sound field collection is used to generate beams with heart-shaped directivity in 0 degree and 180 degree directions, then the mobile terminal can implement three-dimensional sound field collection, but the simulated three-dimensional sound field still has features of a two-dimensional sound field with poor quality

Engineering Contradiction:
Improvethree-dimensional sound field collection capabilityVSAvoidsound field simulation quality
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent transitions from two-dimensional beamforming (0 and 180 degrees) to four-dimensional sound field collection by adding beams in 90 and 270 degree directions. This dimensional expansion enables true three-dimensional spatial audio simulation by incorporating front, rear, left, and right directional information, thereby resolving the limitation of pseudo-3D effects produced by traditional 2D beamforming.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent divides the sound field collection into four distinct directional beams (front, rear, left, right) instead of using a single omnidirectional or two-directional beam. Each beam is independently processed and then integrated to create a comprehensive spatial audio experience, improving the precision of sound source localization and spatial distribution.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If beams with heart-shaped directivity in 0 degree and 180 degree directions are generated, then sound field collection can be implemented, but the difference between left and right directions is more obvious than the difference between front and rear directions

Engineering Contradiction:
Improvesound field collection implementationVSAvoiddirectional sound difference discrimination
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent creates an asymmetric beam configuration by generating four beams at different orientations (0, 90, 180, 270 degrees) rather than symmetric heart-shaped beams. This asymmetric arrangement allows independent control and processing of front-rear and left-right directional differences, enabling more precise discrimination between all four directions through separate gain adjustment parameters.

Inventive Principle:
Principle #4Asymmetry

Solution Approach 2:

The patent applies different gain adjustment parameters specifically tailored for each directional beam (front, rear, left, right). By optimizing the quality and characteristics of each individual beam separately, the system enhances the ability to distinguish directional differences in all orientations, not just privileging left-right over front-rear as in traditional approaches.

Inventive Principle:
Principle #3Local quality

3Device complexity

If traditional beamforming technology is used, then the processing method is simple, but the simulated three-dimensional sound field quality is poor

Engineering Contradiction:
Improveprocessing method complexityVSAvoidsound field simulation quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent introduces dynamic gain adjustment parameters that can be independently modified for each of the four directional beams. This dynamic control mechanism allows flexible optimization of spatial audio characteristics without requiring complete redesign of the beamforming architecture, balancing computational complexity with improved sound field simulation quality through adaptive parameter tuning.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves the quality of the simulated three-dimensional sound field by accurately determining the sound source's direction and adjusting gain parameters, thereby enhancing the separation between front and rear sound components, resulting in a more immersive audio experience.

Implementation Method 1

at least three microphones are disposed on the mobile terminal and every microphone of the at least three microphones is configured to receive a sound signal in at least one direction

Methodology Applied
Scientific EffectAcoustic detection: Sound

Implementation Method 2

acquiring a time difference of arrival between a sound signal in one direction and a sound signal in another direction that are received by the microphones on the mobile terminal

Methodology Applied
Scientific EffectTime difference of arrival: Speed of Sound

Data Source

PatentEP2991382B1Sound signal processing method and apparatus
Publication Date: 2017.04.19 HUAWEI TECH CO LTD
  • EP2991382B1 patent drawingFigure 1~1a
  • EP2991382B1 patent drawingFigure 1b
  • EP2991382B1 patent drawingFigure 1c

AI summary

Embodiments of the present invention disclose a sound signal processing method and apparatus, relate to the audio signal processing field, and can collect and process signals in a three-dimensional sound field surrounding a terminal. The method in the present invention includes: acquiring, by a mobile terminal, sound signals from a three-dimensional sound field, where at least three microphones are disposed on the mobile terminal and one microphone is configured to receive a sound signal in at least one direction; acquiring, according to the acquired sound signals, a direction of a sound source relative to the mobile terminal; and obtaining spatial audio signals according to the direction of the sound source relative to the mobile terminal and the acquired sound signals, where the spatial audio signals are used for simulating the three-dimensional sound field. The present invention is applicable to a process of collecting and processing signals in a three-dimensional sound field surrounding a terminal.