Wave Field Synthesis for Multi-Listener Spatial Audio

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing techniques cannot effectively enable multiple listeners to hear appropriate sounds simultaneously based on the motions of multiple listeners, as they primarily focus on following a single listener's motion.

Innovation Solution

An information processing device and method that detects changes in the position of multiple people and adjusts virtual sound sources using wave field synthesis to transmit spatial sound fields through multiple speakers, ensuring each listener hears appropriate sounds in accordance with their motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If wave field synthesis is used to enable multiple listeners to hear appropriate sounds simultaneously, then the auditory experience for multiple listeners is enhanced, but the device complexity and computational requirements increase

Engineering Contradiction:

ImproveAbility to serve multiple listeners simultaneouslyVSAvoidComplexity of sound field processing system

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the sound field into multiple independent virtual sound sources, each corresponding to a specific spatial location. The system segments the audio content and processes it through separate transfer function calculations for each speaker and listener position, enabling independent control of sound delivery to multiple listeners without requiring a completely new system architecture

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates a universal sound field synthesis system that can simultaneously serve multiple listeners with different spatial positions and motion states. The same speaker array and processing framework handle all listeners, with the system automatically adapting the transfer functions and virtual sound source positions based on real-time detection of each listener's characteristics

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Measurement precision

If the position of virtual sound sources is dynamically adjusted for each listener, then spatial accuracy of sound delivery is improved, but the computational load and processing time increase

Engineering Contradiction:

ImprovePositional accuracy of virtual sound sourcesVSAvoidTime for real-time sound field adjustment

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent pre-calculates and stores transfer functions for various speaker configurations and listener positions before actual use. When a listener's position is detected, the system retrieves and applies the pre-computed transfer function corresponding to that position, avoiding the need for real-time calculation and significantly reducing processing delay

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses detected listener positions and motion states to create virtual copies of the listener's auditory experience through virtual sound sources. The system calculates transfer functions that replicate what the listener would hear if a physical sound source were placed at the virtual position, enabling accurate spatial sound delivery without physically moving speakers

Inventive Principle:

Principle #26Copying

3Adaptability or versatility

If motion detection and tracking is implemented for multiple listeners, then the ability to follow listener motions is improved, but the system complexity and detection requirements increase

Engineering Contradiction:

ImproveAbility to track multiple listeners' motionsVSAvoidComplexity of detection and tracking system

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple detection functions into a unified detection system that simultaneously tracks the positions and motion states of multiple listeners. Rather than using separate detection systems for each listener, the system processes detection data from all listeners through a single integrated framework, reducing overall system complexity

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The detection system automatically identifies and tracks each listener's position and motion state without requiring manual configuration or intervention. The system self-adapts to the number and positions of listeners in the environment, automatically adjusting the sound field synthesis parameters for each detected listener

Inventive Principle:

Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables multiple listeners to hear spatially accurate and synchronized sounds as they move, enhancing the auditory experience by dynamically adjusting sound sources based on listener positions.

Implementation Method 1

outputs a sound through wave field synthesis so that a spatial sound field is transmitted

Methodology Applied

Scientific EffectWave field synthesis:

Data Source

PatentUS11546713B2Information processing device, information processing method, program, and information processing system

Publication Date: 2023.01.03 SONY GROUP CORP

AI summary

An information processing device includes circuitry that detects a change in a position of a person. The circuitry also changes a position of a virtual sound source in accordance with the change in the position of the person and outputs a sound through wave field synthesis so that a spatial sound field is transmitted via a plurality of speakers.