Sound Field Synthesis Model for Real-Time Virtual Acoustics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating a virtual space sound field struggle to balance realism and real-time performance, with high-precision simulations requiring extensive calculations for high reality but resulting in low real-time performance, while simpler models achieve real-time performance at the cost of low realism.

Innovation Solution

A sound field synthesis model is pre-obtained through machine learning using high-precision calculation data, allowing for the generation of a virtual space sound field based on sound source information from a real space and virtual space information, combining the benefits of precision and real-time processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If high-precision simulation algorithm is used to generate virtual space sound field, then the degree of reality is improved, but the real-time performance deteriorates due to large amount of calculation required

Engineering Contradiction:
Improvedegree of realityVSAvoidreal-time performance
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-training a neural network model using high-precision simulation data before actual application. The model is trained offline with comprehensive training data, then deployed for real-time inference. This separates the heavy computational workload of training from the real-time operation phase, enabling both high precision and real-time performance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a computational model that copies the essential characteristics of high-precision sound field simulations. Instead of performing complex physical simulations in real-time, the system uses a neural network that has learned the mapping relationships from input parameters to sound field characteristics, producing similar results much faster.

Inventive Principle:
Principle #26Copying

2Productivity

If ideal model is used to calculate sound field for real-time performance, then the real-time performance is improved, but the degree of reality deteriorates

Engineering Contradiction:
Improvereal-time performanceVSAvoiddegree of reality
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent changes the fundamental parameters of the calculation model by replacing traditional physics-based simulation algorithms with a data-driven neural network model. The model takes input parameters (sound source information, virtual space information) and outputs sound field characteristics through learned transformations, achieving both speed and accuracy.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent substitutes traditional mechanical/computational simulation methods with a neural network-based system. Instead of performing explicit physical calculations involving wave propagation, reflection, and absorption, the system uses a trained neural network to directly compute sound field characteristics, dramatically reducing computational complexity while maintaining accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20240251218A1Information processing apparatus, information processing method, and computer-readable storage medium
Publication Date: 2024.07.25 SONY (CHINA) CO LTD
  • US20240251218A1 patent drawing
  • US20240251218A1 patent drawing
  • US20240251218A1 patent drawing

AI summary

The present disclosure relates to an information processing apparatus, an information processing method, and a computer-readable storage medium. The information processing apparatus according to the present disclosure includes processing circuitry configured to: obtain a sound field in a virtual space, by using a sound field synthesis model, based on sound source information about a sound source in a real space and virtual space information indicating an object present in a virtual space. The sound field synthesis model is pre-obtained through machine learning by using a sound field in a virtual space obtained from high-precision calculation as learning data.