Sound Source Matching for Immersive Audio Playback

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing sound reproduction systems fail to provide an immersive listening experience without causing discomfort due to mismatches between auditory and visual perceptions of sound sources.

Innovation Solution

A sound processing method that analyzes environmental sound using neural networks to identify sound sources, compares this with pre-recorded audio data, and selectively reproduces audio data that does not match the environmental sound, thereby preventing overlap and maintaining consistency between perceived and actual sound sources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If sound reproduction systems play pre-recorded audio data without analysis, then the system operation is simple, but the user experiences discomfort due to mismatches between auditory and visual perceptions

Engineering Contradiction:

Improvesystem operation simplicityVSAvoiduser discomfort from sound-visual mismatch

Core Design Contradiction:

Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary analysis of environmental sound and compares it with pre-recorded audio data before reproduction. This advance preparation allows the system to identify matching sounds and exclude them from playback, preventing the discomfort caused by sound-visual mismatches while maintaining simple operation during actual use

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If the system analyzes environmental sound and selectively reproduces non-matching audio data, then user immersion is improved, but the device complexity increases

Engineering Contradiction:

Improvelistening experience qualityVSAvoidsound processing system complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system extracts only the necessary audio data for reproduction by excluding pre-recorded sounds that match the environmental sound. This selective extraction approach improves listening immersion while keeping the processing system relatively simple by focusing only on what needs to be reproduced rather than analyzing and processing all possible audio data

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses pre-recorded audio data as copies of real-world sounds to compare against environmental sound. This copying approach allows the system to achieve sophisticated sound-visual synchronization without requiring complex real-time analysis, as the pre-recorded data serves as a reference library for quick matching

Inventive Principle:

Principle #26Copying

Data Source

PatentUS12542146B2Sound processing method, sound processing apparatus and sound processing system

Publication Date: 2026.02.03 YAMAHA CORP

AI summary

A sound processing method obtains first audio data representing first sound, obtains second audio data representing second sound created in advance, analyzes the first audio data, compares the second audio data with an analysis result of the analyzing, reproduces third audio data from the second audio data by omitting a type of sound from the second sound that matches a type of sound in the first sound, based on a comparison result of the comparing, and outputs an audio signal representing the reproduced third audio data.