Audio Mapping Across Display Speakers for Stable Sound Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing methods for interlocking sound and video using multiple speakers result in a narrow range of correctly reproduced sound images, making it difficult to achieve a sense of unity between the video and audio.

Innovation Solution

An information processing apparatus and method that extracts audio data corresponding to different sound sources and maps them to combinable display and speaker units, utilizing a control system to render and reproduce audio content based on reproduction environment information, including a sound source extraction unit, band division, and mapping processing units to enhance sound image localization and unity with video.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a phantom sound image method is used to interlock sound and video, then sound image position can be controlled, but the range of viewing position where the sound image is correctly reproduced is narrow

Engineering Contradiction:
Improvesound image position accuracyVSAvoidviewing position range
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system segments the audio data into multiple frequency bands and processes each band separately through different speaker groups. This segmentation allows the sound image to be constructed from multiple discrete sound sources, expanding the viewing position range while maintaining position accuracy through coordinated control of each segment.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from traditional two-dimensional speaker arrangements to a three-dimensional sound field construction by utilizing vertical speaker placement and multi-level audio processing. This dimensional expansion creates a more robust sound image that remains stable across wider viewing angles.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If traditional speaker-based sound reproduction is used, then audio content can be reproduced, but it is difficult to obtain a sense of unity between video and audio

Engineering Contradiction:
Improveaudio reproductionVSAvoidsense of unity between video and audio
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system merges video and audio processing into a unified control framework where the information processing apparatus simultaneously manages both visual and auditory content. This integration ensures that sound images are precisely positioned to match visual elements, creating a cohesive sense of unity between video and audio.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The information processing apparatus performs multiple functions including audio extraction, frequency band division, sound image position calculation, and speaker control within a single integrated system. This multi-functionality streamlines the operation and enhances the coherence between visual and auditory presentations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances the sense of unity between video and audio by accurately reproducing sound images across a wider range, reducing vibration-induced image shifts, and improving sound localization capabilities.

Implementation Method 1

each of the plurality of display units 12 outputs a sound associated with a display video

Methodology Applied
Scientific EffectVibration: Vibration

Data Source

PatentUS12483850B2Information processing apparatus, information processing method, and information processing program
Publication Date: 2025.11.25 SONY GROUP CORP
  • US12483850B2 patent drawing
  • US12483850B2 patent drawing
  • US12483850B2 patent drawing

AI summary

An information processing apparatus (30) includes a sound source extraction unit (341) and a mapping processing unit (343). The sound source extraction unit (341) extracts one or more audio data (AD) corresponding to different sound sources from audio content (AC). The mapping processing unit (343) selects, for each audio data (AD), one or more display units (12) to serve as mapping destinations of the audio data (AD) from one or more combinable display units (12) including a sound producing mechanism.