Display Unit Vibration for Video Sound Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video sound systems fail to synchronize acoustic signals with video signals effectively, leading to discomfort and confusion for users when multiple video sources are displayed, as sound localization does not match the visual content, especially on large screens.

Innovation Solution

An information processing apparatus and method that uses vibrators to control sound output, detecting sound sources within videos and localizing sound images on the screen to match the visual content, ensuring synchronized audio-visual experience across multiple windows and screens.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional sound localization is used with multiple video sources displayed in parallel, then the display can show multiple video sources simultaneously, but the sound localization does not match the visual content causing user discomfort and confusion

Engineering Contradiction:
Improvemulti-video source display capabilityVSAvoiduser comfort and understanding
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent applies local quality by dynamically adjusting sound localization parameters according to the specific video source being displayed. Each video source in the parallel display is associated with specific sound localization settings that match its visual content, ensuring that the sound image is localized at the position corresponding to the sound source in the video, thereby resolving the mismatch between sound and visual content

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically switches sound localization parameters based on which video source is currently being displayed. When multiple video sources are shown in parallel, the sound localization is dynamically adjusted to match the active video source, creating a synchronized audio-visual experience that adapts to the current display state and eliminates user confusion

Inventive Principle:
Principle #15Dynamics

2Device complexity

If sound localization is implemented without synchronization to video content, then the system is simpler to implement, but it causes discomfort and confusion for users when multiple video sources are displayed

Engineering Contradiction:
Improvesound localization system complexityVSAvoiduser comfort
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent implements feedback by detecting the video source information and using this feedback to adjust sound localization parameters. The system continuously monitors which video source is displayed and automatically adjusts the sound localization settings accordingly, creating a closed-loop system that ensures synchronization between audio and visual content without requiring complex manual configuration

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary action by pre-configuring sound localization parameters for different video sources before they are displayed. When a specific video source is detected, the corresponding pre-configured sound localization settings are automatically applied, ensuring immediate synchronization without requiring real-time complex processing or adjustment

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides a synchronized audio-visual experience, enhancing user understanding and comfort by accurately localizing sound sources on the screen, even with multiple video sources, thereby improving the overall multimedia experience.

Implementation Method 1

uses one or more vibrators to vibrate the display unit and thereby control output of sound

Methodology Applied
Scientific EffectVibration: Vibration

Data Source

PatentUS12170876B2Information processing apparatus, information processing method, and video sound output system
Publication Date: 2024.12.17 SONY GROUP CORP
  • US12170876B2 patent drawing
  • US12170876B2 patent drawing
  • US12170876B2 patent drawing

AI summary

Provided are an information processing apparatus, an information processing method, and a video sound output system that execute an output process of an acoustic signal in synchronization with a video signal.The information processing apparatus includes a control section that detects a position of a sound source appearing in a video displayed on a screen of a display unit and that uses one or more vibrators to vibrate the display unit and thereby control output of sound such that a sound image of sound in synchronization with the video is localized at the position where the sound source appears on the screen displaying the video. In a case of displaying videos of two or more video sources on individual windows, the control section localizes a sound image of a sound source detected from the video of each video source at a position where the sound source appears in the corresponding window.