3D Image Display Audio Depth Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image display technologies fail to effectively synchronize audio signals with the depth and movement of objects in 3D images, leading to a lack of immersive and realistic audio experiences during 3D image display.

Innovation Solution

An image display apparatus and method that detect the depth of 3D images and objects within them, performing 3D processing on audio signals in synchronization to control sound image localization and output, using techniques such as Head-Related Transfer Function (HRTF) filtering and subband analysis to enhance the stereophonic effect.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional audio output is used during 3D image display, then the audio signal is simple and easy to process, but the audio experience lacks immersion and realism

Engineering Contradiction:
Improveaudio experience qualityVSAvoidaudio processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The audio processing system dynamically adjusts sound image localization based on detected object movement and depth information from the 3D image. The audio signal is continuously modified to match the temporal and spatial changes in the visual content, creating an immersive experience where audio and video are synchronized in a dynamic manner rather than using static conventional audio output

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The controller acts as an intermediary that receives both the 3D image data and audio signal, detects depth and movement information from the image, and processes the audio signal accordingly. This intermediary processing layer enables the system to generate realistic audio experiences by mediating between the visual input and audio output through depth-based and movement-based audio processing

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If audio signal is processed in correspondence with depth and movement, then the stereophonic effect is enhanced, but the processing time and computational load increase

Engineering Contradiction:
Improveaudio spatial precisionVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary detection of depth information from the 3D image data structure, which is already encoded in the incoming video signal. By utilizing the depth information that is inherently part of the 3D image format rather than requiring separate measurement, the system achieves precise audio spatial positioning without significant additional processing time

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex real-time physical measurement systems with signal processing-based depth extraction. Instead of using sensors or mechanical measurement devices to determine object depth and movement, the system substitutes these with computational methods that extract depth information from the 3D image data, reducing processing time while maintaining high spatial precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8665321B2Image display apparatus and method for operating the same
Publication Date: 2014.03.04 LG ELECTRONICS INC
  • US8665321B2 patent drawing
  • US8665321B2 patent drawing
  • US8665321B2 patent drawing

AI summary

An image display apparatus and a method for operating the same are disclosed. The method for operating an image display apparatus includes receiving a 3-dimensional (3D) image, detecting the depth of the 3D image, performing 3D processing on an audio signal received in synchronization with the 3D image in correspondence with the detected depth, and outputting the audio signal subjected to 3D processing. Thus, it is possible to output the audio signal in correspondence with the depth of the 3D image during 3D image display.