Audio Processing Device for 3D Stereoscopic Image Linkage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional 3D display devices struggle to effectively link audio with stereoscopic images, particularly when converting 2D images to 3D, and fail to emphasize the connection between 3D images and audio.

Innovation Solution

An audio processing device and method that estimates a user's representative perceived position of a stereoscopic image from the difference between left-eye and right-eye images, controlling audio output accordingly to enhance the linkage between the 3D image and audio, using a front and rear audio output system adjusted based on the estimated position relative to a reference plane.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional 3D display devices display stereoscopic images without audio position estimation, then the system is simple, but the linkage between 3D image and audio is impaired

Engineering Contradiction:
Improvelinkage between 3D image and audioVSAvoidaudio processing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces complex multi-channel audio routing mechanics with a computational estimation system. Instead of physically configuring multiple speakers for different positions, the system uses image processing to estimate perceived position and controls audio output through software algorithms, substituting mechanical audio system complexity with computational methods

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses the stereoscopic image data already being processed for display to automatically estimate the perceived position. The same image processing pipeline that generates the 3D effect also provides the position information needed for audio control, making the system self-sufficient without requiring separate sensors or additional input devices

Inventive Principle:
Principle #25Self-service

2Reliability

If audio output is controlled according to representative perceived position, then the linkage between stereoscopic image and audio is emphasized, but the audio control system becomes more complex

Engineering Contradiction:
Improvelinkage between stereoscopic image and audioVSAvoidaudio controller complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The audio controller is designed to handle multiple audio scenarios through a single unified algorithm. The same perceived position estimation serves both 2D and 3D audio routing needs, and the controller can adapt to different speaker configurations (front/rear speakers, left/right speakers) without requiring separate control systems for each scenario

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system controls audio output by dynamically changing audio parameters (volume, pan position, channel assignment) based on the estimated perceived position. Instead of requiring complex physical reconfiguration of audio equipment, the system achieves different audio scenarios by adjusting software-controlled parameters in real-time

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9351092B2Audio processing device, audio processing method, and program
Publication Date: 2016.05.24 SONY GROUP CORP
  • US9351092B2 patent drawing
  • US9351092B2 patent drawing
  • US9351092B2 patent drawing

AI summary

There is provided an audio processing device including an estimation unit configured to estimate a user's representative perceived position of a stereoscopic image from a difference between a left-eye image and a right-eye image of the stereoscopic image displayed on a display device, and an audio controller configured to control audio output of an audio output device in accordance with the representative perceived position estimated by the estimation unit.