Viewpoint-Adaptive Stereoscopic Image Processing Apparatus

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing stereoscopic display systems face challenges in displaying images stereoscopically when the user's viewpoint direction changes, as they typically require a fixed disparity direction, limiting flexibility and realism in viewing angles.

Innovation Solution

An image processing apparatus that determines the user's viewpoint direction and generates disparity images by selecting and synthesizing source images from a set of images captured at various viewpoints, allowing for stereoscopic display regardless of the user's position, using a liquid crystal shutter scheme to ensure stereoscopic viewing from any direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fixed disparity direction is used in stereoscopic display systems, then the system structure is simple and easy to implement, but the system cannot adapt when the user's viewpoint direction changes, limiting flexibility and realism

Engineering Contradiction:
Improveadaptability to user viewpoint directionVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic adaptation by detecting the user's actual viewpoint direction and dynamically adjusting the disparity direction of the stereoscopic image accordingly. The system transitions from a static fixed disparity approach to a dynamic one where the disparity direction changes based on user position, thereby improving adaptability without requiring multiple physical display devices

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the disparity parameter (direction and magnitude) based on the detected user viewpoint. By adjusting the disparity parameter dynamically according to user position, the system achieves adaptability to different viewing angles while maintaining a single display device, thus resolving the contradiction between adaptability and system complexity

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If multiple source images from different viewpoints are captured and synthesized, then stereoscopic viewing from any direction is enabled, but the data processing complexity and computational load increase

Engineering Contradiction:
Improveviewing flexibility from any directionVSAvoidimage processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by capturing multiple source images from different viewpoints in advance and storing them. When a user views the display, the system selects and synthesizes the appropriate source images based on the detected viewpoint direction. This pre-capture approach enables flexible stereoscopic viewing from any direction while managing processing complexity by preparing images beforehand rather than generating them in real-time

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates virtual copies of the subject from different viewpoints by synthesizing images from multiple captured source images. Instead of requiring multiple physical cameras positioned at all possible viewing angles, the system generates synthetic viewpoint images through image processing, thereby enabling viewing flexibility while controlling the complexity of the physical system

Inventive Principle:
Principle #26Copying

3Reliability

If the disparity direction is changed dynamically based on user position, then realism and viewing experience are improved, but the processing time and computational resources required increase

Engineering Contradiction:
Improvestereoscopic display accuracyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements feedback by detecting the user's viewpoint direction in real-time and using this information to adjust the disparity direction of the displayed stereoscopic image. This closed-loop feedback mechanism ensures that the displayed image always matches the user's actual viewing position, improving stereoscopic display accuracy and realism while managing processing time through efficient detection and adjustment algorithms

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9210407B2Image processing apparatus and method, and program
Publication Date: 2015.12.08 SONY GROUP CORP
  • US9210407B2 patent drawing
  • US9210407B2 patent drawing
  • US9210407B2 patent drawing

AI summary

An apparatus for processing source images having known viewpoints is disclosed. The apparatus may include a viewpoint determining section for determining, relative to the known viewpoints, left-eye and right-eye viewpoints of a viewer. Additionally, the apparatus may include a disparity image generating section. The disparity generating section may be for selecting data of at least one of the source images, based on the determined left-eye viewpoint, as raw left-eye data. In addition, the disparity generating section may be for selecting data of at least one of the source images, based on the determined right-eye viewpoint, as raw right-eye data. The disparity generating section may also be for outputting left-eye image data, based on the raw left-eye data. Additionally, the disparity generating section may be for outputting right-eye image data, based on the raw right-eye data.