Stereo Image Foreign Object Correction via Parallax Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Foreign objects adhering to optical systems in stereoscopic image capturing devices impair the quality of stereoscopic viewing, and existing detection technologies do not effectively improve viewing quality even after object removal.

Innovation Solution

An image processing device and method that selects reference and correction images based on correlation values and phase differences to identify and correct foreign objects in the images, generating a composite image that suppresses the impact of foreign objects on stereoscopic viewing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If foreign object detection technology is used, then foreign objects can be detected, but the quality of stereoscopic viewing is not improved and may deteriorate further

Engineering Contradiction:
Improveforeign object detection accuracyVSAvoidstereoscopic viewing quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the image processing into distinct functional modules: foreign object detection unit, parallax calculation unit, and image correction unit. This segmentation allows the system to detect foreign objects while simultaneously generating corrected images that maintain stereoscopic viewing quality, resolving the contradiction between detection capability and viewing quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary image correction by generating corrected images that remove foreign object effects before final display. The correction process uses parallax information to reconstruct clean images in advance, ensuring that the displayed stereoscopic images are free from foreign object interference while maintaining detection functionality.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If foreign objects are not removed from the optical system, then detection can continue, but user may not remove objects properly and viewing quality deteriorates

Engineering Contradiction:
Improveforeign object detection capabilityVSAvoidforeign object removal efficiency
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the manual mechanical removal process with an automated digital image correction system. The system uses computational algorithms to detect and remove foreign object effects from images automatically, eliminating the need for users to physically clean or remove objects from the optical system, thereby maintaining detection capability while dramatically improving ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If multiple foreign objects adhere to the optical system, then detection complexity increases, but viewing quality deteriorates more severely

Engineering Contradiction:
Improveforeign object detection accuracyVSAvoidstereoscopic viewing quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the image correction process into region-based processing where the correction unit identifies and processes each foreign object region independently using parallax information. This segmentation approach allows the system to handle multiple foreign objects simultaneously without overwhelming complexity, maintaining both detection accuracy and viewing quality even when multiple objects are present.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP4475525A1Image processing device
Publication Date: 2024.12.11 CANON KK
  • EP4475525A1 patent drawingFigure 1
  • EP4475525A1 patent drawingFigure 2
  • EP4475525A1 patent drawingFigure 3A~3B

AI summary

An image processing device according to the present invention includes: acquiring means configured to acquire a first image captured via a first optical system and a second image captured via a second optical system; detecting means configured to detect, as a foreign object region, a region satisfying a predetermined condition in one image out of the first image and the second image; and correcting means configured to correct a pixel value in the foreign object region in the one image by using a pixel value of another image out of the first image and the second image.