Parallax Image Defect Correction via Captured Image Reference
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image pickup apparatuses suffer from defects such as dot flaws, line flaws, and shading issues due to pupil division, leading to degraded parallax image quality.
Innovation Solution
An image processing apparatus that includes an image processing unit capable of correcting defects in parallax images by combining signals from subpixels and using correction values calculated based on captured image data to improve image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If pupil division is used to capture multiple parallax images simultaneously, then imaging efficiency is improved, but image quality deteriorates due to defects and shading
Solution Approach 1:
The patent extracts and removes defective regions from parallax images by identifying bad pixels through comparison between captured images and parallax images. The correction unit extracts bad pixel information and uses it to replace defective regions, thereby eliminating the harmful effects of pupil division while maintaining the efficiency benefit.
Solution Approach 2:
The patent introduces captured images as an intermediary reference to correct defects in parallax images. By comparing parallax images with captured images and using the captured images as a reference for correction, the system mediates between the efficiency of pupil division and the quality degradation it causes.
2Quantity of substance
If multiple parallax images are captured simultaneously through pupil division, then the number of captured viewpoints increases, but defects such as dot flaws and line flaws occur
Solution Approach 1:
The patent converts the harmful effect of having multiple viewpoints (which causes defects) into a benefit by using the captured image as a reference to identify and correct defects in the parallax images. The defect correction process transforms the problematic multi-viewpoint data into high-quality output by eliminating defects.
Solution Approach 2:
The patent extracts and removes defective regions from parallax images by identifying bad pixels through comparison between captured images and parallax images. The correction unit extracts bad pixel information and uses it to replace defective regions, thereby eliminating the harmful effects of pupil division while maintaining the efficiency benefit.
3Adaptability or versatility
If parallax images are used for image processing, then refocusing capability is improved, but image quality is degraded by shading and saturated signals
Solution Approach 1:
The patent implements a feedback mechanism where the correction unit continuously compares parallax images with captured images, identifies defects including shading and saturated signals, and applies corrections. This feedback loop ensures that refocusing capability is maintained while image quality is improved by eliminating shading and other defects.
Solution Approach 2:
The patent introduces captured images as an intermediary reference to correct defects in parallax images. By comparing parallax images with captured images and using the captured images as a reference for correction, the system mediates between the efficiency of pupil division and the quality degradation it causes.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution effectively reduces defects and enhances the quality of parallax images by performing correction processes, resulting in improved image processing and refocusing accuracy.
Implementation Method 1
an imaging lens into a plurality of pupil regions and simultaneously capturing a plurality of parallax images
Implementation Method 2
a two-dimensional image pickup element that includes a single micro lens and a plurality of divided photoelectric converters for one pixel
Data Source
Figure 1
Figure 2~3B
Figure 4
AI summary
[PROBLEMS] The present invention provides an image processing apparatus which can generate a parallax image having an improved quality. [SOLVING MEANS] An image processing apparatus includes an acquisition unit 125a which acquires a parallax image generated based on a signal of a photoelectric converter among a plurality of photoelectric converters which receive light beams passing through partial pupil regions of an imaging optical system different from each other, and acquires a captured image generated by combining signals of the plurality of photoelectric converters, and an image processing unit 125b which performs correction process so as to reduce a defect included in the parallax image based on the captured image.