Ghost Removal in Parallax Images via Pupil Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing methods for removing unnecessary components like ghosts and flares in images require multiple image captures, making them unsuitable for still or moving object image pickup, and are inefficient when dealing with parallax images captured at three or more viewpoints.
Innovation Solution
An image processing method that generates parallax images by guiding light beams through different regions of the image pickup optical system's pupil to an image pickup element, allowing for the detection and reduction of unnecessary components in a single image capture by calculating relative difference images and synthesizing unnecessary components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple image captures are performed to detect and remove unnecessary components, then the detection accuracy of ghosts and flares is improved, but the productivity and suitability for moving object image pickup deteriorate
Solution Approach 1:
The image pickup apparatus segments the pupil of the image pickup optical system into multiple regions, and each pixel unit detects light beams passing through different pupil regions. This segmentation allows the system to capture multiple parallax images simultaneously in a single shot, enabling ghost detection without requiring multiple captures, thus resolving the contradiction between detection accuracy and productivity.
2Measurement precision
If multiple parallax images from three or more viewpoints are used for ghost detection, then the detection coverage is improved, but the processing complexity increases
Solution Approach 1:
The patent combines the detection results from multiple pixel units that correspond to different pupil regions into a single ghost detection result. By merging the information from multiple parallax images captured simultaneously, the system achieves comprehensive ghost detection coverage while maintaining simple processing procedures, resolving the contradiction between detection coverage and processing complexity.
3Reliability
If ghost removal processing is performed on each parallax image separately, then the ghost removal effectiveness is improved, but the processing time and complexity increase
Solution Approach 1:
Instead of performing ghost removal processing on each parallax image separately, the patent performs ghost detection based on multiple parallax images and then performs the removal processing once on the synthesized image. This merging approach maintains effective ghost removal while significantly reducing processing time and complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method effectively reduces unnecessary components in images without the need for multiple captures, improving image quality by simplifying the processing and maintaining high image fidelity.
Implementation Method 1
generating a plurality of parallax images by guiding, with the image pickup optical system, a plurality of light beams passing through regions of a pupil that are different from each other to light-receiving portions that are different from each other
Implementation Method 2
calculating relative difference information of the plurality of parallax images; determining any unnecessary component in each of the plurality of parallax images based on the plurality of pieces of relative difference information
Data Source
Figure 1(A-1)~2B
Figure 3~4
Figure 5
AI summary
An image processing method includes the steps of determining a first unnecessary component included in each of a plurality of parallax images based on a plurality of pieces of relative difference information of the parallax images (S14, S25, S35, S46), calculating a synthesis value of the first unnecessary components included in the parallax images (S15, S26, S36, S47), and reducing a second unnecessary component included in a synthesis image of the parallax images based on the synthesis value of the first unnecessary components (S17, S28, S38, S50).