Image Capture Apparatus Defocus Distribution Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing systems face increased data size and processing load when detecting defocus distribution in images captured by sensors with multiple photoelectric conversion units per pixel, leading to reduced image capture capacity and longer data communication times.

Innovation Solution

An image capture apparatus and system that reduces captured image data, generates spatial defocus distribution data, extracts relevant pixel data, and outputs it along with the entire exit pupil data, using a combination of reduction and generation units to lighten the processing load and improve efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If two types of image data are recorded to calculate defocus amount, then defocus distribution detection accuracy is improved, but data size doubles and processing load increases

Engineering Contradiction:
Improvedefocus distribution detection accuracyVSAvoiddata size
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent divides the image data processing into two stages: first, reduce the resolution of captured images to create lower-resolution versions for defocus calculation; second, use the calculated defocus distribution to guide selective processing of original high-resolution data. This segmentation allows accurate defocus detection without processing full-resolution dual-image data simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a simplified copy of the image data by reducing resolution, using this reduced copy for defocus distribution calculation, and then applying the results back to the original full-resolution data. This copying approach avoids the need to process two full-resolution images while maintaining measurement accuracy.

Inventive Principle:
Principle #26Copying

2Measurement precision

If two types of image data are recorded to calculate defocus amount, then defocus distribution detection accuracy is improved, but the number of capturable images decreases

Engineering Contradiction:
Improvedefocus distribution detection accuracyVSAvoidimage capture capacity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the image data into reduced-resolution versions for defocus analysis and maintains separate storage for original high-resolution images. This allows the system to process defocus information from reduced data while preserving full-resolution capture capacity, effectively doubling the number of capturable images compared to storing two full-resolution datasets.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates reduced-resolution copies of captured images specifically for defocus calculation purposes, while the original full-resolution images remain available for storage and final output. This copying strategy enables continuous high-capacity image capture without the data size constraints that would otherwise limit image capture frequency.

Inventive Principle:
Principle #26Copying

3Power

If image processing is performed by a separate image processing apparatus, then processing capability is improved, but data communication time increases

Engineering Contradiction:
Improveprocessing capabilityVSAvoiddata communication time
Core Design Contradiction:
PowerVSLoss of time

Solution Approach 1:

The patent extracts only the essential defocus distribution information from the captured images by processing reduced-resolution data, and transmits only this extracted defocus data along with necessary pixel information to the external processing apparatus. This extraction approach dramatically reduces communication data volume and time while maintaining the external apparatus's processing capability for final image generation.

Inventive Principle:
Principle #2Taking out (Extraction)

4Measurement precision

If data size doubles, then defocus distribution analysis accuracy is improved, but processing load for data processing increases

Engineering Contradiction:
Improvedefocus distribution analysis accuracyVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the processing workload by first calculating defocus distribution using reduced-resolution image data, which requires minimal processing power. Then, it uses the pre-calculated defocus distribution map to guide selective processing of only relevant regions in the original high-resolution data, significantly reducing the overall processing load compared to processing all high-resolution data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary defocus distribution calculation using reduced-resolution data before processing the full-resolution images. This preliminary action identifies regions of interest and prepares defocus maps in advance, so that subsequent processing of high-resolution data requires minimal computational resources, focusing only on areas needing enhancement.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10368012B2Image capture apparatus, image processing system, and control method thereof
Publication Date: 2019.07.30 CANON KK
  • US10368012B2 patent drawing
  • US10368012B2 patent drawing
  • US10368012B2 patent drawing

AI summary

When distribution image data indicating a defocus distribution is generated from a plurality of sets of image data including pupil-divided image data that is captured image data corresponding to part of an exit pupil, reduced image data is used. Further, based on the distribution image data, pixel data that is to be subjected to the image processing is extracted from the pupil-divided image data corresponding to the distribution image data. The extracted pixel data, the defocus distribution image data, and captured image data corresponding to the entirety of the exit pupil are recorded or output to an external device.