Segmented Image Sensor Pixels for Circular Blur and Multi-F-Number Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image pickup apparatuses struggle to obtain images with different F-numbers while maintaining an optimal blur shape, as they often produce rectangular blur due to the rectangular shape of the image pickup elements, which is undesirable compared to the round shape of mechanical diaphragm apertures.

Innovation Solution

The image processing apparatus features a pixel arrangement with micro lenses and a photoelectric conversion region divided into multiple regions by segmented upper and lower electrodes, allowing for the generation of photoelectric conversion signals from different pupil regions, enabling the formation of images with various F-numbers and optimizing the blur shape to be circular.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a rectangular image pickup element is used, then the device structure is simple and easy to manufacture, but the blur shape becomes rectangular which is not preferable

Engineering Contradiction:
Improveease of manufactureVSAvoidblur shape
Core Design Contradiction:
Ease of manufactureVSShape

Solution Approach 1:

The image pickup element is divided into multiple sub-elements (first, second, third, and fourth image pickup elements) arranged in specific patterns. This segmentation allows each sub-element to contribute to forming a circular blur shape while maintaining the overall rectangular pixel structure, thus resolving the contradiction between manufacturing simplicity and blur shape quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image pickup element are assigned different functions through the segmented structure. The first and second image pickup elements form a first blur shape, while the third and fourth elements form a second blur shape, with specific local arrangements optimizing the overall circular blur appearance while keeping the manufacturing process straightforward.

Inventive Principle:
Principle #3Local quality

2Shape

If multiple images with different F-numbers are obtained by changing mechanical diaphragm, then the blur shape can be optimized, but the shooting time and operation complexity increase

Engineering Contradiction:
Improveblur shapeVSAvoidshooting time
Core Design Contradiction:
ShapeVSLoss of time

Solution Approach 1:

The image pickup element is pre-configured with multiple segmented regions that can simultaneously capture light from different pupil regions corresponding to different F-numbers. This preliminary structural arrangement eliminates the need for mechanical diaphragm adjustment during shooting, allowing multiple F-number images to be captured in a single exposure operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The segmented image pickup element serves multiple functions simultaneously: it can capture images at different F-numbers (F2.8, F4.0, F5.6) in a single shot, and each segment can be independently read out to provide flexibility in post-processing. This multi-functionality eliminates the need for multiple separate shooting operations.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If the image pickup element is divided into multiple regions, then images with different F-numbers can be obtained, but the device complexity increases

Engineering Contradiction:
ImproveadaptabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The image pickup element is divided into multiple sub-elements (first, second, third, and fourth image pickup elements) arranged in specific patterns. This segmentation allows each sub-element to contribute to forming a circular blur shape while maintaining the overall rectangular pixel structure, thus resolving the contradiction between manufacturing simplicity and blur shape quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image pickup element are assigned different functions through the segmented structure. The first and second image pickup elements form a first blur shape, while the third and fourth elements form a second blur shape, with specific local arrangements optimizing the overall circular blur appearance while keeping the manufacturing process straightforward.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for the easy acquisition of multiple images corresponding to different F-numbers with a preferred circular blur shape, eliminating the need for multiple shooting operations and enhancing the flexibility in designing pupil patterns, thus improving image quality and processing efficiency.

Implementation Method 1

a micro lens for condensing light from outside into the pixel

Methodology Applied
Scientific EffectLight focusing: Lens

Implementation Method 2

a photoelectric conversion region provided beneath the micro lens and for generating a photoelectric conversion signal

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS11122196B2Image processing apparatus
Publication Date: 2021.09.14 CANON KK
  • US11122196B2 patent drawing
  • US11122196B2 patent drawing
  • US11122196B2 patent drawing

AI summary

In order to provide an image processing apparatus that can obtain images having a plurality of F-numbers simultaneously by one shooting operation, the image processing apparatus includes an image pickup device, each pixel of the image pickup device has a micro lens for condensing light and a photoelectric conversion region provided beneath the micro lens, and the photoelectric conversion region includes an upper electrode and a lower electrode sandwiching a photoelectric conversion film and forms at least first to third regions that are divided and arranged in a plane parallel to the image pickup plane by the upper electrode or the lower electrode. Additionally, the first region has a shape for forming a circle, and the second and third regions are arranged outside the first region. Additionally, the image processing apparatus includes a readout unit that reads out photoelectric conversion signals obtained from one image pickup operation from each of the first to third regions.