Microlens Array Position Correction for Solid-State Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing solid-state imaging devices with microlens arrays face challenges in initial correction due to errors in the position relation of microlenses, leading to image quality degradation and difficulty in distance estimation, especially when optical system distortions occur, such as attachment errors or distortions in the image formation lens.

Innovation Solution

A solid-state imaging device with a signal processing unit that corrects the optical position relation between microlenses and pixel blocks using image signals, employing a method to find and apply correction coefficients to align microlens images accurately, thereby improving image reconstruction and distance estimation precision.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a microlens array with multiple microlenses is used to acquire parallax images for distance estimation, then distance imaging capability is improved, but manufacturing errors in microlens position relations cause image quality degradation and make initial correction difficult

Engineering Contradiction:
Improvedistance estimation precisionVSAvoidmicrolens position relation accuracy
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing correction processing on the captured images before distance estimation. The signal processing unit corrects position relations of microlens images based on predetermined correction coefficients, eliminating the need for physical repositioning of microlenses. This preliminary digital correction resolves the manufacturing precision issue while preserving the distance imaging capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating a corrected version of the original image data through digital processing. Instead of physically correcting the microlens array, the system captures images with the microlens array and then generates corrected images by applying position correction algorithms, effectively copying the desired corrected state from the captured data.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If multiple microlenses are arranged to form a compound eye camera structure, then three-dimensional imaging capability is improved, but the system becomes more complex and initial correction becomes difficult

Engineering Contradiction:
Improvethree-dimensional imaging capabilityVSAvoidoptical system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical/optical correction system with a digital signal processing system. Instead of using complex mechanical adjustment mechanisms to correct microlens position relations, the invention uses electronic correction coefficients and digital image processing algorithms to achieve the same correction effect, thereby reducing device complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The signal processing unit acts as an intermediary between the microlens array and the final image output. It receives raw images containing position errors, applies correction processing using correction coefficients, and outputs corrected images, thereby mediating the effect of manufacturing errors without requiring physical modification of the optical system.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If correction processing is applied to images captured by microlens array, then image alignment precision is improved, but processing time and computational load increase

Engineering Contradiction:
Improveimage alignment precisionVSAvoidcorrection processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing correction coefficients before actual image capture. These correction coefficients, which compensate for microlens position errors, are determined in advance and stored in memory, allowing rapid application during image processing without requiring complex real-time calculations, thus reducing processing time.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively corrects optical distortions and errors, enhancing image alignment precision and preventing picture quality degradation, allowing for accurate distance estimation and improved image reconstruction even with multiple microlenses, thus reducing the impact of manufacturing errors on the reconstructed image.

Implementation Method 1

a second optical system configured to include a microlens array including a plurality of microlenses provided to correspond to the plurality of pixel blocks and reduce and re-form an image scheduled to be formed on the image formation plane, in a pixel block corresponding to an individual microlens

Methodology Applied
Scientific EffectOptical imaging: Lens

Data Source

PatentUS8681249B2Solid-state imaging device and portable information terminal
Publication Date: 2014.03.25 KK TOSHIBA
  • US8681249B2 patent drawing
  • US8681249B2 patent drawing
  • US8681249B2 patent drawing

AI summary

A solid-state imaging device according to an embodiment includes: a first optical system configured to form an image of an object on an image formation plane; an imaging element comprising an imaging area which includes a plurality of pixel blocks each including a plurality of pixels; a second optical system configured to include a microlens array including a plurality of microlenses provided to correspond to the plurality of pixel blocks and reduce and re-form an image scheduled to be formed on the image formation plane, in a pixel block corresponding to an individual microlens; and a signal processing unit configured to perform image signal processing with an optical position relation between each microlens and the pixel block corrected, by using an image signal of the object obtained by the imaging element.