Lens Array Image Reconstruction for Compact Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging apparatuses face challenges in maintaining high resolution and sensitivity while minimizing volume, often resulting in degraded image quality due to reduced sensor size and focal length, which complicates capturing images in low-light environments.

Innovation Solution

An image processing method and apparatus that utilize a lens array and sensor with a relatively prime number of lenses and sensing elements, performing color interpolation and rearranging transformation matrices to enhance image quality and uniformity, allowing for the reconstruction of high-resolution images from low-resolution inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If the size of the sensor is reduced to decrease the volume of the imaging apparatus, then the volume decreases, but the quantity of light incident to the sensor decreases and image resolution decreases

Engineering Contradiction:
Improvevolume of imaging apparatusVSAvoidimage resolution
Core Design Contradiction:
Volume of moving objectVSMeasurement precision

Solution Approach 1:

The imaging apparatus divides the single lens into multiple lenses arranged in an array, and divides the sensor into multiple sensing elements. This segmentation allows each lens to focus light onto specific sensing elements, enabling the compact multi-lens system to achieve high-resolution imaging through coordinated light focusing across multiple elements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a spatial arrangement dimension by configuring lenses and sensing elements in specific geometric patterns (e.g., hexagonal or rectangular arrays). This dimensional organization allows the system to capture light from multiple angles and reconstruct high-resolution images through computational processing, overcoming the limitations of reduced sensor size.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Volume of moving object

If the size of the lens is reduced to decrease the focal length and volume, then the volume decreases, but the image quality deteriorates in low-resolution environments

Engineering Contradiction:
Improvevolume of imaging apparatusVSAvoidimage quality in low-light environment
Core Design Contradiction:
Volume of moving objectVSReliability

Solution Approach 1:

The patent combines multiple small lenses into a lens array that works together with multiple sensing elements. By merging the optical functions of multiple lenses and coordinating their light focusing with corresponding sensing elements, the system achieves reliable image quality in low-light conditions while maintaining a compact form factor.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The multi-lens array creates multiple copies of the optical path, with each lens-sensing element pair forming a redundant imaging channel. This copying approach allows the system to gather more light through multiple pathways, improving low-light performance without increasing the overall apparatus volume.

Inventive Principle:
Principle #26Copying

3Volume of moving object

If a multi-lens with small lenses is used to decrease the volume, then the volume decreases, but the focal length decreases and image quality is compromised

Engineering Contradiction:
Improvevolume of imaging apparatusVSAvoidimage quality
Core Design Contradiction:
Volume of moving objectVSManufacturing precision

Solution Approach 1:

The patent assigns specific functional characteristics to different regions of the lens array and sensor array. Each lens is optimized for its specific position and focuses light onto corresponding sensing elements with tailored optical properties. This local optimization maintains high manufacturing precision and image quality despite the reduced size of individual lenses.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively increases image resolution and sensitivity while maintaining a compact form factor, improving color uniformity and interpolation performance, thereby addressing the limitations of smaller sensor sizes and focal lengths.

Implementation Method 1

a lens array and a sensor disposed at a focal distance from the lens array

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

obtaining, by a sensor and a lens array, a first image corresponding to an original image

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10868957B2Apparatus and method for processing image to reconstruct image
Publication Date: 2020.12.15 SAMSUNG ELECTRONICS CO LTD
  • US10868957B2 patent drawing
  • US10868957B2 patent drawing
  • US10868957B2 patent drawing

AI summary

Provided is an image processing apparatus and method. The image processing method includes obtaining, by a sensor and a lens array, a first image corresponding to an original image, identifying the first image obtained by the sensor and the lens array, rearranging the first image in response to rearranging a transformation matrix based on the sensor and the lens array, and generating a second image by performing a color interpolation on the rearranged first image.