Lensless Imaging Device Complex Sensor Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Lensless imaging devices face significant arithmetic processing challenges during focus adjustment and noise removal, leading to increased computational demands and inefficiencies in transmitting and processing sensor images.

Innovation Solution

The implementation of a modulator with a grating pattern, an image sensor, a complex sensor image processing unit, and a data transmission unit, which converts light into electrical signals and transmits complex sensor images to reduce communication data and simplify processing, enabling efficient focus adjustment and various imaging functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If focus adjustment and noise removal are performed on sensor images from lensless imaging devices, then imaging functions such as auto focus and ranging can be achieved, but enormous arithmetic processing is required due to repeated multiplication by reconstruction patterns and noise removal calculations

Engineering Contradiction:
Improveimaging functionsVSAvoidarithmetic processing
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing the fringe scan operation and generating the complex sensor image before transmission. This preprocessing step converts the raw sensor image into a complex representation that encodes depth and focus information, thereby eliminating the need for repeated multiplication by reconstruction patterns during post-processing focus adjustment. The complex sensor image is transmitted to the server, which then performs focus adjustment with significantly reduced computational load.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If sensor images are transmitted for further processing and analysis, then network connectivity and expanded application range are achieved, but the amount of communication data increases

Engineering Contradiction:
Improvenetwork connectivityVSAvoidcommunication data
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent applies parameter changes by transforming the sensor image into a complex sensor image with complex number values. This transformation changes the data structure and encoding format, allowing the same amount of information to be represented more efficiently. The complex sensor image contains encoded depth and focus information that enables subsequent processing with reduced data requirements compared to transmitting and processing multiple raw sensor images at different focus positions.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution significantly reduces arithmetic processing requirements, allowing for efficient transmission and processing of sensor images, thereby enhancing the functionality and performance of lensless imaging devices while minimizing computational load and data transmission bandwidth.

Implementation Method 1

a modulator configured to modulate the intensity of light, based on a grating pattern

Methodology Applied
Scientific EffectDiffraction: Diffraction

Implementation Method 2

the signal processing unit modulates the image signals output from the image storage unit in accordance with an imaginary second grating pattern composed of multiple concentric circles, thereby generating a moire fringe image

Methodology Applied
Scientific EffectMoiré effect: Moiré Effect

Implementation Method 3

an image sensor configured to convert light passing through the modulator to electrical signals to generate a sensor image

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS10951793B2Imaging device, imaging method, and image processing device generating a complex sensor image
Publication Date: 2021.03.16 HITACHI LTD
  • US10951793B2 patent drawing
  • US10951793B2 patent drawing
  • US10951793B2 patent drawing

AI summary

An imaging device includes: a modulator configured to modulate the intensity of light, based on a grating pattern; an image sensor configured to convert light passing through the modulator to electrical signals to generate a sensor image; a complex sensor image processing unit configured to generate, from the sensor image, a complex sensor image comprising a complex number; and a data transmission unit configured to transmit the complex sensor image.