Lensless Imaging Element Angle Directivity Signal Restoration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging devices without imaging lenses face challenges in improving image quality due to limitations in light reception and processing.

Innovation Solution

The use of an imaging element with pixels having incident angle directivity, where each pixel has different light-receiving sensitivity characteristics based on the incident angle of light, allowing for the creation of simultaneous equations to restore the image without the need for an imaging lens, pinhole, or optical filter, enabling flexible pixel arrangement and improved design freedom.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If an imaging lens is used, then image quality can be improved, but device complexity and size increase

Engineering Contradiction:
Improveimage qualityVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes the imaging lens from the optical system, replacing it with a lattice-shaped optical filter directly positioned at the light-receiving surface of the imaging element. This eliminates the need for separate lens components while maintaining imaging functionality through computational restoration.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical optical focusing system (imaging lens) with a computational approach using a lattice-shaped optical filter and arithmetic restoration processing. The physical lens is substituted by a combination of optical filtering and digital signal processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If an imaging lens is removed, then device size and cost are reduced, but image quality deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidimage quality
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces a lattice-shaped optical filter as an intermediary component at the light-receiving surface. This filter modulates incident light in a specific pattern that enables subsequent computational restoration, serving as a bridge between the removed lens and the imaging element.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the optical parameters by using a lattice-shaped filter with specific periodic structures that modify light transmission characteristics. The filter's geometric parameters (lattice constant, shape, orientation) are optimized to enable effective image restoration through arithmetic processing.

Inventive Principle:
Principle #35Parameter changes

3Volume of moving object

If a lattice-shaped optical filter is used without imaging lens, then device compactness is improved, but light reception efficiency decreases

Engineering Contradiction:
Improvedevice compactnessVSAvoidlight reception efficiency
Core Design Contradiction:
Volume of moving objectVSUse of energy by moving object

Solution Approach 1:

The lattice-shaped optical filter serves multiple functions simultaneously: it acts as both an optical modulation element and a structural component of the imaging system. The filter enables compact device design while its periodic structure is optimized to maintain adequate light transmission for effective imaging.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances image quality by allowing for the restoration of images without the constraints of traditional optical components, resulting in a more compact and cost-effective imaging device with improved design flexibility and higher image resolution.

Implementation Method 1

an imaging element 51 in which each pixel has detection sensitivity with incident angle directivity

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP3700187B1Signal processing device and imaging device
Publication Date: 2023.04.12 SONY GROUP CORP
  • EP3700187B1 patent drawingFigure 1
  • EP3700187B1 patent drawingFigure 2
  • EP3700187B1 patent drawingFigure 3

AI summary

The present disclosure relates to a signal processing device and an imaging device capable of improving an image quality of the imaging device that does not use an imaging lens. A signal processing device includes a restoration unit that restores one restored image by using a plurality of detection signal sets obtained by an imaging element in a plurality of states in which at least one of a position or orientation with respect to a subject is different, the imaging element that includes a plurality of pixel output units that receives incident light from the subject incident without an intervention of an imaging lens or a pinhole and each outputs one detection signal indicating an output pixel value modulated by an incident angle of the incident light, and outputs a detection signal set including a plurality of detection signals output from the plurality of pixel output units. The present disclosure is applicable to, for example, an imaging system that images using a plurality of imaging devices.