Tilted Imaging Sensor with Offset Pixel Lines for Multi-Depth Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging sensors, especially 2D CMOS sensors, face challenges with low light sensitivity and slow ROI read-out due to non-photosensitive parts reducing the fill factor, and microlenses are not suitable when the sensor is tilted, leading to oversampling and distortion in digital pathology and 3D imaging.

Innovation Solution

The method involves using an imaging device with a tilted sensor having offset pixel lines, allowing simultaneous capture of images from multiple depths by activating only necessary pixel lines and using non-photosensitive gaps for read-out electronics, maximizing the fill factor and avoiding microlenses, enabling seamless 2D or 3D image acquisition without gaps or repetitions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If microlenses are used to focus light onto pixels, then light sensitivity is improved, but the sensor cannot be tilted with respect to the optical path

Engineering Contradiction:
Improvelight sensitivityVSAvoidsensor tilting capability
Core Design Contradiction:
Illumination intensityVSAdaptability or versatility

Solution Approach 1:

The patent removes microlenses from the pixel structure entirely, extracting the light-focusing function to the optical path itself through tilting the sensor array. This allows the sensor to be tilted relative to the optical axis to achieve depth discrimination without requiring microlenses, thus resolving the contradiction between light sensitivity and tilting capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a spatial dimension by tilting the sensor array relative to the optical axis, creating different optical path lengths for different pixel lines. This dimensional change enables depth discrimination and maintains light sensitivity without microlenses, as the tilting itself provides the necessary optical path differentiation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If a 2D array sensor is used for imaging, then image capture capability is improved, but stitching problems and mechanical scanning complexity increase

Engineering Contradiction:
Improveimage capture capabilityVSAvoidstitching and scanning complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the 2D sensor array into multiple 1D line sensors oriented perpendicular to the scan direction. Each line sensor captures image data independently without requiring stitching, thereby maintaining the image capture capability of 2D arrays while eliminating the stitching complexity and mechanical scanning issues.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If pixel lines are offset along the scan direction, then simultaneous multi-depth capture is enabled, but the fill factor of individual pixels is reduced

Engineering Contradiction:
Improvemulti-depth capture capabilityVSAvoidpixel fill factor
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent offsets pixel lines in the direction perpendicular to the scan direction rather than along the scan direction. This dimensional reorientation allows simultaneous capture of multiple depths while maintaining full pixel fill factors, as the offset does not sacrifice photoactive area but instead utilizes the spatial arrangement to achieve depth discrimination through different optical path lengths.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances light sensitivity and read-out speed, allowing for efficient and distortion-free image capture of non-flat and volumetric samples, particularly in digital pathology, by maximizing the photoactive area and utilizing gaps for circuitry, thus overcoming limitations of conventional sensors.

Implementation Method 1

The imaging sensor that is used in the presented method has a first pixel line comprising a plurality of pixels and a second pixel line comprising a plurality of pixels

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10082663B2Method for simultaneous capture of image data at multiple depths of a sample
Publication Date: 2018.09.25 KONINKLIJKE PHILIPS NV
  • US10082663B2 patent drawing
  • US10082663B2 patent drawing
  • US10082663B2 patent drawing

AI summary

A novel method is disclosed to allow for the simultaneous capture of image data from multiple depths of a volumetric sample. The method allows for the seamless acquisition of a 2D or 3D image, while changing on the fly the acquisition depth in the sample. This method can also be used for auto focusing. Additionally this method of capturing image data from the sample allows for optimal efficiency in terms of speed, and light sensitivity, especially for the herein mentioned purpose of 2D or 3D imaging of samples when using a tilted configuration as depicted in FIG. 2. The method may be particularly used with an imaging sensor comprising a 2D array of pixels in an orthogonal XY coordinate system where gaps for electronic circuitry are present. Also other imaging sensor may be used. Further, an imaging device is presented which automatically carries out the method.