Solid-State Image Sensor Segmentation for Range Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-capturing devices struggle to accurately obtain range information of moving objects and maintain a high frame rate due to the need for multiple frames to remove background light influence, leading to errors in range images.

Innovation Solution

An image-capturing device with a solid-state sensor that includes both visible light and infrared pixels on a semiconductor substrate, capable of producing both visible light and range images from which background light has been removed during the same single frame scanning period, using a combination of signals from these pixels to enhance accuracy and frame rate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple frames are used to remove background light influence, then the quality of range image is improved, but the frame rate is reduced and errors occur in moving objects

Engineering Contradiction:
Improverange image qualityVSAvoidframe rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The pixel array is segmented into first pixels for visible light and second pixels for infrared light, allowing simultaneous capture of both types of images within a single frame period, thus achieving high frame rate and accurate range measurement without using multiple frames

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines visible light imaging and infrared imaging functions into a single image-capturing device, merging both pixel types on one semiconductor substrate to capture both image types simultaneously during the same frame scanning period

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If multiple frames are used to obtain range image, then background light influence is removed, but the accuracy of moving object range information deteriorates

Engineering Contradiction:
Improvebackground light removalVSAvoidmoving object range accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The infrared light source emits infrared light periodically during the frame scanning period, allowing the second pixels to capture infrared signals at specific intervals while maintaining continuous visible light capture, thus removing background light influence while accurately tracking moving objects

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent uses feedback by comparing infrared pixel signals obtained with and without infrared pulse illumination to remove background light influence, while the simultaneous visible light image provides reference information to maintain accuracy for moving objects

Inventive Principle:
Principle #23Feedback

3Device complexity

If a single sensor captures both visible light and infrared light, then device complexity is reduced, but the ability to remove background light influence deteriorates

Engineering Contradiction:
Improvesensor integrationVSAvoidbackground light removal capability
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

Different regions of the pixel array have different functional qualities - first pixels are optimized for visible light capture while second pixels are optimized for infrared capture, allowing each pixel type to perform its specialized function within the integrated sensor

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves the accuracy of range information for moving objects and increases the frame rate by allowing simultaneous capture of high-quality visible light and background-light-removed range images within a single frame, eliminating the need for multiple frames.

Implementation Method 1

an infrared light source 103 configured to emit infrared light

Methodology Applied
Scientific EffectInfrared emission: Infrared Radiation

Implementation Method 2

a plurality of first pixels configured to convert visible light into signal charge

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Implementation Method 3

a plurality of second pixels configured to convert infrared light into signal charge

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10687002B2Image-capturing device and drive method therefor
Publication Date: 2020.06.16 PANASONIC SEMICON SOLUTIONS CO LTD
  • US10687002B2 patent drawing
  • US10687002B2 patent drawing
  • US10687002B2 patent drawing

AI summary

An image-capturing device includes an infrared light source configured to emit infrared light, and a solid-state image-capturing device including a plurality of first pixels configured to convert visible light into signal charge and a plurality of second pixels configured to convert infrared light into signal charge, the plurality of first pixels and the plurality of second pixels being arranged on a semiconductor substrate in a matrix. The solid-state image-capturing device outputs, during the same single frame scanning period, a first signal obtained from the plurality of first pixels, a second signal obtained from the plurality of second pixels during a period of time when the infrared light is emitted, and a third signal obtained from the plurality of second pixels during a period of time when the infrared light is not emitted.