Dual Image Sensor Pixel Segmentation for Simultaneous Distance and Shape Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image capturing apparatuses face challenges in simultaneously obtaining image signals and distance signals from the same pixel, which is crucial for accurately associating object shape with distance, especially in applications like vehicle-mounted cameras.

Innovation Solution

The apparatus employs a dual-image sensor system with specific driving units that transfer and hold signals generated in photoelectric conversion elements during light irradiation and reflected light periods, allowing for the simultaneous readout of image and distance signals from the same pixel.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single image sensor is used to capture both image signals and distance signals, then the device complexity is reduced, but the measurement precision deteriorates due to inability to simultaneously obtain both signal types from the same pixel

Engineering Contradiction:
Improvenumber of image sensorsVSAvoidassociation accuracy between object shape and distance
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The single image sensor is divided into multiple pixels, with each pixel further segmented into multiple photoelectric conversion elements. This segmentation allows each pixel to independently capture both image signals and distance signals simultaneously, resolving the contradiction between device complexity and measurement precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each pixel is designed with multi-functionality by incorporating multiple photoelectric conversion elements that can simultaneously perform different functions: capturing reflected light for distance measurement and capturing emitted light for image formation. This universal design eliminates the need for separate sensors while maintaining measurement precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple photoelectric conversion elements are used in each pixel to simultaneously capture image and distance signals, then the measurement precision improves, but the device complexity increases

Engineering Contradiction:
Improvesimultaneous detection accuracy of image and distance signalsVSAvoidstructure of photoelectric conversion elements per pixel
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Multiple photoelectric conversion elements within each pixel are merged through a common signal processing path. The signals from multiple photoelectric conversion elements are combined and processed together, which maintains measurement precision while reducing the complexity of individual element structures and their interconnections.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If the same pixel is used to read out both image signals and distance signals, then the loss of information is reduced, but the productivity deteriorates due to sequential readout requirements

Engineering Contradiction:
Improveassociation between object shape and distanceVSAvoidsignal readout speed
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The signal readout process uses periodic action by alternately selecting different photoelectric conversion elements within each pixel for signal output. This periodic switching allows multiple signals to be read out in sequence from the same pixel without information loss, while the periodic nature maintains efficient readout speed through structured time-multiplexed access.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables accurate and simultaneous detection of object shape and distance, improving detection accuracy and enabling real-time monitoring of moving objects, such as in advanced driver assistance systems.

Implementation Method 1

each of the plurality of pixels includes a photoelectric conversion element

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10382714B2Image capturing apparatus and moving object
Publication Date: 2019.08.13 CANON KK
  • US10382714B2 patent drawing
  • US10382714B2 patent drawing
  • US10382714B2 patent drawing

AI summary

An image capturing apparatus that includes a first and second image sensors each including pixel array and a driving unit, the driving units perform first driving, in a first period, such that a signal based on a light from non-irradiated object is held in a first signal holding unit of each of the first and second image sensors, second driving, in a second period, such that a signal based on a light from irradiated object is held in a second signal holding unit of the first image sensor, and third driving, in a third period, such that a signal based on a light from irradiated object is held in a second signal holding unit of the second image sensor, the third period including a period which does not overlap the second period.