Solid-State Imaging Device with Infrared and Visible Pixels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging apparatuses have limitations in accurately measuring distance and detecting subjects, particularly in varying environmental conditions and on road surfaces.

Innovation Solution

An imaging apparatus equipped with a solid-state imaging device that uses both infrared and visible light pixels, where the computator computes subject information by combining data from different imaging regions, employing a TOF distance measuring principle and pattern recognition for enhanced accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a solid-state imaging device uses only visible light pixels for imaging, then the device structure is simpler and cost is lower, but the accuracy of distance measurement and subject detection deteriorates

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoidimaging device structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines visible light pixels and infrared light pixels into a single solid-state imaging device. The visible light pixels capture reflectance information for subject detection, while the infrared light pixels capture distance information through time-of-flight measurement. This merging of two imaging functions into one device resolves the contradiction by achieving high measurement precision without requiring separate imaging systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The solid-state imaging device is designed to perform multiple functions simultaneously: subject detection using visible light and distance measurement using infrared light. This multi-functionality allows a single device to replace what would traditionally require separate systems, improving measurement precision while controlling device complexity through integrated design.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If separate imaging devices are used for visible light imaging and infrared imaging, then each device can be optimized for its specific function, but the overall system complexity increases and coordination becomes difficult

Engineering Contradiction:
Improvesubject detection accuracyVSAvoidsystem structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges visible light imaging and infrared imaging capabilities into a single solid-state imaging device with pixel arrays that can operate in different modes. This integration eliminates the need for separate imaging devices and their associated coordination systems, reducing overall system complexity while maintaining the functional advantages of both visible light and infrared imaging.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If the solid-state imaging device captures both visible light and infrared light information, then distance measurement and subject detection accuracy improve, but the data processing complexity increases

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoiddata processing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The solid-state imaging device segments the pixel array into different regions or modes that can independently process visible light and infrared light information. By segmenting the imaging function at the pixel level, the device can capture both types of information simultaneously while enabling independent processing streams, which reduces the complexity of data processing by avoiding the need to process all data through a single complex pipeline.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration significantly improves the accuracy of distance measurement and subject detection, even in challenging environments, by effectively utilizing both infrared and visible light data to estimate distances and road surface conditions.

Implementation Method 1

a light source that emits illumination light which is infrared light

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

reflected light that is the illumination light reflected off the subject

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 3

a solid-state imaging device that images a subject and outputs an imaging signal indicating a light exposure amount

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS11200688B2Imaging apparatus and solid-state imaging device used therein
Publication Date: 2021.12.14 NUVOTON TECH CORP JAPAN
  • US11200688B2 patent drawing
  • US11200688B2 patent drawing
  • US11200688B2 patent drawing

AI summary

An imaging apparatus that is mounted on a vehicle that runs on a road surface includes: a light source that emits illumination light which is infrared light; a solid-state imaging device that images a subject and outputs an imaging signal indicating a light exposure amount; and a computator that computes subject information regarding the subject by using the imaging signal. The solid-state imaging device includes: first pixels that image the subject by receiving reflected light that is the illumination light reflected off the subject; and second pixels that image the subject by receiving visible light. Information indicated by an imaging signal outputted from the first pixels is information regarding a slope of the road surface, and information indicated by an imaging signal outputted from the second pixels is information regarding an appearance of the road surface.