Imaging Device Pixel Array for Simultaneous Infrared and Visible Light Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging devices configured with a Bayer array cannot simultaneously capture infrared light and visible light images without parallax, limiting their ability to perform sensing and display tasks effectively.

Innovation Solution

An imaging device with a pixel array configuration where each 2x2 matrix includes a mix of pixels receiving red, blue, and green light, along with infrared light, allowing for diagonal arrangement of pixel groups to facilitate simultaneous infrared and visible light image capture, using a combination of color filters and on-chip lenses for enhanced light collection and phase difference detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a Bayer array configuration is used to divide one pixel into multiple pixels, then high-resolution imaging and high dynamic range imaging are improved, but the ability to simultaneously capture infrared and visible light images without parallax deteriorates

Engineering Contradiction:
Improveimaging resolutionVSAvoidmulti-wavelength imaging capability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The pixel array is segmented into distinct functional regions: visible light pixel regions (first through fourth pixel groups with color filters) and infrared light pixel regions (fifth and sixth pixel groups with infrared transmission filters). This segmentation allows each region to be optimized for its specific wavelength range while maintaining overall system integration in a single imaging device

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The imaging device achieves multi-functionality by integrating both visible light imaging and infrared light imaging capabilities within a single Bayer array structure. The pixel array simultaneously performs color imaging in the visible range and thermal/sensing imaging in the infrared range, eliminating the need for separate imaging devices and ensuring aligned optical paths without parallax

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If separate imaging devices are used for infrared and visible light imaging, then sensing and viewing functions are specialized, but parallax between the two images occurs

Engineering Contradiction:
Improvesensing accuracyVSAvoidspatial alignment accuracy
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent merges infrared and visible light imaging functions into a single integrated imaging device with a unified optical path and shared lens system. Both types of pixels are arranged in the same pixel array and receive light from the same optical path, ensuring that infrared and visible light images are captured from identical spatial perspectives without parallax, thereby maintaining accurate spatial alignment for sensing applications

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If one pixel in Bayer array is divided into multiple pixels, then signal-to-noise ratio is improved by adding pixels of the same color, but infrared light detection capability is lost

Engineering Contradiction:
Improvesignal-to-noise ratioVSAvoidinfrared detection capability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

Different regions of the pixel array are assigned different functional qualities: the first through fourth pixel groups are optimized for visible light detection with appropriate color filters to achieve high signal-to-noise ratio through pixel grouping, while the fifth and sixth pixel groups are optimized for infrared detection with infrared transmission filters. This local differentiation allows each region to excel at its specific function while the overall array maintains both capabilities

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the acquisition of high-resolution, high dynamic range images with improved signal-to-noise ratio and reduced parallax, enabling simultaneous sensing and viewing applications in a monocular configuration.

Implementation Method 1

a pixel array part in which a plurality of pixel groups each including four pixels arranged in a matrix of 2×2 is arrayed

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11743604B2Imaging device and image processing system
Publication Date: 2023.08.29 SONY SEMICON SOLUTIONS CORP
  • US11743604B2 patent drawing
  • US11743604B2 patent drawing
  • US11743604B2 patent drawing

AI summary

An imaging device includes: a pixel array part in which a plurality of pixel groups each including four pixels arranged in a matrix of 2×2 is arrayed. As a pixel group including four pixels, there are formed a first pixel group that includes three pixels that receive red light and one pixel that receives infrared light, a second pixel group that includes three pixels that receive blue light and one pixel that receives infrared light, a third pixel group that includes three pixels that receive green light and one pixel that receives infrared light, and a fourth pixel group that includes three pixels that receive green light and one pixel that receives infrared light. Four pixel groups including the first pixel group, the second pixel group, the third pixel group, and the fourth pixel group are arranged to form a set of 2×2 units in which the first pixel group and the second pixel group are diagonally positioned, and the third pixel group and the fourth pixel group are diagonally positioned.