Imaging Pixel Exposure Control for Night Color Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional surveillance cameras cannot generate color images in night mode without decreasing the frame rate, as they rely on alternating between infrared and visible light images.

Innovation Solution

An imaging apparatus with a control unit that manages the exposure periods of different pixel types and infrared light emission, allowing for simultaneous exposure and emission within a single frame period, enabling the generation of color images using infrared light without reducing frame rate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If infrared light is emitted and visible light imaging is alternately performed frame-by-frame to generate color images, then color information can be obtained in night mode, but the frame rate decreases to 1/2

Engineering Contradiction:
Improvecolor informationVSAvoidframe rate
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The imaging element is divided into two types of pixels: first pixels (e.g., white pixels) that receive both visible light and infrared light, and second pixels (e.g., color pixels) that receive only visible light. This segmentation allows simultaneous capture of luminance information (from first pixels) and color information (from second pixels) within a single frame period, eliminating the need for alternating frames and restoring the original frame rate while obtaining color images in night mode.

Inventive Principle:
Principle #1Segmentation

2Productivity

If a single exposure period is provided for both first pixel and second pixel within each frame period, then color images can be obtained without decreasing frame rate, but the exposure period for each pixel type is reduced

Engineering Contradiction:
Improveframe rateVSAvoidexposure period
Core Design Contradiction:
ProductivityVSDuration of action of moving object

Solution Approach 1:

Different exposure periods are assigned to different pixel types based on their specific functions. First pixels (white pixels) that detect infrared light are given a longer exposure period to ensure sufficient infrared light accumulation, while second pixels (color pixels) have a shorter exposure period appropriate for visible light detection. This local differentiation of exposure duration allows both pixel types to function optimally within a single frame period, maintaining high frame rate while ensuring adequate exposure for each pixel type.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the exposure period of the first pixel is extended to capture sufficient infrared light, then infrared detection precision improves, but the frame rate decreases

Engineering Contradiction:
Improveinfrared detection precisionVSAvoidframe rate
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The imaging element is divided into first pixels for infrared detection and second pixels for color detection. By segmenting the pixel functions, the first pixels can have extended exposure periods dedicated to infrared light accumulation without affecting the overall frame rate, since second pixels simultaneously capture visible light during their shorter exposure periods. This segmentation allows high-precision infrared detection and high frame rate operation to coexist.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the capture of color images using infrared light without decreasing the frame rate, improving image quality in low-light conditions while maintaining high frame rates.

Implementation Method 1

an imaging element including a first pixel and a second pixel

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Implementation Method 2

an emission period of infrared light from an infrared light emission unit

Methodology Applied
Scientific EffectInfrared light emission: Infrared Radiation

Data Source

PatentUS10560670B2Imaging apparatus and imaging control method
Publication Date: 2020.02.11 SONY SEMICON SOLUTIONS CORP
  • US10560670B2 patent drawing
  • US10560670B2 patent drawing
  • US10560670B2 patent drawing

AI summary

The present technology relates to an imaging apparatus, an imaging control method, and a program capable of obtaining a color image using infrared light without decreasing the frame rate. The imaging apparatus includes an imaging element including a first pixel and a second pixel, and a control unit that controls an exposure period of the imaging element and an emission period of the infrared light from the infrared light emission unit. The control unit controls to provide an exposure period of the first pixel and the second pixel in each of frame periods and provide a single exposure period being a period in which the first pixel alone is exposed, and controls so as to emit the infrared light within the single exposure period. The present technology is applicable to a surveillance camera, for example.