Image Pickup Apparatus with Dual-Sensitivity Pixels

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image pickup devices with color filters arranged in patterns like the Bayer pattern face challenges in capturing high-quality images under low luminance conditions due to imbalances in sensitivity among light-receiving devices, leading to poor signal-to-noise ratios and errors in image processing, especially when capturing moving subjects.

Innovation Solution

An image pickup apparatus with high-sensitivity and low-sensitivity pixel devices arranged in an array, where exposure periods are independently controlled to optimize light reception, and an image generation unit performs comparison processing between evaluation images from both types of devices to discriminate pixel regions and apply appropriate image processing techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If color filters are arranged in a Bayer pattern to enable color image capture, then color information can be obtained, but sensitivity imbalance occurs among light-receiving devices leading to poor signal-to-noise ratio under low luminance conditions

Engineering Contradiction:
Improvecolor image capture capabilityVSAvoidsignal-to-noise ratio
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The image pickup device is segmented into multiple types of light-receiving devices (first light-receiving devices and second light-receiving devices) with different sensitivity characteristics. Each type is assigned to specific pixel regions, allowing optimized performance for different imaging conditions while maintaining overall system reliability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different pixel regions are assigned different types of light-receiving devices based on local requirements. The first light-receiving devices are placed in regions requiring high sensitivity, while the second light-receiving devices are placed in regions where color information is prioritized, creating local optimization of quality characteristics.

Inventive Principle:
Principle #3Local quality

2Use of energy by moving object

If exposure period is extended to improve light reception for high-sensitivity pixels, then signal strength increases, but moving subjects become blurred due to motion during extended exposure

Engineering Contradiction:
Improvelight reception efficiencyVSAvoidimage sharpness
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The pixel array is segmented into regions with different exposure characteristics. First light-receiving devices in certain regions use longer exposure periods to maximize light collection, while second light-receiving devices in other regions use shorter exposure periods to freeze motion, allowing both requirements to be satisfied simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts exposure periods based on the specific pixel device type and its location. By making exposure time variable rather than fixed, the system can optimize both light reception and motion freezing for different regions of the image.

Inventive Principle:
Principle #15Dynamics

3Reliability

If independent exposure control is applied to different pixel devices to balance sensitivity, then image quality improves, but device complexity increases due to multiple exposure control mechanisms

Engineering Contradiction:
Improveimage qualityVSAvoidexposure control mechanism
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The exposure control unit is designed with multi-functionality to handle different types of light-receiving devices. Rather than requiring separate dedicated control circuits for each device type, a single universal control unit manages exposure for both first and second light-receiving devices, reducing overall system complexity while maintaining independent control capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the generation of high-quality images by balancing light reception across different pixel devices, reducing errors caused by exposure period differences and improving image quality, especially for moving subjects.

Implementation Method 1

A single-plate color solid-state image pickup device 13 receives via a color filter 12 light incident from an optical lens 11, and photoelectrically converts the received light into an electric signal

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS7839437B2Image pickup apparatus, image processing method, and computer program capable of obtaining high-quality image data by controlling imbalance among sensitivities of light-receiving devices
Publication Date: 2010.11.23 SONY SEMICON SOLUTIONS CORP
  • US7839437B2 patent drawing
  • US7839437B2 patent drawing
  • US7839437B2 patent drawing

AI summary

An image pickup apparatus includes an image pickup device that has high-sensitivity pixel devices receiving a relatively large amount of light and low-sensitivity pixel devices receiving a relatively small amount of light, an exposure control unit independently controlling exposure periods of the high-sensitivity pixel devices and the low-sensitivity pixel devices, and an image generation unit performing image generation on the basis of an output signal of the image pickup device. The image generation unit compares a high-sensitivity pixel evaluation image generated using data output from the high-sensitivity pixel devices with a low-sensitivity pixel evaluation image generated using data output from the low-sensitivity pixel devices by obtaining a difference or ratio between pixel values of corresponding pixels in the two evaluation images, and performs different types of image processing for a region composed of pixels each having a small difference and a region composed of pixels each having a large difference.