Image Sensor Line Integration Time Control for Dynamic Range

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital image capture devices have limited dynamic range, leading to incomplete representation of natural scenes, with dark areas appearing uniform and light areas becoming saturated, making it difficult to recognize objects, especially when noise or artifact pixels are present.

Innovation Solution

The method involves individually adjusting the integration time for each line of a sensor unit and applying interpolation filtering based on the correlation between lines to enhance the dynamic range, using characteristics such as noise level and movement blurring to determine optimal integration times and filter coefficients.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional histogram stretching is used to improve brightness contrast, then the dynamic range is adjusted, but the result is not desirable when noise or artifact pixels are present because the adjustment is controlled by noise rather than actual brightness

Engineering Contradiction:
Improvebrightness contrastVSAvoiddynamic range adjustment accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces an intermediary process between light collection and image formation: different integration times for different lines act as a mediator to separately capture dark and light area information. This intermediary approach allows the system to obtain both dark and light area characteristics without direct conflict, avoiding the noise sensitivity of conventional histogram stretching.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the sensor into multiple lines with different integration times. Odd lines use one integration time while even lines use another, allowing separate optimization for dark and light areas. This segmentation enables independent control of exposure parameters for different brightness regions, improving both brightness contrast and adjustment accuracy.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If a single integration time is used for the entire image, then the device structure is simple, but the dynamic range is limited and cannot represent both dark and light areas with sufficient detail

Engineering Contradiction:
Improvedynamic rangeVSAvoidintegration time control
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making integration times variable across different lines rather than uniform. The integration time becomes a dynamic parameter that changes based on line position, allowing the system to adapt to varying brightness requirements across the image while maintaining a relatively simple sensor structure.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Different lines of the sensor are assigned different integration times based on their local brightness requirements. This local quality approach allows optimization of exposure for both dark and light areas simultaneously, expanding the overall dynamic range without requiring complex per-pixel control mechanisms.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If interpolation filtering is applied to combine lines with different integration times, then image detail is improved, but the processing complexity increases

Engineering Contradiction:
Improveimage detailVSAvoidimage processing
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex optical or mechanical systems with computational image processing. Instead of using complex hardware to capture full dynamic range information, the system uses relatively simple interpolation filtering algorithms to combine data from lines with different integration times, achieving high image detail through software rather than hardware complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves image detail and reduces noise and blurring, effectively expanding the dynamic range to represent both dark and light areas with more tonal variations, preventing saturation and enhancing overall image quality.

Implementation Method 1

a sensor unit which has a plurality of lines and individually integrates, for a period of an integration time which is differently set for each line, light which is incident on each line for a period of time

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS8456555B2Method and apparatus for improving dynamic range of image
Publication Date: 2013.06.04 SAMSUNG ELECTRONICS CO LTD
  • US8456555B2 patent drawing
  • US8456555B2 patent drawing
  • US8456555B2 patent drawing

AI summary

Provided are a method and apparatus for improving a dynamic range of an image. The method of improving a dynamic range of an image, which is obtained by a sensor unit of an image capture device, includes: creating an input image by using the sensor unit which has a plurality of lines and has different integration times for the individual lines; and creating an interpolated image by performing interpolation filtering on the input image by using neighboring lines of a current line which have different integration times.