Binned HDR Imaging System Reducing Processing Power

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional high-dynamic-range (HDR) imaging systems require excessive processing resources and power to continuously output high-definition video data, particularly when using interleaved exposure methods, which can lead to motion artifacts and inefficient power consumption.

Innovation Solution

The implementation of a binned HDR imaging system that processes interleaved exposure images by grouping pixel values into bins, performing linear combinations of short-exposure and long-exposure pixel values, and generating weighted pixel values to produce a binned HDR image, which reduces processing requirements and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional interleaved exposure HDR imaging systems are used to continuously output high definition video data, then highlight and shadow detail are retained, but excessive processing resources and power are consumed

Engineering Contradiction:
Improvehighlight and shadow detailVSAvoidprocessing power consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the high-definition pixel array into multiple bins, each corresponding to a lower resolution. By processing only representative pixel values from each bin rather than all pixels, the system retains HDR detail capabilities while significantly reducing processing power consumption and resource usage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary pixel values needed for HDR processing by selecting representative pixels from each bin, rather than processing all pixel data. This extraction approach maintains the ability to capture highlight and shadow detail while eliminating redundant processing operations.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If conventional interleaved exposure HDR imaging systems are used to continuously output high definition video data, then high dynamic range is achieved, but device complexity increases

Engineering Contradiction:
Improvehigh dynamic range capabilityVSAvoidprocessing circuitry complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the complex high-definition pixel processing into simpler bin-based segments. Each bin processes a subset of pixels at lower resolution, which maintains HDR reliability while reducing the overall complexity of the processing circuitry required.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses simplified processing models that work on reduced-resolution bin data rather than full HD data. This approach achieves HDR functionality with less complex, more energy-efficient processing circuitry that can be implemented with fewer resources.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Measurement precision

If full high definition pixel data is processed for HDR video output, then image quality is maintained, but processing time increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the full HD image into multiple bins and processes only representative pixels from each bin. This segmentation approach maintains sufficient image quality for HDR video while dramatically reducing the time required for processing compared to handling all pixels at full resolution.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial processing by selecting and processing only the necessary representative pixel values from each bin rather than all pixels. This partial action approach maintains adequate image quality for HDR output while reducing processing time through selective processing.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9438827B2Imaging systems and methods for generating binned high-dynamic-range images
Publication Date: 2016.09.06 SEMICON COMPONENTS IND LLC
  • US9438827B2 patent drawing
  • US9438827B2 patent drawing
  • US9438827B2 patent drawing

AI summary

Electronic devices may include image sensors that capture interleaved images having rows of long-exposure pixel values interleaved with rows of short-exposure pixel values. Processing circuitry in the electronic device may (spatially) partition the interleaved images into multiple bins. The processing circuitry may generate a weighted long-exposure pixel value for each bin and a weighted short-exposure pixel value for each bin. The weighted long and short exposure values in each bin may be combined to generate a binned high-dynamic-range (HDR) pixel value for that bin. The processing circuitry may output a binned HDR image formed from the binned HDR pixel values to additional circuitry such as video processing circuitry for performing additional image processing operations. If desired, the image sensor and processing circuitry may be combined into an integrated structure that generates a single binned HDR pixel value and multiple integrated structures may be used.