Image Frame Registration for Low Light Brightness and Detail

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image quality captured in low light conditions is often degraded due to ambient conditions, leading to dark and detail-lacking images, which existing image processing technologies fail to adequately address.

Innovation Solution

A method involving the receipt and processing of both color and panchromatic image frames, where registration information is computed based on panchromatic image frames to modify corresponding color image frames, enhancing image intensity and detail by aligning and averaging pixel values across frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If image frames are captured in low light ambient conditions, then image capture is possible, but image quality is significantly degraded with dark appearance and lack of details

Engineering Contradiction:
Improveimage brightnessVSAvoidimage detail quality
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent combines multiple panchromatic image frames with corresponding color image frames to create a composite image. The panchromatic frames are registered and averaged to produce a high-quality luminance image, which is then merged with the color image frame using a transformation matrix. This merging process allows the final image to benefit from both the brightness enhancement of multiple panchromatic frames and the color information from the color frame, resolving the contradiction between image brightness and detail quality in low light conditions.

Inventive Principle:
Principle #5Merging (Combining)

2Manufacturing precision

If multiple image frames are processed to improve quality, then image brightness and detail are enhanced, but processing complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing task into distinct modules: (1) computing transformation matrices between panchromatic frames using feature detection and matching, (2) registering and averaging the panchromatic frames to create a composite luminance image, and (3) merging the composite image with the color image frame using the transformation matrix. This segmentation allows each module to be optimized independently and facilitates parallel processing, reducing overall processing complexity while maintaining high image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary registration and averaging of panchromatic frames before merging with the color image frame. By pre-computing the composite luminance image from multiple panchromatic frames, the system reduces the computational burden during the final merging step. The transformation matrix is also pre-computed based on the registered panchromatic frames, allowing for efficient application during the merge operation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9202288B2Method, apparatus and computer program product for processing of image frames
Publication Date: 2015.12.01 NOKIA TECHNOLOGIES OY
  • US9202288B2 patent drawing
  • US9202288B2 patent drawing
  • US9202288B2 patent drawing

AI summary

In accordance with an example embodiment a method, apparatus and computer program product are provided. The method comprises receiving color image frames and panchromatic image frames associated with a scene. The color image frames correspond to the panchromatic image frames. The method further comprises computing registration information based on a panchromatic image frame and one or more panchromatic image frames from among the panchromatic image frames. A color image frame corresponding to the panchromatic image frame is modified based on the registration information.