Convolutional Neural Network for High Dynamic Range Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing technologies fail to effectively enhance the dynamic range of images, particularly in regions with over- or under-exposure, leading to loss of details and poor visual quality due to insufficient lighting conditions.

Innovation Solution

A system and method utilizing a convolution neural network with exposure-induced network architecture, which includes exposure gated detail recovering branches and a dynamic range expansion branch to adjust exposure levels and recover missing details, generating high dynamic range images from standard dynamic range inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If conventional image processing technologies are used, then the processing speed and simplicity are maintained, but the dynamic range enhancement capability and detail recovery in over/under-exposed regions are insufficient

Engineering Contradiction:
Improvedynamic rangeVSAvoidprocessing system complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent divides the image processing task into multiple specialized branches: a first branch processes over-exposed regions to recover details, a second branch processes under-exposed regions to enhance visibility, and a third branch handles normally exposed regions. This segmentation allows each branch to be optimized for its specific exposure condition, improving overall dynamic range enhancement capability while managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing strategies to different regions of the image based on their exposure characteristics. Over-exposed regions receive one type of processing (detail recovery), under-exposed regions receive another (enhancement), and normally exposed regions receive a third type of processing. This local quality approach ensures that each region is processed appropriately for its specific conditions, maximizing detail recovery across the entire image.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If conventional image processing is applied, then the processing time and computational resources are conserved, but the visual quality and detail preservation in extreme exposure regions deteriorate

Engineering Contradiction:
Improvedetail recovery qualityVSAvoiddetail loss in over/under-exposed regions
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The patent applies preliminary processing steps to identify and isolate over-exposed and under-exposed regions before applying the main enhancement algorithms. By pre-segmenting the image into different exposure zones and preparing appropriate processing paths for each, the system recovers details more effectively while minimizing information loss in extreme exposure regions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces intermediate processing stages that act as mediators between the input image and final output. These intermediate steps include generating confidence maps, creating processed versions of over/under-exposed regions, and blending results from multiple branches. These intermediaries enable gradual refinement and preserve details that would otherwise be lost in extreme exposure conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If advanced neural network processing is implemented, then the detail recovery and dynamic range expansion are improved, but the computational complexity and processing time increase

Engineering Contradiction:
Improvevisual quality consistencyVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements a dynamic processing system that adapts its computational resources based on the input image characteristics. The neural network dynamically determines which regions require intensive processing (over/under-exposed areas) and which can be processed more simply (normally exposed areas). This dynamic approach maintains high visual quality consistency while optimizing processing efficiency by avoiding unnecessary computational overhead in regions that don't need intensive enhancement.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12069379B2System and a method for processing an image
Publication Date: 2024.08.20 CENT FOR INTELLIGENT MULTIDIMENSIONAL DATA ANALYSIS LTD
  • US12069379B2 patent drawing
  • US12069379B2 patent drawing
  • US12069379B2 patent drawing

AI summary

A system and a method for processing an image. The system comprises an image gateway arranged to receive an input image showing a scene composed by a combination of a plurality of image portions of the input image, wherein one or more of the plurality of image portions is associated with an exposure level deviated from an optimal exposure level; and an enhancement engine arranged to process the input image by applying an exposure/image relationship to the input image, wherein the exposure/image relationship is arranged to adjust the exposure level of each of the plurality of image portions towards the optimal exposure level; and to generate an enhanced image showing a visual representation of the scene composed by a combination of the plurality of image portions of the input image with an adjusted exposure level.