Video Illumination Enhancement via Neural Network Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies are inefficient as they rely on a single neural network for illumination improvement, limiting the effectiveness in enhancing diverse image types and causing inconvenience in real-time video playback due to prolonged processing times.

Innovation Solution

Classifying images based on illumination and selecting appropriate neural networks for enhancement, allowing for efficient processing of low illumination frames in real-time video, thereby reducing overall image illumination processing time and improving video quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single neural network is used for illumination improvement processing, then the device complexity is reduced, but the image processing efficiency and quality for diverse image types deteriorates

Engineering Contradiction:
Improveneural network structureVSAvoidimage processing efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent segments the image processing task by dividing images into different illumination categories (low illumination, ultra-low illumination, normal illumination) and applying different neural network models to each category. This segmentation allows each neural network to be specialized for specific image types, improving processing efficiency and quality while maintaining manageable system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If a single neural network is used for all images, then the ease of operation is improved, but the adaptability to different illumination conditions deteriorates

Engineering Contradiction:
Improveprocessing operationVSAvoidillumination condition adaptation
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic selection mechanism that automatically chooses the appropriate neural network model based on the illumination characteristics of each input image. The system dynamically categorizes images into different illumination groups and selects the corresponding specialized neural network, providing adaptability to various illumination conditions while maintaining ease of operation through automated classification and selection processes.

Inventive Principle:
Principle #15Dynamics

3Reliability

If illumination enhancement is applied to all video frames, then the overall video quality is improved, but the processing time and energy consumption increases

Engineering Contradiction:
Improvevideo qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies partial action by selectively enhancing only those video frames that require illumination improvement. The system classifies each frame according to its illumination characteristics and applies neural network enhancement only to low illumination and ultra-low illumination frames, while normal illumination frames are processed more simply or skipped. This approach maintains overall video quality while significantly reducing processing time and energy consumption compared to enhancing all frames.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11321820B2Video data quality improving method and apparatus
Publication Date: 2022.05.03 LG ELECTRONICS INC
  • US11321820B2 patent drawing
  • US11321820B2 patent drawing
  • US11321820B2 patent drawing

AI summary

A method for improving image illumination of the present disclosure includes receiving images of original video data, classifying and arranging the images according to illumination for image enhancement processing of the original video data images, and generating high illumination images for an image region by processing the images using a neural network for image enhancement that is selected according to the illumination attribute of the classified images from among groups of neural networks for image enhancement, so as to reproduce a video having enhanced illumination. The neural network for image enhancement according to an embodiment of the present disclosure may be a deep neural network generated through machine learning, and input and output of images is performed in an Internet of Things (IoT) environment using a 5G network.