Video Illumination Enhancement via Neural Network Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies are inefficient as they rely on a single neural network for illumination improvement, limiting the effectiveness in enhancing diverse image types and causing inconvenience in real-time video playback due to prolonged processing times.
Innovation Solution
Classifying images based on illumination and selecting appropriate neural networks for enhancement, allowing for efficient processing of low illumination frames in real-time video, thereby reducing overall image illumination processing time and improving video quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single neural network is used for illumination improvement processing, then the device complexity is reduced, but the image processing efficiency and quality for diverse image types deteriorates
Solution Approach 1:
The patent segments the image processing task by dividing images into different illumination categories (low illumination, ultra-low illumination, normal illumination) and applying different neural network models to each category. This segmentation allows each neural network to be specialized for specific image types, improving processing efficiency and quality while maintaining manageable system complexity through modular architecture.
2Ease of operation
If a single neural network is used for all images, then the ease of operation is improved, but the adaptability to different illumination conditions deteriorates
Solution Approach 1:
The patent implements a dynamic selection mechanism that automatically chooses the appropriate neural network model based on the illumination characteristics of each input image. The system dynamically categorizes images into different illumination groups and selects the corresponding specialized neural network, providing adaptability to various illumination conditions while maintaining ease of operation through automated classification and selection processes.
3Reliability
If illumination enhancement is applied to all video frames, then the overall video quality is improved, but the processing time and energy consumption increases
Solution Approach 1:
The patent applies partial action by selectively enhancing only those video frames that require illumination improvement. The system classifies each frame according to its illumination characteristics and applies neural network enhancement only to low illumination and ultra-low illumination frames, while normal illumination frames are processed more simply or skipped. This approach maintains overall video quality while significantly reducing processing time and energy consumption compared to enhancing all frames.
Data Source
AI summary
A method for improving image illumination of the present disclosure includes receiving images of original video data, classifying and arranging the images according to illumination for image enhancement processing of the original video data images, and generating high illumination images for an image region by processing the images using a neural network for image enhancement that is selected according to the illumination attribute of the classified images from among groups of neural networks for image enhancement, so as to reproduce a video having enhanced illumination. The neural network for image enhancement according to an embodiment of the present disclosure may be a deep neural network generated through machine learning, and input and output of images is performed in an Internet of Things (IoT) environment using a 5G network.


