Low-illumination image enhancement method based on saliency foreground content

An image enhancement, low-light technology, applied in the field of image processing, can solve the problems of excessive image enhancement, amplifying noise, affecting the subjective evaluation of images, etc., to achieve the effect of suppressing excessive enhancement and noise amplification, and avoiding noise amplification

Active Publication Date: 2020-06-12
XI AN JIAOTONG UNIV
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Although the existing image enhancement methods have achieved satisfactory results for some low-light datasets, they often expose the image over-enhancement and Amplify issues such as random noise
Specifically, whether it is contrast enhancement or Retinex model enhancement, these methods uniformly enhance all areas of the entire image, so that the dark sky, ground or wall that people do not pay attention to will often be over-represented. is more likely to cause overexposure enhancement in areas such as street lights and car lights
On the other hand, due to the overall enhancement, the random noise previously hidden in the dark is exposed, which will not only destroy the important structural information inside the image, but also seriously affect the subjective evaluation of the image.
[0004] The main reason for the above problems is that the existing low-light image enhancement methods often ignore the salient content and foreground and background content in the image during the enhancement process, and only directly enhance the entire image, which will lead to excessive enhancement and enlargement. Noise etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Low-illumination image enhancement method based on saliency foreground content
  • Low-illumination image enhancement method based on saliency foreground content
  • Low-illumination image enhancement method based on saliency foreground content

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The invention provides a low-light image enhancement method based on saliency foreground content. First, the low-light image is input into a low-light saliency attention deep network model SAM (Saliency Attention Model), and an output saliency map is obtained. Next, input the low-light image to the depth prediction network model monodepth2 and output the corresponding depth map. The depth map is used as a guide map to perform guided filtering on the saliency map to obtain a salient foreground map. Finally, for the input low-light image, the LIME enhancement algorithm is used to enhance the low-light image to different degrees with the salient foreground image as the weight of the degree of enhancement, and finally the result map based on the salient foreground content enhancement is obtained.

[0041] see figure 1 , a low-light image enhancement method based on salient foreground content of the present invention, the specific steps are as follows:

[0042] S1. Low-lig...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a low-illumination image enhancement method based on saliency foreground content, and the method comprises the steps: learning saliency foreground content information in a low-illumination image, carrying out the fusion of the saliency foreground content information and an enhancement process, and inputting the low-illumination image into a low-illumination saliency attention depth network model SAM to obtain an output saliency map; inputting a low-illumination image to the depth prediction network model and outputting a corresponding depth map; performing guided filtering on the saliency map by taking the obtained depth map as a guided map to obtain a saliency foreground map; for an input low-illumination image, the significant foreground image is used as the weight of the enhancement degree, an LIME enhancement algorithm is adopted to enhance the low-illumination image to different degrees, and finally a result image based on significant foreground content enhancement is obtained. According to the method, the significant foreground content area in the low-illumination image can be effectively enhanced, meanwhile, excessive enhancement of the background andirrelevant content areas is inhibited, and noise is inhibited.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a low-light image enhancement method based on salient foreground content. Background technique [0002] With the development and update of image sensor equipment and technology, people can obtain high-quality images more conveniently. However, in low-light environments, image sensors will suffer from low contrast, random noise, and color distortion due to insufficient light. These problems often hinder the development of subsequent computer vision and image processing tasks such as object recognition, detection and tracking. In order to solve the above-mentioned problems of low-light images, people have proposed many low-light enhancement methods, which can be divided into three categories according to the theories and models based on them: the first category is based on contrast enhancement methods such as grayscale histograms Image equalization and adaptiv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06T5/50
CPCG06T5/50G06T2207/10004G06T2207/10028G06T2207/20081G06T2207/20084G06T5/90G06T5/70
Inventor 杨勐郝鹏程王爽郑南宁
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products