Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Night image defogging algorithm based on deep learning

A deep learning and imaging technology, applied in neural learning methods, computing, image enhancement, etc., can solve problems such as difficult foggy image restoration

Pending Publication Date: 2022-07-19
NORTHWEST UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These two methods have better defogging effects on images in daytime environments. Since the sky and atmospheric light are no longer the only source of light energy in the scene in the night imaging environment, a large number of artificial light sources participate in imaging with different scattering paths. Fog technology methods are difficult to directly apply to the restoration of foggy images in night environments

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Night image defogging algorithm based on deep learning
  • Night image defogging algorithm based on deep learning
  • Night image defogging algorithm based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0031] A deep learning-based night image dehazing algorithm provided by an embodiment of the present invention includes the following steps:

[0032] Step 1: collect clear image data without fog at night, then perform scene depth ratio estimation on the image data, and perform fog processing on the clear image without fog at night based on the depth ratio map to establish a night "fog-free fog" image data set;

[0033] Step 2: First design the encoder part of the overall network. The foggy image at night is subjected to three dual-tree complex wavelet transform groups in the encoder to iteratively extract multi-sca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a night image defogging algorithm based on deep learning. The end-to-end network structure is more suitable for engineering practicability. The characteristics of non-uniform illumination, serious color cast, low brightness and the like of night images exist, a traditional defogging algorithm based on an atmospheric scattering model is not applicable, the method focuses on the powerful nonlinear fitting capability of deep learning, a U-Net network is combined with dual-tree complex wavelet transform, and the defogging efficiency is improved. More residual structures are fused into a network model to extract the structure and texture information of a night foggy image, and an attention module is introduced into the network to effectively quantify the relative importance between feature layers. Through a self-constructed foggy-fogless night data set, an error is calculated according to a global-local loss function, network weight is adjusted based on error back propagation, and a completely trained night image defogging network model is finally obtained through multiple iteration training. The method provided by the invention can restrain the mesh artifact problem caused by frequent up-sampling and down-sampling in the defogging task.

Description

[0001] The invention belongs to the field of digital image processing, in particular to a night image dehazing algorithm based on deep learning. Background technique [0002] With the increase of haze weather in recent years, the resolution of the collected images has decreased significantly, especially in the low-visibility environment at night. Compared with imaging in a foggy environment during the day, due to the low visibility at night, the image captured by the observation is not clear, which is reflected in the image data, and the pixels with high gray value in the image are weakened. In addition, the color and contrast of the scene change significantly compared to the daytime, and the characteristic information contained in it is weakened, which greatly reduces the recognizability of the scene target. If accompanied by severe weather such as haze, the transparency of the atmosphere will be further reduced, and the impact on high-resolution observation activities will b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06T5/10G06V10/77G06V10/80G06V10/82G06N3/08
CPCG06T5/10G06N3/084G06T2207/20064G06T2207/20081G06T2207/20084G06F18/213G06F18/253G06T5/73
Inventor 姜博李艺欣陈冠廷陈晓璇汪霖孟娜周延李艳艳张嘉洋
Owner NORTHWEST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products