Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Attention-optimized deep coding and decoding defogging generative adversarial network

An attention, encoding and decoding technology, applied in the field of image processing, can solve the problems of low complexity, difficult to obtain dehazing data sets, error superposition, etc., to achieve the effect of recovering information loss, good training effect, and strong robustness

Pending Publication Date: 2022-03-15
NANJING FORESTRY UNIV
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the traditional algorithm has low complexity, it also has the following unavoidable defects: First, due to the superposition of errors in parameter estimation and the inaccuracy of the atmospheric scattering model, the generated dehazed image cannot completely restore the reference image
Second, the performance of the traditional algorithm is largely limited by the detection accuracy of the fog area. While removing the fog, the original low-frequency information in the fog-free area may also be removed.
[0006] First, the performance of a completely end-to-end network is overly dependent on the training results on large-scale datasets. The fog data set is difficult to obtain, which limits the performance of the model;
[0007] Second, most of the existing methods process the pixels on the picture indiscriminately, and cannot cope with the uneven distribution of fog in real scenes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Attention-optimized deep coding and decoding defogging generative adversarial network
  • Attention-optimized deep coding and decoding defogging generative adversarial network
  • Attention-optimized deep coding and decoding defogging generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Below in conjunction with accompanying drawing and specific embodiment the present invention is further described:

[0022] 1 Overview

[0023] The attention-optimized deep codec defogging generative adversarial network of the present invention is a dehazing generative adversarial network based on a codec architecture. The generative confrontation network of the present invention adopts an encoder with a four-layer downsampling structure to fully extract semantic information lost due to fog so as to restore a clear image. At the same time, in the decoder network, an attention mechanism is introduced to adaptively assign weights to different pixels and channels, so as to deal with the unevenly distributed fog. Finally, the framework of generative confrontation network enables the model to achieve better training effect on small sample data sets.

[0024] The experimental results show that the dehazing network of the present invention can not only effectively remove the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Aiming at the problems that the existing defogging algorithm is difficult to process non-uniformly distributed fog and a deep convolution defogging network excessively depends on a large-scale data set, the invention provides an attention-optimized deep coding and decoding defogging generative adversarial network which adopts an encoder with a four-layer down-sampling structure. Semantic information lost due to fog is fully extracted so as to restore a clear image. Meanwhile, in a decoder network, an attention mechanism is introduced, and weights are distributed to different pixels and channels in a self-adaptive manner, so that non-uniformly distributed fog is processed. And finally, a framework of the generative adversarial network enables the model to obtain a better training effect on a small sample data set. Experimental results show that the technical scheme not only can effectively remove non-uniformly distributed fog in a real scene image, but also can recover a clear image for a real scene data set with fewer training samples, and the evaluation index is superior to that of other widely adopted comparison algorithms.

Description

technical field [0001] The technical solution belongs to the field of image processing, in particular, it is an attention-optimized deep codec defogging generative confrontation network applied to image processing. Background technique [0002] The scattering phenomenon produced by light passing through suspended particles such as fog and haze degrades the image collected by the imaging sensor, and thus loses a lot of effective information, which directly affects the performance of downstream advanced vision tasks. The purpose of image defogging is to eliminate the influence of atmospheric environment on image quality, increase the visibility of images, and provide support for downstream semantic tasks (such as image classification, object detection, etc.). [0003] Image dehazing is mainly divided into traditional dehazing and deep learning dehazing algorithms. Most traditional dehazing algorithms use prior knowledge to estimate parameters to restore the original image [1,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T5/50G06T9/00G06N3/04G06N3/08
CPCG06T5/50G06T9/002G06N3/084G06T2207/20081G06T2207/20084G06T2207/20221G06N3/045G06T5/73
Inventor 赵亚琴赵文轩
Owner NANJING FORESTRY UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products