Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image rain removing method based on attention mechanism and gating circulation unit

A cycle unit and attention technology, applied in the field of image processing, can solve the problems of rain line residue, image contrast reduction, and blurred details, etc., to improve quality, improve image quality, and solve the effect of rain streak residue and blurred details

Pending Publication Date: 2020-10-30
南京信息工程大学滨江学院
View PDF0 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Purpose of the invention: In order to overcome the deficiencies of the prior art, the present invention provides an image deraining method based on the attention mechanism and the gated cycle unit, which solves the problems of reduced image contrast, blurred details and residual rain lines when the image is derained

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image rain removing method based on attention mechanism and gating circulation unit
  • Image rain removing method based on attention mechanism and gating circulation unit
  • Image rain removing method based on attention mechanism and gating circulation unit

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0037] A kind of image deraining method based on attention mechanism and gated recurrent unit proposed by the present invention specifically includes the following steps:

[0038] Step 1: If figure 1 As shown, a single image deraining network architecture (Attention Mechanism and Gated Recurrent Network, AMGR-Net AMGR-Net) based on the attention mechanism and the gated recurrent unit is constructed.

[0039]The constructed network architecture contains 6 modules, and the number of convolution kernels is 24. The first five modules include gated recurrent units, spatial attention modules and activation functions, and use 3×3 convolution kernels. The first module acts as an encoder, converting the image into a feature map. Considering that a large receptive field helps to obtain a large amount of context information, dilated convolutions with expansion factors...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an image rain removal method based on an attention mechanism and a gating circulation unit, and the method comprises the steps: firstly constructing an image rain removal network architecture based on the attention mechanism and the gating circulation unit, wherein the image rain removal network architecture includes 6 modules, each of the first five modules comprises a gating circulation unit, a spatial attention module and an activation function; wherein the module 1 is used as an encoder, expansion convolution with expansion factors of 1, 2, 4 and 8 is respectively used in the module 2 to the module 5, and the sizes of corresponding receiving domains are respectively 5 * 5, 9 * 9, 17 * 17 and 33 * 33; the module 6 comprises a convolution layer, a channel attentionmodule and an activation function, and a 1 * 1 convolution layer is connected behind the module 6 and serves as a decoder to generate residual error mapping; then, selecting the MSE and the SSIM as loss functions; and finally, training the constructed network architecture. According to the method, the problems of rain stripe residues and detail blurring occurring in processing of the image containing the dense rain stripes are solved, the rain lines in the image are removed, meanwhile, the detail parts of the image are reserved, and the image definition is greatly improved.

Description

technical field [0001] The invention belongs to the field of image processing, and in particular relates to an image rain removal method based on an attention mechanism and a gated cycle unit. Background technique [0002] Rain is a relatively common dynamic severe weather. The raindrops fall randomly, the speed of falling is very fast, and they are randomly distributed in the air. In the image, the raindrops mainly appear in the shape of rain lines, which is easy to cause blurred images, loss of detail information, and even Some areas in the image will be randomly occluded, which greatly affects the visual effect of the image and also reduces the performance of computer vision algorithms (such as person detection and tracking, automatic driving, traffic monitoring, etc.). For example, when an image is taken in a rainy environment, due to the influence of the rain line, the characteristics of the object in the image will change, which will reduce the accuracy of the target d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06T2207/10016G06T2207/20081G06T2207/20084G06N3/048G06N3/045G06T5/73Y02A90/10
Inventor 李晨郭业才姚文强
Owner 南京信息工程大学滨江学院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products