Single picture bidirectional rain removing method based on picture block raindrop density

A single picture, picture block technology, applied in the field of computer vision, can solve the problems of failing to consider the density of raindrops, failure to completely remove the dense raindrop area, failure to consider the phenomenon of raindrop atomization, etc. The effect of automation

Active Publication Date: 2019-07-12
EAST CHINA NORMAL UNIVERSITY
View PDF4 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, in real life, due to the occlusion of some objects, the density of raindrops also changes for a whole image of raindrops. De-raining a picture with a change in the density of raindrops will result in excessive or dense raindrop areas in the image. Cases that cannot be completely removed
[0007] Deng Junping and others divided the picture into 64*64

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single picture bidirectional rain removing method based on picture block raindrop density
  • Single picture bidirectional rain removing method based on picture block raindrop density
  • Single picture bidirectional rain removing method based on picture block raindrop density

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0081] refer to Figure 1 to Figure 1 0, the present embodiment comprises the following steps:

[0082] Step 1: Train a classifier for distinguishing the density of raindrops in different positions of a single rainy day picture, and use the trained classifier to predict the density of raindrops in different positions of the entire rainy day picture.

[0083]Specifically, the classifier combines different convolutional layers with filters of different structures, combines different features of image blocks, and finally connects fully connected layers. The classifier training set is divided into image blocks (size 64*64) from uniformly distributed rainy weather images, and marked with raindrop density labels. Input the rainy day picture block (size 64*64)) into the classifier to predict the density of raindrops. It is hoped that the predicted density of raindrops is consistent with the density of raindrops corresponding to the mark, and the classifier parameters are updated wit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a single picture bidirectional rain removing method based on picture block raindrop density. The method can remove rain from a picture with non-uniform raindrop distribution. The method remove rain of picture blocks by different degrees, according to raindrop intensities of different areas of a single picture predicted by a classifier, and excessive rain removal and incomplete rain removal are prevented. A plurality of picture block bidirectional rain removing modules are trained to remove rain from picture blocks with different sizes, and reinforcing the relationship between the encoder and the generator through the generated hidden layer codes to ensure that the generator can remove rain according to the raindrop intensity. A repairing module is used for repairingthe spliced image subjected to rain removal according to the unsmooth and distorted phenomena. Considering that dense raindrops generate an atomization phenomenon in a rainy day picture, a defoggingmodule is added to a defogging network. Rain removal is carried out on pictures which are distributed unevenly in rainy days, heavy rain pictures are effectively removed through a circulating structure, and meanwhile the atomization phenomenon generated in the rainy days is removed.

Description

technical field [0001] The present invention relates to computer vision technology, in particular to deep learning and neural network rain removal technology, specifically a bidirectional rain removal method for a single picture based on the raindrop density of a picture block. Background technique [0002] In rainy days, since the falling raindrops are relatively dense, and the falling raindrops are reflected by light, the visibility of the background is reduced, and the quality of the picture is seriously affected. It can be observed that in the images taken in rainy days, the density, coverage, direction and shape of raindrops are all different, which makes the pictures taken in rainy days blurred and deformed. Dense raindrops can also create fog, making rainy days blurry. In different vision applications, falling raindrops will affect the effect of monitoring or recognition. [0003] The raindrop removal algorithm can be divided into video raindrop removal algorithm an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06K9/62G06N3/04G06N3/08
CPCG06T5/003G06T5/002G06N3/084G06T2207/30192G06T2207/20081G06T2207/20084G06N3/045G06F18/24G06F18/214Y02A90/10
Inventor 邱崧翟高杰孙力徐伟周梅刘洪英金豫李庆利
Owner EAST CHINA NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products