Single image rain removal method based on convolutional neural network

A convolutional neural network, single-image technology, applied in the field of image processing, can solve problems such as inability to distinguish well, cannot retain background images, and filters cannot achieve ideal effects, to meet real-time processing and ensure clarity degree of effect

Active Publication Date: 2016-12-07
XIAMEN UNIV
View PDF6 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But for the task of directly removing rain, traditional filters cannot achieve the desired effect
because they can only take into account smaller local neighborhood information
In a small local window, the structural distinction between rainlines and edges is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single image rain removal method based on convolutional neural network
  • Single image rain removal method based on convolutional neural network
  • Single image rain removal method based on convolutional neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The following embodiments will further illustrate the present invention in conjunction with the accompanying drawings.

[0036] Embodiments of the present invention include the following steps:

[0037] Step 1: Artificially add rain to the clean and clear image through the screen blend model to form a corresponding rainy image and build an image library.

[0038] In the training process, a large number of image pairs of rainy images and non-rainy images are required as training samples. In real-life scenarios, it is relatively simple to obtain a single image without rain or a single image with rain. However, it is difficult to obtain a large number of corresponding image pairs. Therefore, the rainy image is artificially synthesized through the screen blend model, and the specific steps are as follows:

[0039] Step 1: Find 440 clean images of various scenes from the Internet. Some examples of images are as follows: figure 1 shown.

[0040] Step 2: Consider the poss...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a single image rain removal method based on a convolutional neural network and relates to image processing. The method includes the following steps that firstly, manual rain addition is conducted on clean and clear images through a screen blend model to form corresponding rain images, and an image library is built; secondly, the system structure of the convolutional neural network is determined; thirdly, corresponding rain image blocks and rain-free image blocks with the size being 64*64 are obtained from the first step and serve as training samples for training; fourthly, the single image blocks are obtained in an overlapped mode and input in a trained rain removal filter system to obtain the corresponding rain-free image blocks, and weighted averaging is conducted on the image blocks to obtain rain-free images. The method solves the problem that a single image rain removal method based on dictionary learning is long in consumed time, achieves rain removal and guarantees definition of background images, the rain-free images can be quickly obtained after the rain images are input, and the requirement of embedded equipment for real-time processing is met.

Description

technical field [0001] The invention relates to image processing, in particular to a method for removing rain from a single image based on a convolutional neural network. Background technique [0002] The existing single image deraining methods are mainly divided into the method based on dictionary learning and the method of filtering by using filters such as guided filtering. [0003] The method based on dictionary learning considers that the rain line and the background edge belong to different structures, and they should be represented by different dictionaries, so as to distinguish whether the edge belongs to the rain line for deraining. But in real life, some properties such as the direction color of the rain line and some background edges sometimes overlap. In the dictionary separation step of this type of method, although new features are continuously introduced to increase the discrimination of dictionary classification, the accuracy rate is improved to a certain ex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06T5/10G06T5/50G06N3/02
CPCG06N3/02G06T5/002G06T5/10G06T5/50G06T2207/20024G06T2207/20081
Inventor 丁兴号傅雪阳陈丽琴
Owner XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products