Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Method of Image Deraining Based on Cross-Domain Collaborative Learning

An image, cross-domain technology, applied in the field of image inpainting and enhancement, to achieve the effect of improving the ability to remove rain, realize knowledge transfer, improve robustness and generalization ability

Active Publication Date: 2022-02-18
CHINA UNIV OF MINING & TECH
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide an image deraining method based on cross-domain collaborative learning, and at the same time solve the problem of the rain pattern information distribution difference between different synthetic domains and between the synthetic domain and the real domain for the deraining performance of the image deraining model Influence, improve the robustness and generalization ability of the image deraining model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of Image Deraining Based on Cross-Domain Collaborative Learning
  • A Method of Image Deraining Based on Cross-Domain Collaborative Learning
  • A Method of Image Deraining Based on Cross-Domain Collaborative Learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0084] combine figure 1 and figure 2 , a method for deraining images based on cross-domain collaborative learning according to the present invention, the steps are as follows:

[0085] Step 1. Collect 1800 images containing rain in the real environment, perform normalization processing, and unify the pixel size to 384×384, as the real domain training sample set R, select 1800 images in the Rain200L synthetic image deraining data, and perform Normalization processing, unify the pixel size to 384×384, as the first synthetic domain training sample set S 1 , select 1800 images from Rain1200 synthetic image deraining data, perform normalization processing, and unify the pixel size to 384×384, as the second synthetic domain training sample set S 2 , the training sample set such as image 3 shown, go to step 2.

[0086] Step 2. Use the multi-scale feature fusion module to replace the convolutional layer in the basic residual module, and add an attention mechanism to build a mult...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image deraining method based on cross-domain collaborative learning, constructs a dual-branch image deraining network based on a multi-scale attention residual module, and reduces rain in different synthesis fields through a cross-domain collaborative learning strategy oriented to the synthesis field The impact of the difference in the distribution of grain information on the deraining effect of the dual-branch image deraining model, through the real domain-oriented cross-domain learning strategy, reduces the influence of the difference in the distribution of rain grain information in the real domain and the synthetic domain on the deraining performance of the dual-branch image deraining model . The invention improves the learning ability of the image deraining model for the rain pattern information of samples in different fields, reduces the influence of the difference in the distribution of rain pattern information in different fields on the deraining performance of the image deraining model, and enhances the robustness and performance of the image deraining model. Generalization.

Description

technical field [0001] The invention relates to the field of image restoration and enhancement, in particular to an image rain removal method based on cross-domain collaborative learning. Background technique [0002] Photos taken under rainy weather conditions are often of low quality, and these image quality degradations due to rain streaks will affect a range of computer vision tasks, e.g., object detection, image recognition, etc. Therefore, designing effective image deraining algorithms is crucial to the practical application of computer vision algorithms. [0003] At present, deep learning has achieved excellent performance in image deraining tasks. For example, Zhang et al. proposed a single image de-raining model based on conditional generative adversarial network, and used the perceptual loss function to further improve the de-raining effect (He Zhang, Vishwanath Sindagi, and Vishal M. Patel, "Image de-raining using a conditional generative adversarial network”, I...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00G06N3/04G06N3/08G06N20/00G06V10/80G06V10/82
CPCG06N3/08G06N20/00G06T2207/20081G06T2207/20084G06N3/045G06F18/253G06T5/70
Inventor 潘在宇王军李玉莲申政文韩淑雨
Owner CHINA UNIV OF MINING & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products