Rainy day video restoration method based on time domain, space domain and frequency domain joint processing

A rainy day and video technology, applied in image data processing, instruments, calculations, etc., can solve problems such as incorrect detection results, affecting restoration effects, and inability to deal with them

Inactive Publication Date: 2014-07-23
TIANJIN UNIV
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this frequency domain method cannot deal with the rain-like information on those unknown frequencies, which leads to incorrect detection results and ultimately affects the restoration effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rainy day video restoration method based on time domain, space domain and frequency domain joint processing
  • Rainy day video restoration method based on time domain, space domain and frequency domain joint processing
  • Rainy day video restoration method based on time domain, space domain and frequency domain joint processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be described below in conjunction with the accompanying drawings and embodiments.

[0031] see figure 1 , the rainy weather video restoration method based on the joint time-space-frequency three domains of the present invention, comprises the following steps:

[0032] Step 1: Convert each frame image of the input video sequence from the RGB color space to the YCbCr color space, and only select the Y channel image sequence for processing, and the images of the Cb and Cr two channels are used in step 10.

[0033] Step 2: The time-domain median filtering technique is used for background modeling, and the number of frames used is 11 frames. For the kth frame image I k , the gray value of the pixel at (x, y) position is I k (x,y) means that I k (x, y) and the gray value I of the pixel at the corresponding position of each frame before and after k-j (x,y)(j=-5,-4,...0,...,4,5) are sorted in ascending order, using their median values ​​(ranked ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a rainy day video restoration method based on time domain, space domain and frequency domain joint processing. The method includes the following steps that an input video sequence is converted to YCbCr space; background modeling is conducted through a time domain median filtering method; a frame-to-frame difference sequence is calculated, and the rain scene area corresponding to each frame of image is obtained; the minimum enclosing rectangle of each raindrop in the rain scene area corresponding to each frame of image is calculated, the falling direction of each raindrop is calculated, a raindrop falling direction feature histogram is established, and the raindrop falling direction feature of each frame of image is acquired; a Y channel of each frame of image is converted into the frequency domain. In accordance with the raindrop falling direction features, an appropriate wedge-shaped direction filter is selected to conduct filtering processing on the magnitude spectra of the image, a frequency domain filtering result is inversely transformed back to the space domain, a Cb channel image and a Cr channel image of original image frames are combined, and a colored image is obtained after recombination. By means of the rainy day video restoration method based on time domain, space domain and frequency domain joint processing, the visual effect of videos can be improved obviously.

Description

Technical field [0001] The invention relates to video restoration technology under severe weather conditions, in particular to a method for removing raindrops from video in rainy weather. Background technique [0002] Severe weather can seriously interfere with the normal work of the outdoor vision system. For example, in weather such as fog, haze, rain, and snow, the visual system will not be able to perform basic operations such as reliable target detection, object recognition and tracking, and feature extraction on the scene based on the information provided by outdoor images or videos. Factors that cause severe degradation of captured images or videos. Therefore, in order to improve the stability and practicability of the outdoor monitoring system, it is necessary to restore the image affected by the weather, and eliminate the influence of bad weather on the image application, so as to ensure that the system can work well. [0003] With the application of computer visi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/40G06T5/00G06T3/00
Inventor 庞彦伟刘长波王建
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap