Background repairing method of road scene video image sequence

A technology of video image and restoration method, which is applied in the field of background restoration of road scene video image sequence, can solve problems such as complicated calculation, and achieve good restoration effect.

Active Publication Date: 2014-09-03
XI AN JIAOTONG UNIV
View PDF3 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method needs to estimate the global motion information, and the featur...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Background repairing method of road scene video image sequence
  • Background repairing method of road scene video image sequence
  • Background repairing method of road scene video image sequence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0043] The present invention is a method for repairing the background of a road scene video image sequence. The method is divided into two parts. Firstly, the optical flow repair is realized according to the inconsistency of the optical flow between the moving foreground area and the background area; secondly, according to the optical flow after repairing, the missing The pixels in the foreground area correspond to the background pixels in the adjacent frames to achieve image restoration.

[0044] The process of optical flow repair is as follows: figure 1As shown in , taking the roadside as the dividing line, the optical flow patching is implemented in the road area and the area outside the road respectively. Optical flow patching is divided into an initialization phase and a prediction phase. The first is the initialization phase o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a background repairing method of a road scene video image sequence. The method comprises the steps that first, an optical flow diagram of a current frame to the adjacent frame is calculated, then based on Gaussian process regression, splashes in a lost optical flow diagram area are calculated, and the splashes are used for initialization of optical flow prediction; after the initialization of the optical flow prediction, then three layers of BP neural networks are used for achieving row-by-row optical flow prediction; then image repairing is conducted, in the image repairing stage, the optical flow initialization and optical flow prediction are used for enabling the pixels in a current frame lost area to correspond to an adjacent frame background area, and a Gaussian mixture model is used for achieving image repairing. According to the video image sequence under a movement background condition, corresponding of the current frame lost foreground area pixels to the adjacent frame background pixels is achieved based on optical flow information, image repairing of the movement foreground lost areas in the road scene video image sequence is effectively achieved, and the method is simple and effective.

Description

technical field [0001] The invention belongs to the technical fields of image processing, computer vision and pattern recognition, and in particular relates to a background restoration method of a road scene video image sequence. Background technique [0002] Scene restoration based on video image sequences has important applications in the fields of image processing, computer vision, and pattern recognition. In some practical applications, such as panoramic image generation, it is necessary to remove the foreground objects in the source image and generate a splicing of a single background image. In the problem of scene model establishment based on image rendering, it is necessary to separate the foreground and background information in the source image and model them separately. The Wexler method realizes the repair of the missing area of ​​the current frame by sampling the space-time sampling of the available part of the adjacent frame of the video (refer to Wexler's metho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06N3/08
Inventor 刘跃虎李垚辰苏远歧杨旸张驰
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products