Ground power unit (GPU)-based video layering method

A video and layering technology, applied in the field of video layering based on GPU, can solve the problems of large calculation deviation, time-consuming video processing, large amount of calculation, etc., and achieve the effect of reduced calculation time and fast processing results

Active Publication Date: 2011-02-02
ZHEJIANG UNIV
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the optical flow method will produce large calculation deviations for areas where texture information is scarce, the use of the optical flow method to calculate the corresponding mot

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Ground power unit (GPU)-based video layering method
  • Ground power unit (GPU)-based video layering method
  • Ground power unit (GPU)-based video layering method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] With reference to accompanying drawing, the present invention relates to a kind of video layering method based on GPU, carry out in the following steps:

[0035] Step 1. For the input video, select one of the frames as a key frame, and perform an image segmentation operation on the key frame to obtain a series of regional blocks; use the optical flow method to calculate the optical flow information of each pixel in the key frame;

[0036] For the input video, an image containing no or less occlusion of objects contained in the image is selected as a key frame. For images of different sizes, by adjusting the size of the window parameters in the mean-shift algorithm and selecting appropriate parameters, the image over-segmentation of the key frame is achieved, and a large number of blocks that maintain the boundary of the object are formed. A series of regional blocks obtained through image segmentation will be used as the basic unit of subsequent calculation processing; ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a GPU-based video layering method, which comprises the following steps of: firstly, selecting a key frame from an input video and performing image over-division treatment on an image by using a man-shift image dividing method to obtain a series of region blocks; secondly, marking region blocks lacking texture information by computing the rate of pixels lacking motion information in each region block; thirdly, computing affine motion parameters of regions which are not marked and clustering the regions of which the areas reach a threshold to obtain an initial layer; and finally, computing non-appointed pixel regions by combining the motion information and color information and appointing the pixel regions into a corresponding layer in the initial layer to complete the layering processing operation of the key frame. The other frames in the video are layered by mainly combining the layering result of a former frame and the information of the current frame and using a maximal posterior probability model and accelerated by using a GPU, so that the processing efficiency of each frame of the video is greatly improved.

Description

Technical field: [0001] The invention relates to a GPU-based video layering method. Background technique: [0002] Video layering technology has a wide range of applications in object recognition, video compression and multi-target tracking. Considering the complexity of video data and the immaturity of existing technologies, video layering cannot achieve ideal results for all videos, and many methods have better results for specific types of videos. At present, the research on video layering at home and abroad is mainly based on motion information, and then integrates information such as color, space and shape for calculation and processing. [0003] Video layering based on motion information mainly includes two aspects: (1) the description of each layer of the video, that is, the expression of the corresponding motion model parameters; (2) the operation that the pixels of each frame in the video belong to the corresponding layer. For the motion description of each level,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00H04N7/26H04N19/33
Inventor 童若锋唐敏张桂超
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products