Behavior splicing method of video scene

A technology of video scenes and behaviors, applied in image data processing, instruments, character and pattern recognition, etc., can solve problems such as restricting the scope of application, failure of image segmentation and edge extraction, low efficiency and robustness of registration algorithms, etc. High reusability, easy further expansion, improved readability and reusability

Active Publication Date: 2012-04-25
BEIHANG UNIV
View PDF4 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Methods based on image feature line segments or feature regions largely rely on image segmentation and edge extraction. These two operations are inherently difficult and computationally intensive. feature line break), it

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Behavior splicing method of video scene
  • Behavior splicing method of video scene
  • Behavior splicing method of video scene

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention will be described in detail below in conjunction with the accompanying drawings.

[0023] refer to figure 1 System overall architecture diagram of the present invention, the overall architecture of the present invention mainly includes 8 parts:

[0024] (1) Scale-invariant feature extraction: Extract scale-invariant features in video images, which are used as the basis for video image registration;

[0025] (2) Feature vector matching: use an approximate nearest neighbor search algorithm based on the k-d tree to find the nearest neighbor and second nearest neighbor of each feature vector in Euclidean space, when the ratio of the distance between the feature vector to the nearest neighbor and the second nearest neighbor is less than a certain threshold When the two are considered to match;

[0026] (3) image registration: according to feature point matching, all video images are registered to the reference image, and the image transformation that...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a behavior splicing method of a video scene, so that video scene splicing and behavior splicing of moving objects in different videos can be realized. The method comprises the following steps that: on the basis of image registration, meshing is carried out on a video image so as to form an image block node set and an image block label set; an image block clustering algorithm is utilized to generate an image block label type representative candidate set for each of the image block node; and a two dimensional Markov random field and a three dimensional Markov random fields of the image block node are constructed and solved, so that a static background and a dynamic background are generated; on the basis of extraction of tracks of moving objects, track similarity and position similarity between moving objects of different videos are calculated, so that a splicable property of moving object behaviors is obtained and video alignment is provided at time and space; and a poisson image fusion algorithm is utilized to fuse a panoramic dynamic background video and motions, so that a video scene after behavior splicing is generated.

Description

technical field [0001] The invention relates to the fields of computer vision, video processing and virtual reality, and is a video scene behavior splicing method, specifically a method for recombining and merging moving objects in multiple input videos into a panoramic video scene according to behaviors . Background technique [0002] In the process of generating a virtual scene based on video material, users need to obtain a larger scene as a background, or obtain a higher resolution video image of a large scene. Because the user can only shoot a small part of a large scene by rotating or moving the camera due to the limitation of the equipment and the site in the process of shooting the video / image. Therefore, before the birth of the computer, people began to manually stitch together the captured images. With the development of aerial photography, due to the limitation of the flight height of the aircraft and the requirements for the resolution of the photos, people stil...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/20G06K9/46
Inventor 陈小武赵沁平陈召东李鑫
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products