Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Paragraph association rule evaluation method based on multi-dimensional element video segmentation

A video segmentation and video technology, applied to instruments, character and pattern recognition, computer components, etc., can solve problems such as storage difficulties, huge video data volume, inconvenient retrieval, etc., and achieve the effect of reducing complexity

Active Publication Date: 2019-08-06
BEIJING UNIV OF POSTS & TELECOMM
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

With the continuous deepening of edge computing, cloud computing, and big data technologies, problems such as huge video data, difficult storage, and inconvenient retrieval have become increasingly prominent. For large-scale real-time video surveillance data, it is necessary to perform real-time spatio-temporal information on video stream data. Labeling, character extraction, feature extraction, object classification, structured labeling and other image processing work, and quickly transfer to the center for computing and processing, it is necessary to build a paragraph association rule evaluation method for multi-dimensional element video segmentation, which can realize scene, sound and text Fast and accurate matching, providing real-time and efficient monitoring means for the operation of the Chinese government and various enterprises

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Paragraph association rule evaluation method based on multi-dimensional element video segmentation
  • Paragraph association rule evaluation method based on multi-dimensional element video segmentation
  • Paragraph association rule evaluation method based on multi-dimensional element video segmentation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] specific implementation plan

[0048] The present invention will be described in further detail below through examples of implementation.

[0049] The implementation steps of the technical solution are as follows:

[0050] Step 1: Video analysis.

[0051]The first step in video parsing is data reception. It is necessary to demultiplex the video and decompose it into image track, audio track, and subtitle track.

[0052] Demultiplex the traffic surveillance video somewhere in Beijing. The video is 1 minute and 50 seconds long, and it is decomposed into image track, audio track and subtitle track. The decomposed audio track and subtitle track are 1 minute and 50 seconds long.

[0053] Step 2: Keyframe extraction in scene segmentation.

[0054] The key frame extraction methods are mainly divided into five categories, the specific methods are as follows: figure 2 shown.

[0055] (1) Extract keyframes based on boundaries. This method directly selects the first frame a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention mainly provides a paragraph association rule evaluation method based on multi-dimensional element video segmentation. The paragraph association rule evaluation method specifically comprises the steps of 1, carrying out video analysis; 2, extracting a key frame in scene segmentation; step 3, carrying out scene segmentation based on the key frame; step 4, carrying out video audio segmentation; step 5, performing semantic segmentation on the video; 6, judging the paragraph association rule of the segmented video of the GNN network; and step 7, constructing an association network. According to the method, after the same video segment is subjected to multi-dimensional segmentation, a paragraph association rule construction mode is adopted to carry out matching on corresponding multi-dimensional elements. Compard with other paragraph association rule evaluation methods for video segmentation, the video is well segmented in the image dimension by combining the change of the pixels in the image sequence in the time domain and the correlation between the adjacent frames, the key information of the video is reserved, and an effective multi-dimensional element video segmentationparagraph association rule judgment method can be provided.

Description

technical field [0001] The invention mainly relates to a method for judging paragraph association rules, in particular to a method for judging paragraph association rules based on multi-dimensional element video segmentation. Background technique [0002] At present, most of the video structuring problems are segmented on the single-dimensional element of the image, and the research on video structuring methods based on multi-dimensional segmentation is less involved. In practice, the audio information and text information contained in the video also play an important role in the video surveillance work. In addition, when segmenting and extracting key frames from moving objects in the video, in order to consider the problem of computational efficiency, only a certain frame in the video is taken as the key frame, and the important information contained in the video is often ignored, or by setting the threshold The above methods do not consider the changes of pixels in the im...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00
CPCG06V20/49G06V20/46
Inventor 胡燕祝田雯嘉
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products