Semi-supervised neighbor propagation learning and multi-visual dictionary model-based intelligent video analysis method

A technology of intelligent video analysis and neighbor propagation. It is used in character and pattern recognition, instruments, computer parts, etc. It can solve the problem that key video frames cannot take into account the efficiency and accuracy, and achieves improved clustering effect, concise features, and improved classification. The effect of precision and accuracy

Active Publication Date: 2016-06-08
上海贵和软件技术有限公司
View PDF4 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the deficiencies in the prior art, the present invention provides an intelligent video analysis method based on semi-supervised neighbor propagation learning and a multi-visual dictionary model, which solves the problem that the key video frames in the prior art cannot take into account both efficiency and accuracy, and enhances video features to Robustness to approximate global linear changes, enabling accurate intelligent detection that can adapt to video mode changes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semi-supervised neighbor propagation learning and multi-visual dictionary model-based intelligent video analysis method
  • Semi-supervised neighbor propagation learning and multi-visual dictionary model-based intelligent video analysis method
  • Semi-supervised neighbor propagation learning and multi-visual dictionary model-based intelligent video analysis method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] Embodiment one, see figure 1 As shown, an intelligent video analysis method based on semi-supervised nearest neighbor propagation learning and multi-visual dictionary model includes the following steps:

[0051] Step 1. For the video sample, use the sampling and hold strategy to extract key video frames;

[0052] Step 2. For the key video frame, calculate the OM feature vector based on the order measurement;

[0053] Step 3. Utilize the learning based on semi-supervised nearest neighbor propagation to carry out intelligent clustering to all OM feature vectors to form each video sub-cluster;

[0054] Step 4. Determine the category label corresponding to each video sub-cluster, build a multi-visual dictionary, and the category label includes an unknown type video label;

[0055] Step 5. The video to be checked is sequentially executed using the sampling and holding strategy in step 1 to extract key video frames and the calculation in step 2 is based on the OM feature ve...

Embodiment 2

[0057] Embodiment two, see Figure 1-7 As shown, an intelligent video analysis method based on semi-supervised nearest neighbor propagation learning and multi-visual dictionary model includes the following steps:

[0058] Step 1. For the video sample, use the sampling and holding strategy to extract the key video frame, and for any arriving video frame, extract the summary information of the video frame; match the summary information with the key feature library, and if the match is successful, judge the video frame is a key video frame, otherwise, random sampling is performed according to the probability p, if it is selected, it is judged as a key video frame, otherwise, the video frame is discarded, and the key video frame extraction is divided into feature rough matching and video frame fixed-period sampling, if If the arriving video frame matches the known key features, it is considered as a key video frame, otherwise it is sampled with a fixed probability p;

[0059] Ste...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a semi-supervised neighbor propagation learning and multi-visual dictionary model-based intelligent video analysis method. The method includes the following steps that: key video frames are extracted based on a sample-and-hold strategy; the key frames are converted into a grayscale image, and the grayscale image is averagely segmented into a plurality of image blocks, and OM feature vectors are generated based on the sequence of the average brightness of the image blocks; a video sample is divided based on AP clustering, so that mutually exclusive video sub clusters can be formed; the category labels corresponding to each sub cluster are determined according to the video sub clusters obtained through the division of the AP clustering, and a multi-visual dictionary is constructed; the category label of a video to be detected is judged online according to the minimum distance judgment criterion; and closed-loop feedback adaptive reconfiguration learning is adopted to reconstruct a multi-visual dictionary adaptive to a new environment, so that the category label of the video to be detected can be re-judged. With the method of the invention adopted, the problem that efficiency and precision in key frame extraction cannot be taken into account simultaneously can be solved, and enhanced video features have very high robustness for approximate global linear change; and accurate and intelligent detection adaptive to video mode change can be realized.

Description

technical field [0001] The invention relates to the technical field of computer graphics and image processing, in particular to an intelligent video analysis method based on semi-supervised neighbor propagation learning and a multi-visual dictionary model. Background technique [0002] With the popularization of smart phones, digital cameras and other terminal devices and the Internet, the production, storage and transmission of videos are more convenient. More and more people watch videos through the Internet, and make videos of their own life experiences and upload them to the Internet for sharing. Video services are no longer limited to traditional radio and television, entertainment and film and other life service industries, but are widely used in many fields such as politics, military, science and education, medical care, transportation, and security. Facing the "explosive" growth of the number of videos, how to quickly and accurately retrieve, match, and classify vide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V20/41G06V20/46G06V20/52
Inventor 朱珂许维纲夏冰
Owner 上海贵和软件技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products