Video copy detection method based on contents

Abstract

The invention relates to video copy detection system and method, which are used for fast and accurately checking that whether input copies a video segment in a video data set and outputting a beginning position and an end position in the presence of copied segment according to a query video input by users. The method comprises three steps of feature extracting, feature matching and amalgamation judging. The SURF (Speeded Up Robust Features) feature of a video frame is firstly extracted, an optimization scheme of an integrogram is utilized in the extraction process of the feature, and the extraction speed is high. The feature matching step is different from traditional methods for matching feature vectors of each feature point, and adopts a two-layer matching method which comprises the following steps of: firstly, adopting a bag-of-words method on the feature vectors of each key frame, obtaining a word frequency histogram of the key frame, and then indexing the word frequency histogram of each key frame for researching a matched key frame pair; and finally matching the feature points in the key frame pair. In the amalgamation judging step, a probabilistic graphical model is established for PSE (Product Safety of Electrical Appliance and Materials), a powerful reasoning method is utilized for deducing the existence and the position of the copied segment, fully the time consistency and the space consistency of the video are fully utilized, and the disadvantages of traditional amalgamation methods are avoided.

Description

technical field [0001] The invention relates to the field of information processing, in particular to a multimedia processing system, and more specifically, to judging whether a video data set contains a copy of a certain video segment, and determining the position of the copied segment if it is included. Background technique [0002] Duplicate video refers to the video obtained after performing various processing on the source video. Related processing includes video format conversion, color conversion, picture geometry conversion, subtitle insertion, frame loss, picture noise, etc. Treat the video V as a sequence of frames {V i , 1≤i≤N}, the form of video duplication detection is defined as follows: Given a video collection {R j}, and a query video Q={Q i , 1≤i≤N}, the task of video duplication detection is for {R j} for each video in Find out the possible existence of 1≤u<v≤N and 1≤x<y≤M j , satisfy {Q i , u≤i≤v} is A copy of . [0003] There are two appro...

AI Technical Summary

Problems solved by technology

This fusion method does not fully consider the time consistency of the video feature vector sequence, and the fusion effect is not good. It is necessary to design a more effective method to improve the performance of the system.

Images