Face clustering based video categorization method and retrieval method as well as systems thereof

Abstract

The invention provides a face clustering based video categorization method and a retrieval method as well as systems thereof. The method comprises steps as follows: a video file is subjected to shot segmentation; a video shot is subjected to face detection to obtain a face picture and relevant information; a detected face picture is subjected to duplicate removal; facial feature extraction is performed on the face picture subjected to duplicate removal, and extracted facial features are stored into a face feature library; feature clustering is performed on the face picture; the category of each face stored in a face category library is manually annotated; face metadata are automatically generated according to the manually annotated face category and the relevant information of a face in the category, the face metadata are added into an original catalogued file, and a final video catalogued file is obtained. The video categorization method, the retrieval method and the systems have the advantages as follows: the video file is automatically, accurately and efficiently catalogued, and manpower is greatly saved; a face sample library is not required to be prefabricated; a video retrieval function based on a human name and a picture is provided, and the convenient and efficient retrieval advantages are realized.

Description

technical field [0001] The invention belongs to the technical field of video cataloging, and in particular relates to a video cataloging method based on face clustering, a retrieval method and a system thereof. Background technique [0002] Video cataloging refers to the process of organizing and refining video files, and organizing valuable pictures and materials into independent files for easy retrieval and reuse. [0003] Existing video cataloging methods are mainly video cataloging methods based on face recognition. For example, the patent application No. 201110453762.3 discloses an automatic cataloging method based on face recognition technology, which specifically includes: receiving a face material library; receiving Multimedia file; Obtain key frame records and corresponding key frame data images according to the video file; Acquire key frame human face images according to the key frame data images; Query the human face material according to the key frame human face ...

AI Technical Summary

Problems solved by technology

[0006] Aiming at the defects existing in the prior art, the present invention provides a video cataloging method, retrieval method and system based on face clustering, which solves the problem of the inability to automatically generate complete face metadata through video files and the inability to use character names or pictures. Problems with automatic video retrieval

Images