Deep learning based video retrieval method

Abstract

The invention discloses a deep learning based video retrieval method which mainly comprises the following parts: performing video pre-processing by using a convolutional neural network; extracting feature vectors of the video after pre-processing by using a long short-term memory; and finally learning by a similarity learning algorithm to obtain a distance calculation method, and performing similarity calculation according to the method and ranking, so as to obtain a video retrieval result. According to the method disclosed by the invention, scene segmentation and key frame selection are performed by the convolutional neural network, and high-level semantics representing video is extracted, so as to acquire a proper quantity of key frame sequences, and effectively avoid false detection andmissing inspection in shot segmentation. According to method disclosed by the invention, time-order characteristics of the video are extracted by the long short-term memory, so as to obtain a more accurate retrieval result. By similarity learning and a text based matching method, matching accuracy of a similarity measurement method can be promoted. By adopting the method disclosed by the invention, accurate retrieval on a large scale of videos can be realized.

Description

technical field [0001] The invention belongs to the field of computer vision, and especially designs a video retrieval method utilizing deep learning and digital processing technology. Background technique [0002] In recent years, the Internet and multimedia technology have been widely developed and used, and the trend has swept the world. Massive video data is generated in people's daily life, work and study. Facing the explosive growth of multimedia data, we increasingly need a method that can accurately and effectively retrieve and manage massive video. [0003] A complete video retrieval process usually includes three main steps: video preprocessing, that is, the process of removing redundant frames, including shot detection and key frame extraction; video feature extraction; feature matching, that is, similarity calculation. In the field of video preprocessing, existing technologies mainly use pixel difference method, histogram method and edge detection method to perf...

AI Technical Summary

Problems solved by technology

In addition, because video is a complex data structure, existing feature matching methods cannot accurately describe the differences between high-dimensional features, and similarity learning can improve the performance of similarity measurement methods

Images