Video target detection method, system and device based on class external memory

Abstract

The invention belongs to the field, particularly relates to a video target detection method, system and device based on class external memory, and aims to solve the problem that the target detection performance is obviously reduced when the number of auxiliary frames is small in the prior art. The method comprises: firstly, training a video target detection model through a self-attention mechanismaccording to training video information; and obtaining enhanced instance features of the to-be-detected video through the trained video target detection model and the self-attention mechanism, and finally inputting the enhanced instance features into a classification branch and a bounding box regression branch of the universal target detection network to obtain a target detection result. According to the invention, the sensitivity of a video target detection method based on feature integration to the number of auxiliary frames in the prior art is reduced, so that target detection can be accurately carried out under the condition of fewer auxiliary frames or no auxiliary frames.

Description

technical field [0001] The invention belongs to the field of computer vision and pattern recognition, and in particular relates to a video target detection method, system and device based on category external memory. Background technique [0002] Video object detection is an important and challenging computer vision task, which has a wide range of applications in security monitoring, intelligent video analysis, autonomous driving and other fields. However, it is not ideal to directly use image detectors to detect objects in videos due to motion blur, out-of-focus, etc. in some frames in the videos. Different from images, video data contains rich temporal motion information. Therefore, in order to solve the problem that image detectors do not perform well in low-quality frames in videos, many methods improve the performance of detectors by using temporal context information, such as A method based on feature aggregation. Although these methods have achieved a great improvem...

AI Technical Summary

Problems solved by technology

[0003] In order to solve the above-mentioned problems in the prior art, that is, the performance degradation of the prior art image recognition method based on feature aggregation is obvious when the number of auxiliary frames is small, the first aspect of the present invention provides a video recognition method based on category external memory Target detection method, described video target detection method comprises the following steps:

Images