The invention relates to the technical field of equipment operation tests, particularly discloses a simple scene equipment operation action
rapid processing method based on a test video, and is used for solving the problems of low
action recognition precision, insufficient spatial-temporal
feature fusion, low detection speed and more redundant data in the prior art. Comprising the following steps: accurately intercepting motion start-stop frames, extracting the frames according to a preset
frame rate, implementing
geometric transformation and color augmentation on the frame-extracted images, respectively extracting spatio-temporal dynamic features and static spatial features by adopting a 3D convolutional network and a 2D convolutional network in parallel, integrating the spatio-temporal features by a channel fusion attention module based on a
Gram matrix, and extracting the spatial and temporal dynamic features and the static spatial features by adopting the channel fusion attention module based on the
Gram matrix. A thermodynamic diagram is generated based on Grad-
CAM to assist in key area positioning, a RefineDet network is input to generate a detection result through ARM coarse regression and negative anchor filtering, ODM fine regression and non-maximum suppression in sequence, and efficient and accurate positioning and classification of operation actions are carried out with assistance of a dynamic frame abandoning and
time sequence correction strategy; according to the invention, through the multi-scale residual error
convolution and the anchor frame network, accurate positioning of slow action of equipment is realized.