The invention discloses a method for constructing, updating and retrieving an action memory
library, which belongs to the technical field of
computer vision and comprises the following steps of: constructing a training
data source with
time sequence diversity; initializing an action memory
library containing a plurality of learnable prototype matrixes and a double-flow
interaction network;
memory bank evolution is executed, an action prototype is retrieved by utilizing a query
stream, a current memory state is dynamically generated by combining a memory state updating gate mechanism with a historical state, and dynamic memory is injected into a feature space by utilizing memory driving graph
convolution; synchronously updating parameters based on multi-target loss, and driving a
memory bank to evolve into optimal structured prior; and finally, performing structured reasoning on the to-be-detected sequence by using the optimal
memory bank. According to the method, structured priori is constructed by mining a spatio-temporal topology mode of a
human body action sequence, and hierarchical memory evolution and double-flow depth interaction are combined, so that the problem of depth
ambiguity in a
monocular vision task is effectively solved, geometric structure
distortion is corrected, and the accuracy of action posture
estimation is remarkably improved.