The invention discloses a self-supervised skeleton
behavior recognition method,
system and device based on action semantic guidance and a medium, and the method comprises the steps: firstly, obtaining a to-be-trained skeleton video sample, and carrying out the preprocessing of the to-be-trained skeleton video sample; secondly, generating a semantic prototype of each type of action in the preprocessed
human body skeleton
data set through an action semantic generation module, namely generating a corresponding action text
semantic feature; besides, the preprocessed
human body skeleton
data set is input into a feature enhancement module (FAM), skeleton data enhancement is achieved, and skeleton features corresponding to actions are generated; and finally, fusing action text semantic features and skeleton features of corresponding actions by using a multi-
modal fusion module, assisting the model in learning more distinctive and representative action representations from the semantic level, improving the fuzzy
action recognition precision, and through a comparative learning method, improving the fuzzy
action recognition accuracy. A self-supervision mode aims to guarantee model recognition performance and reduce dependence on large-scale
labeled data at the same time, and skeleton-based
human body action classification is achieved; the
system, the device and the medium are based on a self-supervised skeleton
behavior recognition method guided by action
semantics, human body actions are recognized and classified, and the
system, the device and the medium have the advantages of being high in accuracy and good in robustness.