The invention discloses a multi-person
posture recognition method based on CSI (
Channel State Information) and an attention mechanism, and the method comprises the steps: constructing a multi-person
posture recognition system MultiFormer based on the CSI and the attention mechanism, designing a double-TokenTransformer architecture of a time-frequency double-domain Token TFDDT, converting an original CSI
signal into a
time domain Token and a
frequency domain Token, maintaining the local feature continuity of the
time domain and the
frequency domain, and carrying out the recognition of the posture of a plurality of persons. And a multi-stage
feature fusion network MSFN is developed to optimize a part thermodynamic diagram PCM and a part associated field PAF, and the fusion of CSI features and an intermediate attitude thermograph is realized through an adaptive channel-space attention mechanism, so that the anatomical consistency is ensured, and a multi-person scene is supported. According to the method, a MultiFormer
system is provided and is different from existing CSI
imaging processing, an interpretable TFDDT preprocessing method is adopted, the
system adopts a multi-stage
heat map estimation method to realize global attitude
perception, the
estimation precision is improved through iterative optimization, a multi-person scene is supported, attitude topology conforming to an anatomical structure is generated, and the method has the advantages of being simple in structure, convenient to operate and high in practicability. The method has the characteristics of
privacy protection, low cost and no influence of illumination.