The invention discloses a real-time
human body posture tracking method and
system for an XR scene, relates to the technical field of
computer vision, solves the technical problems that a
modal barrier of vision and
time sequence characteristics cannot be broken through and a
diffusion model is degraded, and aims at RGB images, dynamic
Gaussian filtering and ROI
cutting,
noise is restrained, a
human body area is focused, and the real-time
human body posture tracking effect is achieved. Historical attitude normalization covers space, time and physiological constraints, physical significance consistency of input data is ensured, multi-dimensional and scene-adaptive preprocessing is realized, a data foundation is laid for a subsequent
algorithm, a cross attention mechanism breaks through
modal boundaries of vision and
time sequence features, multi-
modal condition vectors are generated, and a multi-modal model is established. And meanwhile, the current limb appearance and the historical motion trend are coded, an accurate reasoning basis is provided for the
diffusion model, dynamic and scene-adaptive feature
collaboration is realized, a theoretical attitude is constructed based on the first five frames, the theoretical attitude and the
diffusion model are preliminarily predicted and dynamically fused, and details are reserved when motion
inertia is fit.