The invention discloses a multi-person three-dimensional
body posture and
spatial positioning combined
reconstruction method and
system, and relates to the field of multi-
modal three-dimensional reconstruction. The method comprises the steps that CSI signals are collected and preprocessed, and
radio frequency feature representation is constructed;
human body structured visual features are extracted by using a camera, and are aligned with CSI data through a
timestamp and
spatial calibration; a continuous three-dimensional
radio frequency implicit field is constructed based on NeRFs,
signal intensity is synthesized through a
volume rendering technology, and deep fusion is carried out on the
signal intensity and visual features under a cross-
modal attention mechanism; a Transform
encoder and double-decoder structure is adopted, three-dimensional
joint point coordinates and spatial position coordinates of multiple persons are regressed, and joint optimization of postures and positioning is achieved through multitask attention. According to the method, the NeRF
radio frequency field and the multi-head attention mechanism are fused to carry out multi-person three-dimensional
human body posture and positioning combined reconstruction, and high-precision posture and spatial position reconstruction can be realized in a complex scene.