The invention discloses a remote photoplethysmography (rPPG)
signal processing method and
system based on a long and short term space-time
convolution network, and belongs to the crossing field of
biomedical signal processing and
computer vision. In order to solve the problem of
signal distortion caused by illumination fluctuation,
motion artifacts and
skin color differences, the method constructs a multi-
scale space-time modeling framework: extracting
local space-time features of transient changes of facial capillaries by adopting a 3D convolutional network, capturing long-range periodic features of
heart rate rhythm in combination with a 1D expansion convolutional network, and establishing a multi-
scale space-time modeling framework; the spatial-temporal characteristics are dynamically fused through the self-attention weight and the gating residual structure, and the anti-interference capability is improved. In the preprocessing stage, a face area is positioned through MTCNN,
motion artifacts are compensated by using an
optical flow equation, and
signal purity is enhanced by combining a
skin color
mask and a YUV
color space. The
system adopts a deep separable
convolution and parallel acceleration strategy to realize light weight, and optimizes the network through
time domain MSE loss and
frequency domain KL
divergence. Experiments show that the
phase error of the method is reduced by 40% in a dynamic scene, the signal amplitude of a deep
skin color group is improved by 60%, the method is suitable for non-contact health monitoring equipment, and the robustness and the
measurement precision of the rPPG technology in a complex environment are remarkably improved.