The invention discloses a remote photoplethysmography (rPPG)
signal extraction method based on a 3D
convolutional neural network (3D CNN), and belongs to the technical field of
image processing and physiological
signal detection. In order to solve the problem that space-
time information utilization is insufficient in a complex scene (illumination change and motion interference) in a traditional method, space-time
feature fusion is carried out through 3D CNN, and feature expression is enhanced in combination with an
encoder-decoder structure and an attention mechanism. The method comprises the following steps: extracting continuous
time difference features of a face video, generating space-time fusion features through a 3D CNN, enhancing the space-time fusion features through a codec, and outputting rPPG signals. A self-
supervised training method is innovatively proposed, and the generalization ability of the model is improved by adopting data enhancement, time period alignment and positive and
negative sample comparison. Experiments show that according to the method, the
heart rate estimation error is reduced to be within 1 BPM, the
signal-to-
noise ratio is increased to 1.8 dB, and the motion robustness is superior to that of a traditional
algorithm. The method is suitable for non-contact
heart rate monitoring,
respiratory rate detection and other scenes, has the characteristics of high precision and strong anti-interference, and provides a reliable technical scheme for intelligent health monitoring.