The invention relates to the technical field of
biomedical engineering and
computer vision, in particular to a non-contact physiological
signal extraction method and
system based on frequency self-adaption and illumination
noise perception.The method comprises the following steps of multi-mode video
stream collection and spatio-temporal data preprocessing, illumination-
noise perception mask generation and feature filtering, multi-mode video
stream collection and spatio-temporal data preprocessing, illumination-
noise perception mask generation and feature filtering, and non-contact physiological
signal extraction. Frequency adaptive gating and
frequency domain feature enhancement, depth time attention feature re-calibration, physiological
signal regression and
closed loop optimization; the method has the beneficial effects that a lightweight end-to-end
deep learning network architecture is constructed by systematically fusing three core modules of illumination-noise perception
mask, frequency adaptive gating and depth time attention, and the defects that a traditional
physical model depends on artificial prior and is poor in anti-interference performance and high in reliability are overcome. And the one-sidedness caused by high calculation complexity and difficulty in distinguishing the signal and noise of the existing
deep learning model is avoided, and the weak physiological signal can be recovered from the face video more accurately and robustly.