Non-contact heart rate measurement method, system and device based on face image

A non-contact face image technology, applied in the fields of computer vision, deep learning and medicine, can solve the problems of low real-time performance, high error rate and large influence of heart rate calculation, and achieve low error rate, high efficiency and weakened effect of importance

Active Publication Date: 2021-02-19
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0011] In order to solve the above problems in the prior art, that is, the existing image-based non-contact heart rate measurement method is greatly affected by factors such as ROI area selection and the environment, and the heart rate calculation error rate is large and the real-time performance is low. The present invention provides A non-contact heart rate measurement method based on a face image is proposed. The non-contact heart rate measurement method includes:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Non-contact heart rate measurement method, system and device based on face image
  • Non-contact heart rate measurement method, system and device based on face image
  • Non-contact heart rate measurement method, system and device based on face image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, not to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

[0057] It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.

[0058] The present invention provides a non-contact heart rate measurement method based on face images, which utilizes a cascaded network of CNN and LSTM to extract video space image features and also learn time sequence information between consecutive video frames. At the same time...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of computer vision, deep learning and medicine, particularly relates to a non-contact heart rate measurement method, system and device based on a face image, and aims to solve the problems that an existing non-contact heart rate measurement method based on an image is greatly influenced by ROI selection, environment and other factors, and the measurement accuracy is low. The heart rate calculation error rate is large, and the real-time performance is low are solved. The method comprises the steps of obtaining a face position from a face video through face key point detection and positioning, and extracting a face local ROI area frame by frame as network model input; on the basis of a convolution and time sequence network cascade model, dividingheart rate intervals into different interval categories, embedding a channel attention network SENet into a convolution module, weights are learned according to the channel importance degree, and finally acquiring the heart rate interval categories corresponding to input videos. CNN feature extraction and the LSTM long-short-term memory neural network are combined, and the channel attention network is embedded, so that heart rate non-contact measurement with low error rate and high efficiency is realized.

Description

technical field [0001] The invention belongs to the fields of computer vision, deep learning and medical technology, and in particular relates to a non-contact heart rate measurement method, system and device based on face images. Background technique [0002] Heart rate measurement methods can be divided into contact measurement and non-contact heart rate measurement methods. Contact measurement usually requires professional medical equipment to directly contact the human body, which is inconvenient. Non-contact measurement includes obtaining the photoplethysmography (PPG, photoplethysmography) signal of the human body based on image, reflective photoelectric measurement, radio magnetic field and other methods. The periodic fluctuation of the heart causes the periodic contraction and relaxation of peripheral blood vessels, and the analysis of reflection The obtained PPG signal changes periodically to obtain the human heart rate, such as Figure 6 , which is a schematic diag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/40G06K9/62G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06V40/172G06V20/41G06V10/30G06N3/044G06N3/045G06F18/2411G06F18/214
Inventor 李学恩孙闻张振山王红星
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products