A non-contact heart rate measurement method, device and computer equipment

Abstract

The non-contact heart rate measurement method, device, and computer equipment provided by the present invention acquire a facial image in real time; extract a region of interest (ROI) from the facial image, accumulate image data for the ROI, and screen the ROI for high-quality signal areas when the accumulated time reaches a preset threshold to obtain a human photoplethysmography (PPG) signal. This signal is then subjected to singular spectrum analysis to determine a heart rate value. By employing high-quality signal area screening and a heart rate calculation method based on singular spectrum analysis, the present invention reduces the impact of the environment on non-contact heart rate measurement and increases the accuracy of non-contact heart rate measurement.

Description

Technical Field

[0001] The present invention relates to the field of image processing, and in particular to a non-contact heart rate measurement method, device and computer equipment. Background Art

[0002] Currently, there are two main methods for measuring heart rate: contact and non-contact. Contact methods use the photoelectric volume method, transmissive oximetry, and electrocardiogram (ECG) methods. While contact methods offer high accuracy, they require the wearable or attached measuring device, which can be inconvenient and uncomfortable for the user. Non-contact heart rate measurement involves capturing natural light or monitoring surface fluctuations for 5 to 30 seconds using a standard camera or radar, extracting a weak periodic signal, and analyzing it to calculate the heart rate.

[0003] Although non-contact heart rate measurement methods can bring greater convenience and comfort compared to contact heart rate measurement methods, they are often easily affected by the environment, increasing measurement errors and reducing measurement accuracy. Summary of the Invention

[0004] In view of this, an embodiment of the present invention provides a non-contact heart rate measurement method, device and computer equipment that uses a method of high-quality signal area screening and heart rate calculation based on singular spectrum analysis to reduce the impact of the environment on non-contact heart rate measurement and increase the accuracy of non-contact heart rate measurement.

[0005] In a first aspect, an embodiment of the present invention provides a non-contact heart rate measurement method, comprising:

[0006] Acquire facial images in real time;

[0007] Extracting a region of interest (ROI) of the face image;

[0008] Accumulating image data of the ROI, and screening the ROI for a high-quality signal area when the accumulated time reaches a preset time threshold to obtain a human photoplethysmography (PPG) signal;

[0009] Performing singular spectrum analysis on the human body PPG signal to obtain a heart rate value.

[0010] As an optional solution, the step of screening the ROI for a high-quality signal region to obtain a human photoplethysmography (PPG) signal includes:

[0011] The ROI is divided into several regions, and the RGB three-channel data of each region are fused to obtain the weighted PPG signal:

[0012] I PPGx(k) = αR mean (k)+βG mean (k)+γB mean (k)

[0013] Among them I PPGx is the weighted PPG signal of the xth region at the kth moment, α, β, and γ are weighting coefficients, and R mean , G mean 、B mean are the mean values ​​of the R, G, and B channels of the xth region at the (kth) moment;

[0014] Perform Fourier transform on the PPG signal of each area to obtain the PPG signal spectrum. Calculate the ratio of the peak value within the heart rate fluctuation range of the PPG signal spectrum (e.g., within the range of 0.8Hz to 1.9Hz) to the mean value of the PPG signal spectrum:

[0015]

[0016] where f PPGx The weighted PPG signal I for the xth region PPGx The spectrum of the spectrum is obtained, and the area where the ratio is greater than a certain threshold is determined as the high-quality signal area, and the weighted PPG signal I of the high-quality signal area is retained. PPGx ;

[0017] All retained PPG signals I PPGx To perform the fusion:

[0018]

[0019] Among them I PPG It is the PPG time domain signal filtered by high-quality signal area.

[0020] As an optional solution, performing singular spectrum analysis on the human body PPG signal to obtain a heart rate value includes:

[0021] The PPG time domain signal obtained by screening the high-quality signal area is subjected to singular spectrum analysis, and the PPG signal obtained by screening the high-quality signal area is decomposed into several singular spectrum components. Perform Fourier transform on each singular spectrum component to obtain the spectrum of each singular spectrum component:

[0022]

[0023] Find the spectrum of each singular spectral component Is the peak within the heart rate fluctuation range? If not, remove the singular spectrum component. If it is within the heart rate fluctuation range, the singular spectrum component is retained

[0024] All the remaining singular spectral components Superposition And Perform Fourier transform to get Spectrum, searched The frequency corresponding to the peak in the spectrum is the heart rate value.

[0025] As an optional solution, before acquiring the face image in real time, the method further includes:

[0026] Acquire image information using an image sensor, and determine whether a human face exists in the image information;

[0027] When it is determined that a human face exists, a facial image of the human face is extracted.

[0028] In a second aspect, an embodiment of the present invention provides a non-contact heart rate measurement device, comprising:

[0029] Acquisition module, used to acquire face images in real time;

[0030] An extraction module, configured to extract a region of interest (ROI) of the face image;

[0031] a screening module, configured to accumulate image data of the ROI and screen the ROI for high-quality signal regions to obtain a human photoplethysmography (PPG) signal when the accumulated time reaches a preset time threshold;

[0032] The analysis module is used to perform singular spectrum analysis on the human body PPG signal to obtain a heart rate value.

[0033] As an optional solution, the screening module is specifically used to:

[0034] The ROI is divided into several regions, and the RGB three-channel data of each region are fused to obtain the weighted PPG signal:

[0035] I PPGx (k) = αR mean (k)+βG mean (k)+γB mean (k)

[0036] Among them I PPGx is the weighted PPG signal of the xth region at the kth moment, α, β, and γ are weighting coefficients, and R mean , G mean 、B mean are the mean values ​​of the R, G, and B channels of the xth region at the (kth) moment;

[0037] Perform Fourier transform on the PPG signal of each area to obtain the PPG signal spectrum. Calculate the ratio of the peak value within the heart rate fluctuation range of the PPG signal spectrum (e.g., within the range of 0.8Hz to 1.9Hz) to the mean value of the PPG signal spectrum:

[0038]

[0039] where f PPGx The weighted PPG signal I for the xth region PPGx The spectrum of the spectrum is obtained, and the area where the ratio is greater than a certain threshold is determined as the high-quality signal area, and the weighted PPG signal I of the high-quality signal area is retained. PPGx ;

[0040] All retained PPG signals I PPGx To perform the fusion:

[0041]

[0042] Among them I PPG It is the PPG time domain signal filtered by high-quality signal area.

[0043] As an optional solution, the analysis module is used to:

[0044] The PPG time domain signal obtained by screening the high-quality signal area is subjected to singular spectrum analysis, and the PPG signal obtained by screening the high-quality signal area is decomposed into several singular spectrum components. Perform Fourier transform on each singular spectrum component to obtain the spectrum of each singular spectrum component:

[0045]

[0046] Find the spectrum of each singular spectral component Is the peak within the heart rate fluctuation range? If not, remove the singular spectrum component. If it is within the heart rate fluctuation range, the singular spectrum component is retained

[0047] All the remaining singular spectral components Superposition And Perform Fourier transform to get Spectrum, searched The frequency corresponding to the peak in the spectrum is the heart rate value.

[0048] As an optional solution, it also includes:

[0049] The detection module is used to obtain image information using an image sensor, determine whether there is a face in the image information, and extract a facial image of the face when it is determined that there is a face.

[0050] In a third aspect, an embodiment of the present invention provides a computer device, including:

[0051] at least one processor; and

[0052] a memory communicatively connected to the at least one processor; wherein,

[0053] The memory stores instructions that can be executed by the at least one processor. The instructions are executed by the at least one processor to enable the at least one processor to perform the above-mentioned non-contact heart rate measurement method.

[0054] In a fourth aspect, an embodiment of the present invention provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute the above-mentioned non-contact heart rate measurement method.

[0055] The non-contact heart rate measurement method, device, and computer equipment provided by the embodiments of the present invention acquire a facial image in real time; extract a region of interest (ROI) from the facial image, accumulate image data for the ROI, and when the accumulation time reaches a preset time threshold, perform high-quality signal area screening on the ROI to obtain a human photoplethysmography (PPG) signal; perform singular spectrum analysis on the human PPG signal to obtain a heart rate value. The method uses high-quality signal area screening and heart rate calculation based on singular spectrum analysis to reduce the impact of the environment on non-contact heart rate measurement and increase the accuracy of non-contact heart rate measurement. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 A flowchart of a non-contact heart rate measurement method is provided in an embodiment of the present invention;

[0057] Figure 2 A schematic flow chart of a high-quality signal area screening process in a non-contact heart rate measurement method according to an embodiment of the present invention is provided;

[0058] Figure 3 A schematic flow chart of a singular spectrum analysis process in a non-contact heart rate measurement method according to an embodiment of the present invention is provided;

[0059] Figure 4 A structural block diagram of a non-contact heart rate measurement device is provided in an embodiment of the present invention;

[0060] Figure 5 A structural block diagram of a computer device is provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0061] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0062] The terms "first," "second," "third," "fourth," and the like in the specification and claims of the present invention and in the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" and "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0063] Combine Figure 1 As shown, an embodiment of the present invention provides a non-contact heart rate measurement method, including:

[0064] S101, acquiring a face image in real time, detecting whether a face exists from image information collected by an image sensor, and extracting a face image if a face exists;

[0065] S102, extracting a region of interest (ROI) from the facial image, where the ROI may be a feature area where facial blood vessels are densely distributed, such as cheeks, forehead, etc.;

[0066] S103. Accumulating image data for the ROI, and screening the ROI for high-quality signal regions when the accumulated time reaches a preset time threshold to obtain a human photoplethysmography (PPG) signal. PPG refers to photoplethysmography, which primarily uses photoplethysmography to scan pulse waves. Detecting heart rate during human exercise using photoplethysmography (PPG) is an application of infrared non-destructive testing technology in biomedicine. It uses a photoelectric sensor to detect differences in the intensity of reflected light after absorption by human blood and tissue, and thus records changes in vascular volume during the cardiac cycle. The heart rate is then calculated from the obtained pulse waveform.

[0067] S104: Perform singular spectrum analysis on the human body PPG signal to obtain a heart rate value.

[0068] The non-contact heart rate measurement method provided by an embodiment of the present invention acquires a facial image in real time; extracts a region of interest (ROI) of the facial image, accumulates image data of the ROI, and when the accumulation time reaches a preset time threshold, performs high-quality signal area screening on the ROI to obtain a human photoplethysmography (PPG) signal; and performs singular spectrum analysis on the human PPG signal to obtain a heart rate value. The method uses high-quality signal area screening and heart rate calculation based on singular spectrum analysis to reduce the impact of the environment on non-contact heart rate measurement and increase the accuracy of non-contact heart rate measurement.

[0069] In some embodiments, before acquiring the facial image in real time, the method further includes:

[0070] Acquire image information using an image sensor, and determine whether a human face exists in the image information;

[0071] When it is determined that a human face exists, a facial image of the human face is extracted.

[0072] An embodiment of the present invention provides a non-contact heart rate measurement method, the method comprising:

[0073] The ROI is divided into several regions, and the RGB three-channel data of each region are fused to obtain the weighted PPG signal:

[0074] I PPGx (k) = αR mean (k)+βG mean (k)+γB mean (k)

[0075] Among them I PPGx is the weighted PPG signal of the xth region at the kth moment, α, β, and γ are weighting coefficients, and R mean , G mean 、B mean are the mean values ​​of the R, G, and B channels of the xth region at the (kth) moment;

[0076] Perform Fourier transform on the PPG signal of each area to obtain the PPG signal spectrum. Calculate the ratio of the peak value within the heart rate fluctuation range of the PPG signal spectrum (e.g., within the range of 0.8Hz to 1.9Hz) to the mean value of the PPG signal spectrum:

[0077]

[0078] where f PPGx The weighted PPG signal I for the xth region PPGxThe spectrum of the spectrum is obtained, and the area where the ratio is greater than a certain threshold is determined as the high-quality signal area, and the weighted PPG signal I of the high-quality signal area is retained. PPGx ;

[0079] All retained PPG signals I PPGx To perform the fusion:

[0080]

[0081] Among them I PPG It is the PPG time domain signal filtered by high-quality signal area.

[0082] The PPG time domain signal obtained by screening the high-quality signal area is subjected to singular spectrum analysis, and the PPG signal obtained by screening the high-quality signal area is decomposed into several singular spectrum components. Perform Fourier transform on each singular spectrum component to obtain the spectrum of each singular spectrum component:

[0083]

[0084] Find the spectrum of each singular spectral component Is the peak within the heart rate fluctuation range? If not, remove the singular spectrum component. If it is within the heart rate fluctuation range, the singular spectrum component is retained

[0085] All the remaining singular spectral components Superposition And Perform Fourier transform to get Spectrum, searched The frequency corresponding to the peak in the spectrum is the heart rate value.

[0086] An embodiment of the present invention further provides a non-contact heart rate measurement method, the method comprising:

[0087] First, the image sensor captures facial image information. If no face is recognized, the system returns to image acquisition and face recognition. If a face is recognized, it extracts characteristic facial regions with dense blood vessels, such as the cheeks and forehead. Next, image data is accumulated for these characteristic facial regions. After a period of accumulation, high-quality signal regions are further screened. This high-quality signal region generates a highly periodic human PPG signal. This signal is then used to calculate the heart rate using singular spectrum analysis to determine the heart rate.

[0088] Combine Figure 2As shown in the figure, the extracted feature area is further divided into several areas, and then the R, G, and B three-channel data of each area are fused to obtain the weighted PPG signal:

[0089] I PPGx (k) = αR mean (k)+βG mean (k)+γB mean (k)

[0090] Among them I PPGx is the weighted PPG signal of the xth region at the kth moment, α, β, and γ are weighting coefficients, and R mean , G mean 、B mean are the mean values ​​of the R, G, and B channels of the xth region at the (kth) moment;

[0091] Then, perform Fourier transform on the PPG signal of each area to obtain the PPG signal spectrum, and calculate the ratio of the peak value within the heart rate fluctuation range of the PPG signal spectrum (such as 0.8Hz to 1.9Hz) to the mean value of the PPG signal spectrum:

[0092]

[0093] where f PPGx The weighted PPG signal I for the xth region PPGx If the ratio is greater than a certain threshold (such as 3.0), the area is considered to be a high-quality signal area, and the weighted PPG signal I PPGx will be retained, otherwise the weighted PPG signal I PPGx will be removed.

[0094] Finally, all retained PPG signals I PPGx To perform the fusion:

[0095]

[0096] Among them I PPG It is the PPG time domain signal filtered by high-quality signal area.

[0097] Combine Figure 3 As shown, the PPG time domain signal obtained by screening the high-quality signal area is subjected to singular spectrum analysis, and the PPG signal obtained by screening the high-quality signal area is decomposed into several singular spectrum components. Perform Fourier transform on each singular spectrum component to obtain the spectrum of each singular spectrum component:

[0098]

[0099] Find the spectrum of each singular spectral component Is the peak within the heart rate fluctuation range? If not, remove the singular spectrum component. If it is within the heart rate fluctuation range, the singular spectrum component is retained Finally, all the remaining singular spectral components Superposition And Perform Fourier transform to get Spectrum, searched The frequency corresponding to the peak in the spectrum is the heart rate.

[0100] Combine Figure 4 As shown, an embodiment of the present invention provides a non-contact heart rate measurement device, comprising:

[0101] Acquisition module 401, for acquiring face images in real time;

[0102] Extraction module 402, used to extract the region of interest ROI of the face image;

[0103] A screening module 403 is configured to accumulate image data of the ROI and screen the ROI for high-quality signal regions to obtain a human photoplethysmography (PPG) signal when the accumulated time reaches a preset time threshold;

[0104] The analysis module 404 is configured to perform singular spectrum analysis on the human PPG signal to obtain a heart rate value.

[0105] As an optional solution, the screening module 403 is specifically configured to:

[0106] The ROI is divided into several regions, and the RGB three-channel data of each region are fused to obtain the weighted PPG signal:

[0107] I PPGx (k) = αR mean (k)+βG mean (k)+γB mean (k)

[0108] Among them I PPGx is the weighted PPG signal of the xth region at the kth moment, α, β, and γ are weighting coefficients, and R mean , G mean 、B mean are the mean values ​​of the R, G, and B channels of the xth region at the (kth) moment;

[0109] Perform Fourier transform on the PPG signal of each area to obtain the PPG signal spectrum. Calculate the ratio of the peak value within the heart rate fluctuation range of the PPG signal spectrum (e.g., within the range of 0.8Hz to 1.9Hz) to the mean value of the PPG signal spectrum:

[0110]

[0111] where f PPGx The weighted PPG signal I for the xth region PPGx The spectrum of the spectrum is obtained, and the area where the ratio is greater than a certain threshold is determined as the high-quality signal area, and the weighted PPG signal I of the high-quality signal area is retained. PPGx ;

[0112] All retained PPG signals I PPGx To perform the fusion:

[0113]

[0114] Among them I PPG It is the PPG time domain signal filtered by high-quality signal area.

[0115] As an optional solution, the analysis module 404 is used to:

[0116] The PPG time domain signal obtained by screening the high-quality signal area is subjected to singular spectrum analysis, and the PPG signal obtained by screening the high-quality signal area is decomposed into several singular spectrum components. Perform Fourier transform on each singular spectrum component to obtain the spectrum of each singular spectrum component:

[0117]

[0118] Find the spectrum of each singular spectral component Is the peak within the heart rate fluctuation range? If not, remove the singular spectrum component. If it is within the heart rate fluctuation range, the singular spectrum component is retained

[0119] All the remaining singular spectral components Superposition And Perform Fourier transform to get Spectrum, searched The frequency corresponding to the peak in the spectrum is the heart rate value.

[0120] As an optional solution, it also includes:

[0121] The detection module 405 is configured to acquire image information using an image sensor, determine whether a face exists in the image information, and extract a facial image of the face when it is determined that a face exists.

[0122] The non-contact heart rate measurement device provided by an embodiment of the present invention acquires a facial image in real time; extracts a region of interest (ROI) from the facial image, accumulates image data for the ROI, and when the accumulation time reaches a preset time threshold, performs high-quality signal area screening on the ROI to obtain a human photoplethysmography (PPG) signal; and performs singular spectrum analysis on the human PPG signal to obtain a heart rate value. The method of high-quality signal area screening and heart rate calculation based on singular spectrum analysis is used to reduce the impact of the environment on non-contact heart rate measurement and increase the accuracy of non-contact heart rate measurement.

[0123] Combine Figure 5 As shown, accordingly, an embodiment of the present invention provides a computer device, including:

[0124] at least one processor; and

[0125] a memory communicatively connected to the at least one processor; wherein,

[0126] The memory stores instructions that can be executed by the at least one processor. The instructions are executed by the at least one processor to enable the at least one processor to perform the above-mentioned non-contact heart rate measurement method.

[0127] Figure 5 FIG. 1 is a structural diagram of a computer device 12 provided in an embodiment of the present invention. Figure 5 A block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention is shown. Figure 5 The computer device 12 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0128] like Figure 5 As shown, computer device 12 is represented in the form of a general-purpose computing device. Computer device 12 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0129] Components of computer device 12 may include, but are not limited to, one or more processors or processing units 16 , a system memory 28 , and a bus 18 that connects various system components, including system memory 28 and processing unit 16 .

[0130] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. Examples of these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0131] The computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0132] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be configured to read and write non-removable, non-volatile magnetic media ( Figure 5 Not shown, often called a "hard drive"). Although Figure 5 Not shown, a magnetic disk drive for reading and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of the present invention.

[0133] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may include an implementation of a network environment. Program modules 42 generally implement the functions and / or methods of the embodiments described herein.

[0134] The computer device 12 can also communicate with one or more external devices 14 (e.g., a keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and / or any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication can occur via an input / output (I / O) interface 22. Furthermore, the computer device 12 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with the other modules of the computer device 12 via a bus 18. It should be understood that, although not shown, other hardware and / or software modules can be used in conjunction with the computer device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0135] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the non-contact heart rate measurement method provided by the embodiment of the present invention.

[0136] An embodiment of the present invention provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable the computer to execute the above-mentioned non-contact heart rate measurement method.

[0137] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, apparatus or device.

[0138] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0139] The program code that comprises on the computer-readable medium can be transmitted with any appropriate medium, includes but not limited to wireless, electric wire, optical cable, RF etc., or above-mentioned any suitable combination.Can write the computer program code that is used to carry out the operation of the present invention with one or more programming languages ​​or its combination, described programming language comprises object-oriented programming language such as Java, Smalltalk, C++, also comprises conventional procedural programming language--such as " C " language or similar programming language.Program code can be carried out on user's computer completely, partly on user's computer, carry out as an independent software package, partly on user's computer partly on remote computer, or carry out completely on remote computer or server.In the situation that relates to remote computer, remote computer can comprise local area network (LAN) or wide area network (WAN) to be connected to user's computer by the network of any kind, perhaps, can be connected to external computer (for example, utilize Internet service provider to come to connect by Internet).

[0140] An embodiment of the present invention further provides a computer program product, including a computer program, which implements the above-mentioned non-contact heart rate measurement method when executed by a processor.

[0141] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not a limitation herein.

[0142] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A non-contact heart rate measurement method, characterized in that: include: Acquire facial images in real time; Extracting a region of interest (ROI) of the face image; Accumulating image data for the ROI, and screening the ROI for a high-quality signal area to obtain a human photoplethysmography (PPG) signal when the accumulated time reaches a preset time threshold, wherein the screening of the ROI for a high-quality signal area to obtain the human photoplethysmography (PPG) signal includes: The ROI is divided into several regions, and the RGB three-channel data of each region are fused to obtain the weighted PPG signal: I PPGx (k)=αR mean (k)+βG mean (k)+γB mean (k) Among them I PPGx is the weighted PPG signal of the xth region at the kth moment, α, β, and γ are weighting coefficients, and R mean , G mean 、B mean are the mean values ​​of the R, G, and B channels of the xth region at the (kth) moment; Perform Fourier transform on the PPG signal of each region to obtain the PPG signal spectrum, and calculate the ratio of the peak value within the heart rate fluctuation range of the PPG signal spectrum to the mean value of the PPG signal spectrum: where f PPGx The weighted PPG signal I for the xth region PPGx The spectrum of the spectrum is obtained, and the area where the ratio is greater than a certain threshold is determined as the high-quality signal area, and the weighted PPG signal I of the high-quality signal area is retained. PPGx ; All retained PPG signals I PPGx To perform the fusion: Among them I PPG It is the PPG time domain signal filtered by high-quality signal area; The human body photoplethysmography (PPG) signal is subjected to a singular spectrum analysis to obtain a heart rate value.

2. The non-contact heart rate measurement method according to claim 1, characterized in that: The performing singular spectrum analysis on the human body photoplethysmography (PPG) signal to obtain a heart rate value includes: The PPG time domain signal obtained by screening the high-quality signal area is subjected to singular spectrum analysis, and the PPG signal obtained by screening the high-quality signal area is decomposed into several singular spectrum components. Perform Fourier transform on each singular spectrum component to obtain the spectrum of each singular spectrum component: Find the spectrum of each singular spectral component Is the peak value within the heart rate fluctuation range? If not, remove the singular spectrum component. If it is within the heart rate fluctuation range, the singular spectrum component is retained All the remaining singular spectral components Superposition And Perform Fourier transform to get Spectrum, searched The frequency corresponding to the peak in the spectrum is the heart rate value.

3. The non-contact heart rate measurement method according to claim 1, characterized in that: Before acquiring the face image in real time, the method further includes: Acquire image information using an image sensor, and determine whether a human face exists in the image information; When it is determined that a human face exists, a facial image of the human face is extracted.

4. A non-contact heart rate measurement device, characterized in that: include: Acquisition module, used to acquire face images in real time; An extraction module, configured to extract a region of interest (ROI) of the face image; A screening module is configured to accumulate image data for the ROI and screen the ROI for high-quality signal regions when the accumulated time reaches a preset time threshold to obtain a human photoplethysmography (PPG) signal. The screening module is specifically configured to: The ROI is divided into several regions, and the RGB three-channel data of each region are fused to obtain the weighted PPG signal: I PPGx (k)=αR mean (k)+βG mean (k)+γB mean (k) Among them I PPGx is the weighted PPG signal of the xth region at the kth moment, α, β, and γ are weighting coefficients, and R mean , G mean 、B mean are the mean values ​​of the R, G, and B channels of the xth region at the (kth) moment; Perform Fourier transform on the PPG signal of each region to obtain the PPG signal spectrum, and calculate the ratio of the peak value within the heart rate fluctuation range of the PPG signal spectrum to the mean value of the PPG signal spectrum: where f PPGx The weighted PPG signal I for the xth region PPGx The spectrum of the spectrum is obtained, and the area where the ratio is greater than a certain threshold is determined as the high-quality signal area, and the weighted PPG signal I of the high-quality signal area is retained. PPGx ; All retained PPG signals I PPGx To perform the fusion: Among them I PPG It is the PPG time domain signal filtered by high-quality signal area; The analysis module is used to perform singular spectrum analysis on the human body photoplethysmography (PPG) signal to obtain a heart rate value.

5. The non-contact heart rate measurement device according to claim 4, characterized in that: The analysis module is used to: The PPG time domain signal obtained by screening the high-quality signal area is subjected to singular spectrum analysis, and the PPG signal obtained by screening the high-quality signal area is decomposed into several singular spectrum components. Perform Fourier transform on each singular spectrum component to obtain the spectrum of each singular spectrum component: Find the spectrum of each singular spectral component Is the peak value within the heart rate fluctuation range? If not, remove the singular spectrum component. If it is within the heart rate fluctuation range, the singular spectrum component is retained All the remaining singular spectral components Superposition And Perform Fourier transform to get Spectrum, searched The frequency corresponding to the peak in the spectrum is the heart rate value.

6. The non-contact heart rate measurement device according to claim 4, characterized in that: Also includes: The detection module is used to obtain image information using an image sensor, determine whether there is a face in the image information, and extract a facial image of the face when it is determined that there is a face.

7. A computer device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the non-contact heart rate measurement method according to any one of claims 1 to 3.

8. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable the computer to execute the non-contact heart rate measurement method according to any one of claims 1 to 3.

Images