Vital signs monitoring methods, related equipment and computer-readable storage media

Abstract

This application discloses a method, related equipment, and computer-readable storage medium for monitoring vital signs. The method is applied to a vital sign monitoring device, which includes an image acquisition unit, a feature extraction unit, and a processing unit connected in sequence. The method includes the following steps: acquiring at least one frame of a first facial image of a user performing exhalation and inhalation through the image acquisition unit; processing the first facial image through the feature extraction unit to obtain the user's vital sign data; and processing the user's vital sign data through the processing unit to obtain the user's health status. Implementing this application allows for convenient detection of a user's vital signs without the need for dedicated monitoring equipment, enabling users to understand their health status in real time and potentially preventing the occurrence of sudden illnesses to some extent.

Description

Technical Field

[0001] This application relates to the field of vital sign monitoring technology, and in particular to a vital sign monitoring method, related equipment and computer-readable storage medium. Background Technology

[0002] As society progresses and people's living standards improve, the medical system is also constantly evolving and becoming more humane. People are no longer satisfied with just hospital treatment; they demand real-time monitoring of their health at home. Currently, vital sign monitoring is of great significance for human work, study, and overall health, especially for individuals with potential health risks, where real-time monitoring and prevention are of paramount importance.

[0003] Typically, vital sign monitoring relies on authoritative equipment or monitoring devices in hospitals. Most of these devices are intended for patients and are generally bulky, inconvenient to carry, or expensive and inconvenient to use frequently. Although technological advancements have led to the development of many home-use or portable vital sign monitoring devices, users still need to visit a hospital to request a doctor's assistance in reviewing the collected vital sign data and providing appropriate treatment guidance. They cannot independently detect and manage abnormal health conditions. Therefore, providing a convenient way to monitor one's own vital signs is a pressing technical problem that needs to be solved. Summary of the Invention

[0004] This application provides a method, related equipment, and computer-readable storage medium for monitoring vital signs, which can conveniently detect a user's vital signs without the need for dedicated detection equipment.

[0005] In a first aspect, embodiments of this application provide a method for monitoring vital signs. This method is applied to a vital signs monitoring device, which includes an image acquisition unit, a feature extraction unit, and a processing unit connected in sequence. The method may include the following steps:

[0006] The image acquisition unit acquires at least one frame of a first facial image of the user performing exhalation and inhalation actions;

[0007] The first face image is processed by the feature extraction unit to obtain the user's vital signs data;

[0008] The processing unit processes the user's vital signs data to obtain the user's health status.

[0009] By implementing the embodiments of this application, the vital signs monitoring device can acquire a first facial image of the user during exhalation and inhalation through an image acquisition unit. Then, the first facial image is processed by a feature extraction unit to obtain the user's vital signs data. Finally, the user's vital signs data is processed by a processing unit to obtain the user's health status. In this way, the user's vital signs can be conveniently detected without the need for dedicated monitoring equipment, allowing the user to understand their health status in real time and potentially preventing the occurrence of sudden illnesses to some extent.

[0010] In one possible implementation, the vital signs monitoring device further includes a display unit connected to the processing unit; the method further includes:

[0011] The user's health status is displayed in the form of charts or curves through the display unit.

[0012] In one possible implementation, the step of processing the first face image through the feature extraction unit to obtain the user's vital sign data includes:

[0013] Extract the region of interest (ROI) from the first face image;

[0014] The region of interest (ROI) is masked to eliminate pixels containing noisy or insignificant PPG signals in the first face image, thereby obtaining a second face image.

[0015] Extract the user's vital signs data from the second facial image.

[0016] In one possible implementation, after masking the key region of interest (ROI) to eliminate pixels containing noisy or insignificant PPG signals in the first face image to obtain the second face image, the method further includes:

[0017] A third face image is obtained by enhancing the PPG signal contained in the second face image using a signal enhancement algorithm.

[0018] Extracting the user's vital signs data from the second facial image includes:

[0019] Extract the user's vital signs data from the third facial image.

[0020] In one possible implementation, the method further includes:

[0021] The processing unit outputs health recommendations based on the user's current health status or historical health status.

[0022] In one possible implementation, the step of outputting health recommendations based on the user's health status includes:

[0023] If the user's health condition is classified as Level 1 abnormal, a primary warning message will be output to alert them to seek immediate medical attention; or,

[0024] If the health condition is not classified as Level 1 abnormal, health recommendations are output based on the health condition that indicates an abnormality.

[0025] In one possible implementation, the user's vital signs data include at least one of heart rate, heart rate variability analysis, blood oxygen saturation, pressure, blood pressure, respiratory rate, and temperature.

[0026] Secondly, embodiments of this application provide a life monitoring system applied to a vital signs monitoring device. The vital signs monitoring device includes an image acquisition unit, a feature extraction unit, and a processing unit connected in sequence.

[0027] The image acquisition unit is used to acquire at least one frame of a first face image of a user performing exhalation and inhalation actions;

[0028] The feature extraction unit is used to process the first face image to obtain the user's vital signs data;

[0029] The processing unit is used to process the user's vital sign data to obtain the user's health status.

[0030] In one possible implementation, the vital signs monitoring device further includes a display unit connected to the processing unit, wherein...

[0031] The display unit is used to display the user's health status in the form of charts or curves.

[0032] In one possible implementation, the feature extraction unit includes a first extraction unit, a masking unit, and a second extraction unit; wherein,

[0033] The first extraction unit is used to extract the region of interest (ROI) in the first face image;

[0034] The masking unit is used to mask the region of interest (ROI) to eliminate pixels containing noise or insignificant PPG signals in the first face image, thereby obtaining a second face image.

[0035] The second extraction unit is used to extract the user's vital sign data from the second face image.

[0036] In one possible implementation, the feature extraction unit further includes a signal enhancement unit, which enhances the PPG signal contained in the second face image through a signal enhancement algorithm to obtain a third face image;

[0037] The second extraction unit is specifically used for:

[0038] Extract the user's vital signs data from the third facial image.

[0039] In one possible implementation, the processing unit is further configured to:

[0040] Output health recommendations based on the user's current health status or historical health status.

[0041] In one possible implementation, the processing unit is specifically used for:

[0042] If the user's health condition is classified as Level 1 abnormal, a primary warning message will be output to alert them to seek immediate medical attention; or,

[0043] If the health condition is not classified as Level 1 abnormal, health recommendations are output based on the health condition that indicates an abnormality.

[0044] In one possible implementation, the user's vital signs data include at least one of heart rate, heart rate variability analysis, blood oxygen saturation, pressure, blood pressure, respiratory rate, and temperature.

[0045] Thirdly, embodiments of this application provide an electronic device including a processor and a memory interconnected thereto, wherein the memory is used to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to execute the method described in the first aspect.

[0046] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program, the computer program including program instructions, which, when executed by a processor, cause the processor to perform the method described in the first aspect.

[0047] Fifthly, embodiments of this application also provide a computer program, the computer program including program instructions, which, when executed by a processor, cause the processor to perform the method described in the first aspect. Attached Figure Description

[0048] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below.

[0049] Figure 1 This is a schematic diagram of the architecture of a vital signs monitoring device provided in an embodiment of this application;

[0050] Figure 2 This is a flowchart illustrating a vital signs monitoring method provided in an embodiment of this application;

[0051] Figure 3 This is a schematic diagram of facial image processing provided in an embodiment of this application;

[0052] Figure 4 This is another schematic diagram of facial image processing provided in an embodiment of this application;

[0053] Figure 5 This is a schematic flowchart of a face image processing method provided in an embodiment of this application;

[0054] Figure 6 This is a schematic diagram of a health status display provided in an embodiment of this application;

[0055] Figure 7 This is another schematic diagram of health status display provided in an embodiment of this application;

[0056] Figure 8a This is a flowchart illustrating another vital sign monitoring method provided in an embodiment of this application;

[0057] Figure 8b This is a schematic diagram of the structure of a vital signs monitoring device provided in an embodiment of this application;

[0058] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0059] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0060] Typically, vital sign monitoring relies on authoritative hospital equipment or expensive, bulky monitoring devices. Most of these devices are intended for patients and are generally bulky, inconvenient to carry, or expensive and inconvenient to use frequently. Although technological advancements have led to the development of many home-use or portable vital sign monitoring devices, current devices merely collect the wearer's vital sign data in real time. Users still need to visit a hospital to request a doctor's assistance in reviewing the collected data and providing appropriate treatment guidance; they cannot provide self-monitoring for abnormal health conditions. Therefore, this application proposes a vital sign monitoring method, related equipment, and a computer-readable storage medium to address the aforementioned technical problems of the prior art.

[0061] The technical solution of this application and how it solves the above-mentioned technical problems will be described in detail below with specific embodiments. It should be noted that, for the convenience of explanation, the following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0062] The vital signs monitoring method provided in this application will be described in detail below with reference to the accompanying drawings.

[0063] like Figure 1 The diagram shown is a structural schematic of a vital signs monitoring device 10 provided in an embodiment of this application, including an image acquisition unit 11, a feature extraction unit 12, a processing unit 13, a display unit 14, and a storage unit 15. The image acquisition unit 11 may include a camera acquisition unit 110 and a facial image capture unit 111.

[0064] by Figure 1 Taking the vital signs monitoring equipment shown as an example, such as Figure 2 As shown, the vital signs monitoring method proposed in this application may include, but is not limited to, the following steps:

[0065] Step S101: Acquire a first face image of the user performing exhalation and inhalation actions using the image acquisition unit.

[0066] In this embodiment, the camera acquisition unit 110 records color images of a user performing exhalation and inhalation actions according to instructions within a short period of time. Here, the color images of the exhalation and inhalation actions can be multiple consecutive frames. Then, the facial image capture unit 111 processes the color images acquired by the camera using a machine learning model (e.g., a face recognition model) to determine the location of faces contained within the color images. Subsequently, image patches of the complete face image corresponding to the person are created using the obtained face locations.

[0067] Considering that not all color images acquired by the image acquisition unit 11 are used for feature extraction, the acquired color images can be filtered before feature extraction to obtain color images containing PPG signals. In this way, the impact of noise on PPG signals can be minimized, greatly improving the accuracy of vital sign monitoring.

[0068] Step S102: The first face image is processed by the feature extraction unit to obtain the user's vital signs data.

[0069] In some embodiments, the process of processing a first face image through a feature extraction unit to obtain the user's vital signs data may include: extracting a region of interest (ROI) from the first face image, wherein the ROI includes pixels of PPG signal; then, masking the ROI to eliminate noisy pixels or pixels with indistinct PPG signals contained in the first face image to obtain a second face image; and finally, extracting the user's vital signs data from the second face image.

[0070] In practical applications, computer vision algorithms can be used to identify Regions of Interest (ROIs) to estimate facial features, which can be location points of facial structures (e.g., eyes, nose, mouth, etc.). These location points are used as reference points to estimate the angle between the point and the camera. The surface normal to the point is calculated, and then the angle difference between the surface normal and the camera orientation is calculated. Afterward, a facial surface transformation is performed to map the angle of each location point onto a 2D map and fill in the pixels between the locations, followed by extrapolation. The resulting 2D map can then be used to estimate a mask representing the area on the face containing PPG signals, which has higher saliency due to its visibility to the camera. A specific implementation could be as follows... Figure 3 As shown, the changes in results that occur during execution can be as follows: Figure 4 As shown. Then, using the obtained mask, the Region of Interest (ROI) extracted from the first face image (i.e., the original face image) is masked through Boolean AND operations to eliminate noisy pixels or pixels with insignificant PPG signals contained in the first face image, resulting in a second face image. Thus, the user's vital signs data can be extracted from the second face image. In some embodiments, after obtaining the second face image, a signal enhancement algorithm can be used to enhance the PPG signal contained in the second face image to obtain a third face image, thereby allowing the extraction of the user's vital signs data from the third face image. Its specific implementation can be as follows... Figure 5 As shown. In practical applications, signal enhancement processing requires some facial features or changes in facial features over a period of time.

[0071] In this embodiment of the application, the user's vital signs data include at least one of heart rate, heart rate variability analysis, blood oxygen saturation, pressure, blood pressure, respiratory rate, and temperature.

[0072] Step S103: The processing unit processes the user's vital sign data to obtain the user's health status.

[0073] Understandably, a user's health status can be used to determine their risk of developing a certain disease. In practical applications, machine learning models can be used to process a user's vital sign data to determine their risk of developing a particular disease. In some embodiments, machine learning models can be used to analyze given vital sign data and improve the accuracy of estimating a user's risk of developing a certain disease, minimizing any possible errors. A health report for the user is then generated.

[0074] Step S104: Display the user's health status in the form of a chart or curve through the display unit.

[0075] For example, the user's health report displayed by the display unit 14 can be as follows: Figure 6 As shown.

[0076] For example, such as Figure 7 As shown, health reports can be displayed according to different functional systems of the human body.

[0077] In some embodiments, such as Figure 8a As shown, after executing step S103, step S105 can also be executed, which will be explained in detail below:

[0078] Step S105: The processing unit outputs health recommendations based on the user's health status or historical health status.

[0079] In some embodiments, health recommendations are output based on the user's health status, including:

[0080] If the user's health condition is classified as Level 1 abnormal, a primary warning message will be output to alert them to seek immediate medical attention; or,

[0081] If the health condition is not classified as Level 1 abnormal, health recommendations are output based on the health condition that indicates an abnormality.

[0082] In the embodiments of this application, by analyzing vital sign data, abnormal vital sign data and the level of abnormality can be accurately determined, and corresponding self-medication can be carried out according to the level of abnormality, effectively avoiding situations such as untimely rescue and delayed treatment when the body is abnormal.

[0083] Then, health advice can be output through display unit 14.

[0084] In some embodiments, the vital signs monitoring device can receive feedback from the user regarding their health status, and then store the user's health status and the user's feedback in the storage unit 15. Furthermore, the storage unit 15 can store the user's historical data, and the processing unit 13 can utilize this historical data to optimize algorithms to output more targeted health recommendations.

[0085] In summary, the vital signs monitoring device acquires a first facial image of the user during inhalation and exhalation using an image acquisition unit. Then, a feature extraction unit processes the facial image to obtain the user's vital signs data. Finally, a processing unit further processes this data to determine the user's health status. This method allows for convenient detection of vital signs without the need for dedicated monitoring equipment, enabling users to understand their health status in real time and potentially preventing the occurrence of sudden illnesses.

[0086] To facilitate better implementation of the methods described in the embodiments of this application, the embodiments of this application also describe methods related to the above. Figure 2 The method described in this embodiment is a structural schematic diagram of a vital signs monitoring device under the same inventive concept. For example... Figure 8b As shown, the vital signs monitoring device may include an image acquisition unit 801, a feature extraction unit 802, and a processing unit 803 connected in sequence, wherein,

[0087] The image acquisition unit 801 is used to acquire at least one frame of a first face image of a user performing exhalation and inhalation actions;

[0088] The feature extraction unit 802 is used to process the first face image to obtain the user's vital signs data;

[0089] The processing unit 803 is used to process the user's vital sign data to obtain the user's health status.

[0090] In one possible implementation, the vital signs monitoring device further includes a display unit 804 connected to the processing unit, wherein...

[0091] The display unit 804 is used to display the user's health status in the form of a chart or curve.

[0092] In one possible implementation, the feature extraction unit 802 includes a first extraction unit, a masking unit, and a second extraction unit; wherein,

[0093] The first extraction unit is used to extract the region of interest (ROI) in the first face image;

[0094] The masking unit is used to mask the region of interest (ROI) to eliminate pixels containing noise or insignificant PPG signals in the first face image, thereby obtaining a second face image.

[0095] The second extraction unit is used to extract the user's vital sign data from the second face image.

[0096] In one possible implementation, the feature extraction unit 802 further includes a signal enhancement unit, which enhances the PPG signal contained in the second face image through a signal enhancement algorithm to obtain a third face image;

[0097] The second extraction unit is specifically used for:

[0098] Extract the user's vital signs data from the third facial image.

[0099] In one possible implementation, the processing unit 803 is further configured to:

[0100] Output health recommendations based on the user's current health status or historical health status.

[0101] In one possible implementation, the processing unit 803 is specifically used for:

[0102] If the user's health condition is classified as Level 1 abnormal, a primary warning message will be output to alert them to seek immediate medical attention; or,

[0103] If the health condition is not classified as Level 1 abnormal, health recommendations are output based on the health condition that indicates an abnormality.

[0104] In one possible implementation, the user's vital signs data include at least one of heart rate, heart rate variability analysis, blood oxygen saturation, pressure, blood pressure, respiratory rate, and temperature.

[0105] It is understood that the functions of each functional unit of the vital signs monitoring device in this embodiment can be based on the above. Figure 2 The specific implementation of the method in the illustrated method embodiment can be referred to the relevant description of the above method embodiment, and will not be repeated here.

[0106] To facilitate better implementation of the above-described solutions in the embodiments of this application, this application also provides another electronic device, which will be described in detail below with reference to the accompanying drawings:

[0107] like Figure 9The diagram illustrates the structure of an electronic device provided in this embodiment. The electronic device 90 may include a processor 901, a memory 904, and a communication module 905, which are interconnected via a bus 906. Further, the electronic device 90 may be equipped with a camera or webcam to acquire facial images of a user performing inhalation and exhalation. The memory 904 may be a high-speed random access memory (RAM) or a non-volatile memory, such as at least one disk drive. Optionally, the memory 904 may also be at least one storage system located remotely from the aforementioned processor 901. The memory 904 stores application code and may include an operating system, a network communication module, a user interface module, and a data processing program. The communication module 905 is used for information interaction with external devices. The processor 901 is configured to call the program code and execute the following steps:

[0108] Acquire at least one frame of the user's face image during exhalation and inhalation;

[0109] The first facial image is processed to obtain the user's vital signs data;

[0110] The user's vital signs data are processed to obtain the user's health status.

[0111] The processor 901 is also used for:

[0112] The user's health status is displayed in the form of a chart or curve.

[0113] The processor 901 processes the first facial image to obtain the user's vital signs data, including:

[0114] Extract the region of interest (ROI) from the first face image;

[0115] The region of interest (ROI) is masked to eliminate pixels containing noisy or insignificant PPG signals in the first face image, thereby obtaining a second face image.

[0116] Extract the user's vital signs data from the second facial image.

[0117] The processor 901 masks the key region of interest (ROI) to eliminate pixels containing noisy or insignificant PPG signals in the first face image. After obtaining the second face image, the processor further includes:

[0118] A third face image is obtained by enhancing the PPG signal contained in the second face image using a signal enhancement algorithm.

[0119] Extracting the user's vital signs data from the second facial image includes:

[0120] Extract the user's vital signs data from the third facial image.

[0121] The processor 901 is also used for:

[0122] Output health recommendations based on the user's current health status or historical health status.

[0123] The processor 901 outputs health recommendations based on the user's health status, including:

[0124] If the user's health condition is classified as Level 1 abnormal, a primary warning message will be output to alert them to seek immediate medical attention; or,

[0125] If the health condition is not classified as Level 1 abnormal, health recommendations are output based on the health condition that indicates an abnormality.

[0126] The user's vital signs data include at least one of heart rate, heart rate variability analysis, blood oxygen saturation, pressure, blood pressure, respiratory rate, and temperature.

[0127] It should be noted that the execution steps of the processor in the electronic device 90 in this application embodiment can be referred to the above method embodiments. Figure 2 The specific implementation of the vital signs monitoring device in the embodiment will not be described in detail here.

[0128] It should be understood that the application scenarios applicable to the methods provided in the embodiments of this application are only examples and are not limited to these in actual applications.

[0129] It should also be understood that the first, second, third and various numerical designations used in this application are merely distinctions for ease of description and are not intended to limit the scope of this application.

[0130] It should be understood that the term "and / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Furthermore, the character " / " in this application generally indicates that the preceding and following related objects have an "or" relationship.

[0131] Furthermore, in the various embodiments of this application, the order of the above-mentioned process numbers does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0132] Those skilled in the art will recognize that the units and method steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0133] Those skilled in the art will understand that, for the sake of convenience and brevity, the above-described division of functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0134] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules and units is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0135] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of this application, depending on actual needs.

[0136] Furthermore, the functional units involved in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units described above can be implemented in hardware or as software functional units, and this application does not limit this.

[0137] This invention also provides a computer storage medium storing instructions that, when executed on a computer or processor, cause the computer or processor to perform one or more steps of the method described in any of the above embodiments. If the constituent modules of the above-described apparatus are implemented as software functional units and sold or used as independent products, they can be stored in the computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a computer-readable storage medium.

[0138] The aforementioned computer-readable storage medium can be an internal storage unit of the server described in the foregoing embodiments, such as a hard disk or memory. Alternatively, it can be an external storage device for the server, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, the aforementioned computer-readable storage medium may include both internal and external storage units of the server. The aforementioned computer-readable storage medium is used to store the aforementioned computer program and other programs and data required by the server. It can also be used to temporarily store data that has been output or will be output.

[0139] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed, the program can include the processes of the embodiments of the methods described above. The aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0140] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0141] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0142] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for monitoring vital signs, characterized in that, The method is applied to a vital signs monitoring device, which includes an image acquisition unit, a feature extraction unit, and a processing unit connected in sequence. The method includes: The image acquisition unit acquires at least one frame of a first facial image of the user performing exhalation and inhalation; the feature extraction unit processes the first facial image to obtain the user's vital sign data, including: The system identifies regions of interest to estimate facial feature locations, which are used as reference points to assess the angle between the point and the camera. A facial surface transformation is performed by calculating the surface normal at each location and then the angle difference between the surface normal and the camera. This maps the angle of each location onto a 2D map and fills in the pixels between the locations. Extrapolation is then performed to generate a mask representing the area of ​​the face containing PPG signals. Next, the user's vital signs data are extracted. The processing unit then processes the user's vital signs data to determine the user's health status.

2. The method according to claim 1, characterized in that, The vital signs monitoring device further includes a display unit connected to the processing unit; the method further includes: The user's health status is displayed in the form of charts or curves through the display unit.

3. The method according to claim 1, characterized in that, The step of processing the first face image through the feature extraction unit to obtain the user's vital sign data further includes: The region of interest (ROI) is masked to eliminate pixels containing noisy or insignificant PPG signals in the first face image, thereby obtaining a second face image. Extract the user's vital signs data from the second facial image.

4. The method according to claim 3, characterized in that, After masking the region of interest (ROI) to eliminate noisy pixels or pixels with insignificant PPG signals in the first face image to obtain the second face image, the method further includes: A third face image is obtained by enhancing the PPG signal contained in the second face image using a signal enhancement algorithm. Extracting the user's vital signs data from the second facial image includes: Extract the user's vital signs data from the third facial image.

5. The method according to claim 1, characterized in that, The method further includes: The processing unit outputs health recommendations based on the user's current health status or historical health status.

6. The method according to claim 5, characterized in that, The step of outputting health recommendations based on the user's health status includes: If the user's health condition is classified as Level 1 abnormal, a primary warning message will be output to alert them to seek immediate medical attention; or, If the health condition is not classified as Level 1 abnormal, health recommendations are output based on the health condition that indicates an abnormality.

7. The method according to any one of claims 1-6, characterized in that, The user's vital signs data include at least one of heart rate, heart rate variability analysis, blood oxygen saturation, pressure, blood pressure, respiratory rate, and temperature.

8. A vital signs monitoring system, characterized in that, This is applied to a vital signs monitoring device, which includes an image acquisition unit, a feature extraction unit, and a processing unit connected in sequence. The image acquisition unit is used to acquire at least one frame of a first face image of a user performing exhalation and inhalation actions; The feature extraction unit is used to process the first face image to obtain the user's vital sign data, including: The system identifies regions of interest to estimate facial feature locations, which are used as reference points to assess the angle between the point and the camera. A facial surface transformation is performed by calculating the surface normal at each point and then the angle difference between the surface normal and the camera. The angle of each location is mapped onto a 2D map, and pixels between the locations are filled. Extrapolation is then performed to generate a mask representing the area of ​​the face containing PPG signals. Next, the user's vital signs data are extracted. The processing unit processes the user's vital signs data to obtain the user's health status.

9. An electronic device, characterized in that, The device includes a processor and a memory interconnected thereto, wherein the memory is used to store a computer program, the computer program including program instructions, and the processor is configured to invoke the program instructions to perform the method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause the processor to perform the method as described in any one of claims 1-7.

Images