Health condition monitoring method, storage medium and electronic device

Abstract

The invention discloses a health condition monitoring method, a storage medium and an electronic device, and relates to the technical field of smart home / smart home, and the health condition monitoring method comprises the steps: obtaining user face data collected by one or more smart home devices with image collection devices through a face recognition technology; obtaining user state evaluation data according to the user face data; wherein the user state evaluation data comprises one or combination data of more of the following data: user physiological data, user skin state data and user emotional state data; and performing health state evaluation according to the user state evaluation data to obtain a user health state evaluation result. According to the health condition monitoring method, the storage medium and the electronic device provided by the invention, the convenience and efficiency of health monitoring are improved, and the comprehensiveness and accuracy of health monitoring are improved.

Description

Technical Field

[0001] This application relates to the technical field of smart home / smart family, and particularly to a health condition monitoring method, a storage medium, and an electronic device. Background Art

[0002] In the field of health monitoring, traditional health monitoring methods usually require dedicated health monitoring devices or complex biological sample collection processes, which consume a large amount of time and resources, are not convenient, and the conclusions that can be analyzed from the collected data are also limited. In addition, these methods may not be suitable for everyone, such as the elderly or chronic disease patients who are unable to undergo regular medical examinations.

[0003] The existing means of smart home health monitoring mainly include using devices such as smart bracelets, smart watches, and smart weighing scales for health monitoring. These devices can detect users' physiological data, such as heart rate, blood pressure, sleep quality, etc., through built-in sensors and algorithms, so as to help users understand their health conditions.

[0004] However, the existing means of smart home health monitoring have some defects. First, these devices usually require users to actively wear or use them, and need to be charged and maintained regularly, which will reduce users' compliance and usage experience. Second, the physiological data collected by these devices are often only one aspect of users' health conditions and cannot comprehensively reflect users' health conditions. Therefore, there may be missed detections or false detections, and the conclusions that can be analyzed from these numerical data are very limited.

[0005] Therefore, improving the convenience and efficiency of health monitoring, as well as improving the comprehensiveness and accuracy of health monitoring, have become problems to be solved urgently. Summary of the Invention

[0006] This application provides a health condition monitoring method, a storage medium, and an electronic device to solve the defects of poor convenience and low efficiency in health monitoring, as well as poor comprehensiveness and low accuracy in health monitoring in the prior art, and to achieve improving the convenience and efficiency of health monitoring, as well as improving the comprehensiveness and accuracy of health monitoring.

[0007] This application provides a health condition monitoring method, including: obtaining user face data collected by one or more smart home devices with image acquisition devices through face recognition technology; obtaining user status evaluation data according to the user face data; wherein, the user status evaluation data includes combined data of one or more of the following data: user physiological data, user skin state data, and user emotional state data; performing a health status evaluation according to the user status evaluation data to obtain a user health status evaluation result.

[0008] A health status monitoring method provided by the present application, the method further includes: predicting the health status according to the user status evaluation data to obtain a user health status prediction result.

[0009] A health status monitoring method provided by the present application, the predicting the health status according to the user status evaluation data includes: performing regression analysis on the user status evaluation data through a time series model for health status prediction.

[0010] A health status monitoring method provided by the present application, the smart home device with an image acquisition device includes a smart screen and / or a smart mirror.

[0011] A health status monitoring method provided by the present application, the method further includes: automatically adjusting the device parameters of the smart home device according to at least one of the user status evaluation data, the user health status evaluation result, and the user health status prediction result.

[0012] A health status monitoring method provided by the present application, the method further includes: giving at least one piece of feedback information such as diet advice, exercise advice, skin care advice, rest advice, and medical advice according to the user health status evaluation result and the user health status prediction result.

[0013] A health status monitoring method provided by the present application, before evaluating the health status according to the user status evaluation data, the method further includes: collecting user physiological data through at least one physiological signal collection device other than the smart home device with an image acquisition device, and supplementing the user physiological data collected by the smart home device with an image acquisition device to obtain updated user physiological data.

[0014] A health status monitoring method provided by the present application, the supplementing the user physiological data collected by the smart home device with an image acquisition device to obtain updated user physiological data includes: obtaining the same type of data in the user physiological data collected by the physiological signal collection device and the smart home device; retaining the same type of data collected by the physiological signal collection device and removing the same type of data collected by the smart home device; taking the union of the user physiological data collected by the physiological signal collection device and the user physiological data collected by the smart home device to obtain the updated user physiological data.

[0015] A health status monitoring method provided by the present application, the obtaining the user status evaluation data according to the user face data includes: performing health data clustering analysis on the user face data based on a machine learning model to obtain the user status evaluation data.

[0016] A health condition monitoring method provided by the present application, the method further includes: using the same type of data collected by the physiological signal acquisition device to assist in training the machine learning model.

[0017] A health condition monitoring method provided by the present application, before obtaining the user status evaluation data according to the user face data, the method further includes: adjusting the brightness value of the face image in the user face data to a preset brightness value.

[0018] A health condition monitoring method provided by the present application, before obtaining the user face data collected by one or more smart home devices with image acquisition devices through face recognition technology, the method further includes: obtaining the personal information data registered by the user; collecting the user multi-angle facial image data; saving the personal information data and the user multi-angle facial image data as user identity information.

[0019] The present application further provides a health condition monitoring device, including: a first acquisition module, configured to: acquire user face data collected by one or more smart home devices with image acquisition devices through face recognition technology; a second acquisition module, configured to: obtain user status evaluation data according to the user face data; wherein, the user status evaluation data includes a combined data of one or more of the following data: user physiological data, user skin status data, and user emotion status data; a health monitoring module, configured to: perform a health status evaluation according to the user status evaluation data to obtain a user health status evaluation result.

[0020] The present application further provides an electronic device, including a memory and a processor, a computer program is stored in the memory, and the processor is configured to execute the computer program to implement the health condition monitoring method as described in any one of the above.

[0021] The present application further provides a computer-readable storage medium, the computer-readable storage medium includes a stored program, wherein, when the program runs, it executes to implement the health condition monitoring method as described in any one of the above.

[0022] The present application further provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the health condition monitoring method as described in any one of the above.

[0023] The health condition monitoring method, storage medium and electronic device provided by this application obtain user face data collected by one or more smart home devices with image acquisition devices through face recognition technology, and obtain user status evaluation data according to the user face data. The user status evaluation data includes combined data of one or more of the following data: user physiological data, user skin condition data, and user emotional state data. Health condition evaluation is performed according to the user status evaluation data to obtain a user health condition evaluation result, which improves the convenience and efficiency of health monitoring, as well as the comprehensiveness and accuracy of health monitoring. Description of the Drawings

[0024] The drawings here are incorporated into the specification and form a part of this specification, showing embodiments consistent with this application, and are used together with the specification to explain the principles of this application.

[0025] To more clearly illustrate the technical solutions in the embodiments of this application or in the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0026] Figure 1 It is a schematic diagram of the hardware environment of a health condition monitoring method according to an embodiment of this application;

[0027] Figure 2 It is one of the flow schematic diagrams of the health condition monitoring method provided by an embodiment of this application;

[0028] Figure 3 It is a schematic diagram of the health data obtained in the health condition monitoring method provided by an embodiment of this application;

[0029] Figure 4 It is the second flow schematic diagram of the health condition monitoring method provided by an embodiment of this application;

[0030] Figure 5 It is the third flow schematic diagram of the health condition monitoring method provided by an embodiment of this application;

[0031] Figure 6 It is a schematic diagram of the structure of the health condition monitoring device provided by an embodiment of this application;

[0032] Figure 7 It is a schematic diagram of the structure of the electronic device provided by an embodiment of this application;

[0033] Figure 8 It is a schematic diagram of the structure of the electronic device provided by this application. Detailed Embodiments

[0034] To enable those skilled in the art to better understand the solution of this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0035] It should be noted that the terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of this application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0036] According to one aspect of the embodiments of this application, a health status monitoring method is provided. This health status monitoring method is widely applied to whole-house intelligent digital control application scenarios such as Smart Home, smart home, smart home appliance ecosystem, and Intelligence House ecosystem. Optionally, in this embodiment, the above-mentioned health status monitoring method can be applied to, for example Figure 1 the hardware environment composed of the terminal device 102 and the server 104 as shown. As Figure 1 shown, the server 104 is connected to the terminal device 102 through a network, and can be used to provide services (such as application services, etc.) for the terminal or the client installed on the terminal. A database can be set on the server or independently of the server to provide data storage services for the server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data operation services for the server 104.

[0037] The above network may include, but is not limited to, at least one of the following: a wired network, a wireless network. The above wired network may include, but is not limited to, at least one of the following: a wide area network, a metropolitan area network, a local area network. The above wireless network may include, but is not limited to, at least one of the following: WIFI (Wireless Fidelity), Bluetooth. The terminal device 102 may not be limited to a PC, a mobile phone, a tablet computer, a smart air conditioner, a smart range hood, a smart refrigerator, a smart oven, a smart stove, a smart washing machine, a smart water heater, a smart washing device, a smart dishwasher, a smart projection device, a smart TV, a smart clothes hanger, a smart curtain, a smart audio and video device, a smart socket, a smart speaker, a smart sound box, a smart fresh air device, a smart kitchen and bathroom device, a smart bathroom device, a smart floor sweeping robot, a smart window cleaning robot, a smart mopping robot, a smart air purification device, a smart steam box, a smart microwave oven, a smart kitchen water heater, a smart purifier, a smart water dispenser, a smart door lock, etc.

[0038] Figure 2 is one of the schematic flowcharts of the health status monitoring method provided by the embodiments of the present application. As Figure 2 shown, the method includes:

[0039] Step S1, obtain user face data collected by one or more smart home devices with image acquisition devices through face recognition technology.

[0040] Obtain user face data collected by one or more smart home devices with image acquisition devices in the smart home device. The user face data can be collected and stored when the user passes by or uses the smart home device with an image acquisition device, making the user unaware. Among them, according to different analysis data, the user face data can be user face video data or user face image data. The user face image data can also be obtained according to the collected user face video data.

[0041] Step S2, obtain user status evaluation data according to the user face data; wherein, the user status evaluation data includes a combined data of one or more of the following data: user physiological data, user skin state data, and user emotional state data.

[0042] Obtain user status evaluation data according to the obtained user face data. The user status evaluation data includes at least one of user physiological data, user skin state data, and user emotional state data, realizing comprehensive collection of health data and helping to improve the comprehensiveness and accuracy of health monitoring.

[0043] Figure 3It is a schematic diagram of health data obtained in the health status monitoring method provided by an embodiment of the present application. User physiological data, user skin condition data, and user emotional state data can be collectively referred to as health data. These data can be used for inference and training of a deep learning model, and further monitor the health status of the user.

[0044] Among them, user physiological data may include blood vessel diameter, blood vessel color, heart rate, blood pressure, blood oxygen saturation, and exercise data; user skin condition data may include oiliness (cheeks, T-zone, forehead, chin), smoothness, dark circles (pigment type, vascular type, structural type), acne, blackheads, and relevant data of skin color; user emotional state data may include data indicating emotional states such as happiness, sadness, anger, fear, and surprise.

[0045] Step S3: Perform a health status assessment based on the user status evaluation data to obtain a user health status assessment result.

[0046] Perform a health status assessment based on the user status evaluation data to obtain a user health status assessment result. The user status evaluation data can be input into a machine learning prediction model to output a user health status assessment result.

[0047] The health status monitoring method provided by an embodiment of the present application collects user face data through face recognition technology by obtaining one or more smart home devices with image acquisition devices, obtains user status evaluation data according to the user face data, and the user status evaluation data includes a combination of one or more of the following data: user physiological data, user skin condition data, and user emotional state data. Perform a health status assessment based on the user status evaluation data to obtain a user health status assessment result, improving the convenience and efficiency of health monitoring, as well as improving the comprehensiveness and accuracy of health monitoring.

[0048] According to a health status monitoring method provided by an embodiment of the present application, the method further includes: performing a health status prediction based on the user status evaluation data to obtain a user health status prediction result.

[0049] To improve the quality of health monitoring, the embodiment of the present application not only monitors the current health status of the user, but also predicts the future health status. A health status prediction can be performed based on the user status evaluation data to obtain a user health status prediction result. A combination of medical knowledge and machine learning and deep learning algorithm models can be used to comprehensively evaluate and predict the health status of the user.

[0050] The health status monitoring method provided by an embodiment of the present application improves the quality of health status monitoring by performing a health status prediction based on the user status evaluation data to obtain a user health status prediction result.

[0051] According to a health status monitoring method provided by an embodiment of the present application, the health status prediction based on the user status evaluation data includes: performing regression analysis on the user status evaluation data through a time series model to predict the health status.

[0052] When predicting the health status based on the user status evaluation data, the health status can be predicted by performing regression analysis on the user status evaluation data through a time series model to monitor the changing trend of the user's health status.

[0053] Because facial status data is more complex and changes more subtle than indicators such as blood pressure and blood oxygen, time series modeling of facial data can reveal the potential changing patterns of users' health status, and may predict possible physical problems in the future in advance, thus providing protection for users' physical health.

[0054] The health status monitoring method provided in the embodiment of the present application predicts the health status by performing regression analysis on the user status assessment data through a time series model, thereby improving the accuracy of the health status prediction.

[0055] According to a health status monitoring method provided in an embodiment of the present application, the smart home device with an image acquisition device includes a smart screen and / or a smart mirror.

[0056] Smart home devices with image acquisition devices for user face data acquisition include smart screens and / or smart mirrors. Among them, smart screens include refrigerator screens and central control screens, and smart mirrors include fitting mirrors, makeup mirrors, and bathroom mirrors. When users pass by or use smart screens and / or smart mirrors, user face data can be collected and stored, so that users do not feel it.

[0057] The health status monitoring method provided in the embodiment of the present invention further improves the convenience of health status monitoring by collecting user facial data using a smart screen and / or a smart mirror.

[0058] According to a health status monitoring method provided in an embodiment of the present application, the method also includes: automatically adjusting device parameters of smart home devices according to at least one of the user status evaluation data, the user health status evaluation results and the user health status prediction results.

[0059] The device parameters of the smart home device can be automatically adjusted according to at least one of the user status evaluation data, the user health status evaluation results and the user health status prediction results to provide a more comfortable and healthy living environment.

[0060] For example, according to the user's health condition and facial features, automatically adjust the parameters of smart home devices. Specifically, adjust the parameters of indoor lighting, music, etc. according to the user's complexion and eye expression to provide a more comfortable environment. Another example is to adjust the operating parameters of devices such as air conditioners and heaters according to the user's health condition and exercise volume to provide a healthier living environment.

[0061] The parameters of smart home devices can be adjusted according to any one or any combination of different user status evaluation data, user health status evaluation results, and user health status prediction results. It may include:

[0062] Adjust the lighting: Soft lighting can create a comfortable environment and help relax the body and mind. The color temperature and brightness of smart bulbs can be adjusted, and soft warm tones or natural white light can be selected to reduce eye fatigue and tension. At the same time, add some areas of local lighting, such as reading lights or workbench lights, to provide sufficient illumination.

[0063] Adjust the temperature and humidity: Comfortable indoor temperature and humidity help relieve fatigue and dryness. The indoor temperature and humidity can be adjusted through a smart air conditioner or humidifier. Keep the temperature appropriate, usually between 20°C and 24°C; at the same time, keep the relative humidity between 40% and 60% to avoid dry skin and respiratory tract.

[0064] Adjust the music: Music can bring a feeling of relaxation and pleasure, helping to relieve stress and fatigue. Some soothing music or natural sounds can be selected, such as gentle piano music, the sounds of nature, etc. Music can be played through a smart speaker or a mobile application.

[0065] Adjust the smart mattress: The smart mattress can provide personalized support and comfort adjustment. It can automatically adjust the hardness and angle of the mattress according to an individual's body shape, sleeping posture, and preferences. This helps to provide better sleep quality, thereby relieving fatigue and discomfort.

[0066] The health condition monitoring method provided by the embodiments of the present application can automatically adjust the device parameters of smart home devices according to at least one of user status evaluation data, user health status evaluation results, and user health status prediction results. It can achieve automatic and unobtrusive control of smart home devices according to the user's health condition, create a more comfortable home environment, and significantly improve the user experience.

[0067] According to a health condition monitoring method provided by the embodiments of the present application, the method further includes: giving at least one piece of feedback information such as diet advice, exercise advice, skin care advice, rest advice, and medical advice according to the user health status evaluation result and the user health status prediction result.

[0068] At least one piece of feedback information such as diet advice, exercise advice, skin care advice, rest advice, and medical advice can be given based on the user's health status assessment result and the user's health status prediction result to improve the user's quality of life and further enhance the user experience.

[0069] Example 1:

[0070] Physical condition: A 60-year-old retired elderly person suffering from hypertension and diabetes, who usually needs to take multiple medications to control the condition.

[0071] Diet advice: It is recommended that the elderly person maintain a healthy eating habit, such as controlling salt intake, avoiding high-sugar, high-fat, and high-cholesterol foods, and eating more fresh vegetables, fruits, whole grains, and protein sources. At the same time, it is necessary to discuss the diet plan with the doctor regularly to ensure the interaction between medications and diet.

[0072] Exercise advice: It is recommended that the elderly person perform moderate aerobic exercises, such as walking, jogging, swimming, etc., to improve cardiopulmonary function and enhance muscle strength. In addition, some light strength training, such as using dumbbells for muscle exercise, can also be carried out. The doctor should be consulted before exercise to ensure the safety and rationality of exercise.

[0073] Rest advice: It is recommended that the elderly person maintain sufficient sleep, with 7-8 hours of sleep time per day, and try to maintain a regular schedule. At the same time, some relaxation activities, such as meditation, yoga, etc., can also be carried out to relieve stress and anxiety.

[0074] Medical advice: It is recommended that the elderly person consult the doctor regularly to monitor the development of the condition and the effect of the medications. At the same time, regular physical examinations are also required, including the detection of indicators such as blood pressure, blood sugar, blood lipids, and the examination of cardiopulmonary function and kidney function. If the condition shows abnormalities or discomfort, medical treatment should be sought in a timely manner.

[0075] Example 2:

[0076] Physical condition: A 25-year-old office worker who usually lacks exercise and often feels fatigued and has low back pain.

[0077] Diet advice: It is recommended that the office worker maintain a balanced diet, including a variety of vegetables, fruits, whole grains, protein sources, and healthy fats. At the same time, try to reduce the intake of high-sugar, high-fat, and high-salt foods. Maintain sufficient water intake to maintain the body's water balance.

[0078] Exercise advice: It is recommended that the office worker perform at least 150 minutes of moderate-intensity aerobic exercise per week, such as brisk walking, running, swimming, etc. At the same time, some muscle exercises and stretching exercises can also be carried out to enhance muscle strength and flexibility.

[0079] Rest suggestions: It is recommended that the employee maintain a regular schedule and get 7-8 hours of sleep every day. During work, short breaks can be taken, such as getting up and walking around or doing relaxation activities like deep breathing every hour. Avoid maintaining the same posture for a long time, such as sitting for a long time or looking down at the phone for a long time.

[0080] Medical advice: It is recommended that the employee have a physical examination to rule out potential health problems. If feeling fatigued and experiencing lower back pain and soreness, a simple physical examination can be done first, such as measuring indicators like blood pressure, blood sugar, and heart rate. If the symptoms persist or worsen, it is recommended to consult a doctor and have a more comprehensive physical examination to determine the cause and develop corresponding treatment plans. At the same time, some self-regulation can also be carried out, such as improving sleep quality and increasing physical activity.

[0081] The health status monitoring method provided by the embodiments of the present application further improves the user experience by giving at least one piece of feedback information such as diet advice, exercise advice, skin care advice, rest advice, and medical advice based on the user health status evaluation result and the user health status prediction result.

[0082] According to a health status monitoring method provided by the embodiments of the present application, before performing the health status evaluation based on the user status evaluation data, the method further includes: collecting user physiological data through at least one physiological signal collection device other than the smart home device with an image collection device, and supplementing the user physiological data collected by the smart home device with an image collection device to obtain updated user physiological data.

[0083] Perform a health status evaluation based on the user status evaluation data to obtain a user health status evaluation result. Perform a health status prediction based on the user status evaluation data to obtain a user health status prediction result. Among them, the user status evaluation data includes combined data of one or more of the following data: user physiological data, user skin status data, and user emotional status data.

[0084] Among them, the user physiological data includes user physiological data obtained from the user face data collected by the smart home device with an image collection device, and also includes user physiological data collected by a physiological signal collection device other than the smart home device with an image collection device.

[0085] The physiological signal acquisition device other than the smart home device with an image acquisition device can be other traditional health monitoring devices, such as smart bracelets, smart watches, body fat scales, etc., to assist in acquiring user physiological data, such as heart rate, blood pressure, sleep quality, body fat, exercise amount, etc. These data provide an auxiliary reference for identifying the user's health information through facial recognition, and the two together provide a decision-making basis for predicting the user's health status and providing advice and reminders. Such devices require the user to wear them continuously for a long time to ensure the accuracy of the data.

[0086] The user data collected by the physiological signal acquisition device and the user data obtained through facial recognition together build a complete and comprehensive portrait of the user's health status. The data collected solely by traditional health monitoring devices cannot comprehensively determine the potential problems of the user's body. By combining facial recognition with traditional monitoring indicators, it is possible to more comprehensively monitor and guarantee the user's health status.

[0087] The health status monitoring method provided by the embodiments of the present application collects user physiological data through at least one physiological signal acquisition device other than the smart home device with an image acquisition device, and supplements the user physiological data collected by the smart home device with an image acquisition device to obtain updated user physiological data, thereby improving the accuracy and comprehensiveness of health status monitoring.

[0088] According to a health status monitoring method provided by an embodiment of the present application, the step of supplementing the user physiological data collected by the smart home device with an image acquisition device to obtain updated user physiological data includes: obtaining the same type of data in the user physiological data collected by the physiological signal acquisition device and the smart home device; retaining the same type of data collected by the physiological signal acquisition device and removing the same type of data collected by the smart home device; taking the union of the user physiological data collected by the physiological signal acquisition device and the user physiological data collected by the smart home device to obtain the updated user physiological data.

[0089] The user physiological data obtained based on the user's face data and the user physiological data collected through the physiological signal acquisition device may include the same type of data. For example, by analyzing the user's face data, heart rate and blood pressure can be obtained, and heart rate and blood pressure can also be obtained through the physiological signal acquisition device. Since the measurement results of the physiological signal acquisition device are relatively more accurate, for the same type of data in the user physiological data collected by the physiological signal acquisition device and the smart home device, retain the same type of data collected by the physiological signal acquisition device, remove the same type of data collected by the smart home device, and take the union of the user physiological data collected by the physiological signal acquisition device and the user physiological data collected by the smart home device to obtain the updated user physiological data.

[0090] The health status monitoring method provided by the embodiments of the present application obtains the same type of data in the user physiological data collected by the physiological signal acquisition device and the smart home device, retains the same type of data collected by the physiological signal acquisition device, removes the same type of data collected by the smart home device, and takes the union of the user physiological data collected by the physiological signal acquisition device and the user physiological data collected by the smart home device to obtain the updated user physiological data, which improves the accuracy and comprehensiveness of the user physiological data and further improves the accuracy and comprehensiveness of the health status monitoring.

[0091] According to a health status monitoring method provided by the embodiments of the present application, obtaining user status evaluation data according to the user face data includes: performing health data clustering analysis on the user face data based on a machine learning model to obtain the user status evaluation data.

[0092] The user status evaluation data can be obtained according to the user face data through a machine learning model, that is, inputting the user face data into the trained machine learning model for health data clustering analysis to obtain the user status evaluation data.

[0093] The health status monitoring method provided by the embodiments of the present application performs health data clustering analysis on the user face data based on a machine learning model to obtain the user status evaluation data, which improves the efficiency and accuracy of data acquisition.

[0094] According to a health status monitoring method provided by the embodiments of the present application, the method further includes: using the same type of data collected by the physiological signal acquisition device to assist in training the machine learning model.

[0095] The face recognition technology plays a major role in the collection of health data. It is responsible for collecting all the data of skin status and emotional status, and is responsible for collecting part of the physiological data (mainly identifying the color and diameter of the subcutaneous blood vessels on the face). The blood vessel data can be used to calculate the heart rate and blood pressure, which is more convenient and efficient for people who are unwilling to wear smart watches or do not have blood pressure monitors at home.

[0096] To improve the accuracy of the machine learning model and output more accurate data, the same type of data collected by the physiological signal acquisition device can be used to assist in training the machine learning model to enhance the learning ability of the machine learning model.

[0097] The health status monitoring method provided by the embodiments of the present application uses the same type of data collected by the physiological signal acquisition device to assist in training the machine learning model, improves the performance of the machine learning model, enhances the accuracy of the data output by the machine learning model, and thus improves the accuracy of health monitoring.

[0098] According to a health condition monitoring method provided by an embodiment of the present application, before obtaining user status evaluation data based on the user's face data, the method further includes: adjusting the brightness value of the face image in the user's face data to a preset brightness value.

[0099] To avoid the influence of ambient light on the application of user face data, before obtaining user status evaluation data based on the user face data, the brightness value of the face image in the user face data is adjusted to a preset brightness value. Additionally, other cleaning and processing can be performed on the user face data.

[0100] The health condition monitoring method provided by an embodiment of the present application improves the anti-interference ability of health condition monitoring by adjusting the brightness value of the face image in the user face data to a preset brightness value.

[0101] According to a health condition monitoring method provided by an embodiment of the present application, before obtaining user face data collected by one or more smart home devices with image acquisition devices through face recognition technology, the method further includes: obtaining personal information data registered by the user; collecting multi-angle facial image data of the user; and saving the personal information data and the multi-angle facial image data of the user as user identity information.

[0102] The user registers information (including user portrait data such as age, gender, blood type, etc. that remains unchanged for a long time, and the collection of these data is also for better personalized health condition assessment and prediction of each user) in a smart home system (such as a smart home application or a central control screen). According to the user's registration information, personal information data registered by the user is obtained, and the user's multi-angle facial images are automatically collected. The personal information data and the multi-angle facial image data of the user are saved as user identity information. Among them, feature extraction and comparison are performed on the user's facial images through face recognition technology to confirm the user's identity, and the personal information data and the multi-angle facial image data of the user are stored in the system as user identity information for distinguishing different users.

[0103] When registering, the user sets a user account and can bind smart home devices used to collect physiological data to the user account to obtain third user physiological data.

[0104] The health condition monitoring method provided by an embodiment of the present application realizes the registration of user information and facilitates the distinction of different users by obtaining personal information data registered by the user, collecting multi-angle facial image data of the user, and saving the personal information data and the multi-angle facial image data of the user as user identity information.

[0105] Figure 4This is the second flowchart of the health status monitoring method provided by the embodiments of the present application. As Figure 4 shown, the method includes:

[0106] Input the user's physiological data, skin condition data, and emotional state data into the prediction model to obtain the prediction information output by the prediction model, where the prediction information includes: the user's current health status and potential problems that may occur in the body;

[0107] Provide personalized diet, exercise, rest, and medical advice for the user according to the user's current health status and potential problems in the body, and adaptively adjust the parameters of the smart home devices to create a more comfortable living environment for the user.

[0108] Among them, the prediction model can adopt models such as deep learning and time series.

[0109] Figure 5 This is the third flowchart of the health status monitoring method provided by the embodiments of the present application. As Figure 5 shown, the method includes:

[0110] The user registers personal information in the smart home system, and the system automatically collects multi-angle facial images of the user and stores the user identity information in the system;

[0111] Collect the user's health data through various sensors and health monitoring devices such as smart mirrors, smart screens, smart bracelets, smart watches, and smart body fat scales;

[0112] Clean, enhance, and denoise the collected data, and extract feature data that is strongly correlated with the prediction of the user's health status;

[0113] Based on the extracted feature data, use deep learning and time series algorithms to evaluate and predict the user's health status, and give short-term and long-term suggestions;

[0114] Automatically and invisibly adjust the parameters of the smart interconnected devices based on the user's current health status to create a healthier and more comfortable environment for the user;

[0115] Recommend personalized diet and exercise advice for the user according to the user's health status, and give reminders for medical treatment and rest when necessary.

[0116] The health status monitoring method provided by the embodiments of the present application has the following characteristics:

[0117] (1) Combine face recognition technology with devices such as smart mirrors and smart screens in the home to achieve automated, continuous, and invisible health monitoring and prediction.

[0118] (2) Comprehensively considering the facial image data and the user's health data, evaluate and predict the user's health status, providing new possibilities for the user's health management (not only providing health advice, but also skincare advice and mood regulation advice).

[0119] (3) According to the user's health status and facial features, automatically adjust the parameters of smart home devices to provide a more comfortable and healthy living environment, and also give personalized diet, exercise, rest, and medical advice for each user, enabling the user to imperceptibly enhance their health awareness.

[0120] In the embodiment of this application, the facial image of the user is obtained through face recognition technology, and the facial features are extracted using image processing technology. Then, combined with a health monitoring algorithm, the health status of the user is evaluated and predicted. It can automatically, continuously, and imperceptibly monitor the user's health status, and can also predict the user's future health status. When it senses that there may be potential risks in the user's physical condition, it will send a reminder and recommend seeking medical attention in a timely manner, providing effective support for the user's long-term health management. In addition, in the embodiment of this application, the parameters of smart home devices (such as brightness, humidity, temperature, noise, etc.) can be automatically adjusted according to the user's health status and facial features, and personalized suggestions for the user's diet, rest, exercise, and medical treatment are actively provided to provide a more comfortable and healthy living environment. The embodiment of this application can greatly improve the efficiency and accuracy of health monitoring, and at the same time can also provide more comprehensive and personalized services for the user's health management.

[0121] The health status monitoring method provided by the embodiment of this application has the following advantages:

[0122] (1) Convenient and fast: By combining face recognition technology with devices such as smart mirrors and smart screens, automated, continuous, and imperceptible health monitoring and prediction are achieved. Even if the user does not have other sensor devices, most of the user's physical condition data can be obtained. If there are other devices, it is even better, and they can be mutually referenced and compared to improve the reliability of the data.

[0123] (2) Accurate and reliable: Based on two channels of collecting the user's health data, namely face recognition technology and traditional wearable devices, comprehensive physiological data and behavioral data of the user can be obtained, and the health status of the user is evaluated and predicted, so as to provide more accurate and reliable health monitoring results.

[0124] (3) Personalized service: According to the user's health status and facial features, the parameters of smart home devices can be automatically adjusted to provide a more comfortable and healthy living environment, and at the same time, personalized suggestions for the user's diet, medical treatment, exercise, rest, etc. can also be provided.

[0125] (4) Continuous monitoring: It can automatically and continuously monitor the user's health status, and at the same time predict the user's future health status, providing effective support for the user's long-term health management, enabling the user to understand their own health status at any time, enhancing the user's health awareness, and cultivating good living habits.

[0126] In the embodiments of the present application, by combining face recognition technology with smart home devices with image acquisition devices such as smart mirrors (such as dressing mirrors, makeup mirrors, etc.) and smart screens such as central control screens, the acquisition, analysis, and prediction of the user's facial health data are realized, aiming to achieve automated, continuous, and user-unaware health monitoring and prediction, solving the single and low reliability of data acquisition only by traditional health monitoring devices in the past, and improving the user's quality of life, health awareness, and health level. This method can provide more comprehensive and personalized services for the user's health management, and has important practical significance and social value.

[0127] The health status monitoring device provided by the present application will be described below. The health status monitoring device described below can be mutually referred to the health status monitoring method described above.

[0128] Figure 6 is a schematic structural diagram of the health status monitoring device provided by the embodiments of the present application. As Figure 6 shown, the device includes a first acquisition module 10, a second acquisition module 20, and a health monitoring module 30, where: The first acquisition module 10 is used to: acquire user face data collected by one or more smart home devices with image acquisition devices through face recognition technology; The second acquisition module 20 is used to: obtain user status evaluation data according to the user face data; where, the user status evaluation data includes combined data of one or more of the following data: user physiological data, user skin status data, and user emotional status data; The health monitoring module 30 is used to: perform a health status evaluation according to the user status evaluation data to obtain a user health status evaluation result.

[0129] The health status monitoring device provided by the embodiments of the present application acquires user face data collected by one or more smart home devices with image acquisition devices through face recognition technology, obtains user status evaluation data according to the user face data, and the user status evaluation data includes combined data of one or more of the following data: user physiological data, user skin status data, and user emotional status data, and performs a health status evaluation according to the user status evaluation data to obtain a user health status evaluation result, improving the convenience and efficiency of health monitoring, as well as the comprehensiveness and accuracy of health monitoring.

[0130] Figure 7 is a schematic structural diagram of the electronic device provided by the embodiments of the present application. As Figure 7As shown, the entire electronic device is controlled by a bus. First, various health monitoring devices are used to collect the required data, and the data is stored, mined, and analyzed at the central control console. Then, personalized health status prompting strategies and device parameter regulation strategies are designed based on the analysis conclusions. The strategy commands are sent to the smart home devices in the house for real-time, non-intrusive, and automated regulation.

[0131] Among them, after changing the parameters of the smart home device, the above-mentioned health status monitoring method can be executed at regular intervals or according to a preset cycle to determine the change in the user's health status, and the parameters of the smart home device can be maintained or adjusted according to the change in the user's health status.

[0132] Figure 8 An example of the physical structure diagram of an electronic device is shown, such as Figure 8 As shown, the electronic device may include: a processor 810, a communications interface 820, a memory 830, and a communication bus 840. Among them, the processor 810, the communications interface 820, and the memory 830 communicate with each other through the communication bus 840. The processor 810 can call the logical instructions in the memory 830 to execute the health status monitoring method, which includes: obtaining user face data collected by one or more smart home devices with image acquisition devices through face recognition technology; obtaining user state evaluation data according to the user face data; wherein, the user state evaluation data includes a combination of one or more of the following data: user physiological data, user skin state data, and user emotional state data; performing a health status evaluation according to the user state evaluation data to obtain a user health status evaluation result.

[0133] In addition, when the logical instructions in the above-mentioned memory 830 are implemented in the form of a software functional unit and sold or used as an independent product, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical disks, etc., which can store program codes.

[0134] On the other hand, the present application also provides a computer program product, which includes a computer program that can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the health status monitoring method provided by each of the above methods. The method includes: obtaining user face data collected by one or more smart home devices with image acquisition devices through face recognition technology; obtaining user status evaluation data according to the user face data; wherein, the user status evaluation data includes combined data of one or more of the following data: user physiological data, user skin status data, and user emotional status data; performing a health status evaluation according to the user status evaluation data to obtain a user health status evaluation result.

[0135] In another aspect, the present application also provides a computer-readable storage medium, which includes a stored program. When the program runs, it executes the health status monitoring method provided by each of the above methods. The method includes: obtaining user face data collected by one or more smart home devices with image acquisition devices through face recognition technology; obtaining user status evaluation data according to the user face data; wherein, the user status evaluation data includes combined data of one or more of the following data: user physiological data, user skin status data, and user emotional status data; performing a health status evaluation according to the user status evaluation data to obtain a user health status evaluation result.

[0136] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative labor.

[0137] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disc, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than limiting them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A health condition monitoring method, characterized in that, Including: Obtaining user face data collected by one or more smart home devices with image acquisition devices through face recognition technology; Obtaining user state evaluation data according to the user face data; wherein, the user state evaluation data includes combined data of one or more of the following data: user physiological data, user skin state data, and user emotional state data; Performing a health state evaluation according to the user state evaluation data to obtain a user health state evaluation result.

2. The health condition monitoring method according to claim 1, characterized in that The method further includes: Performing a health state prediction according to the user state evaluation data to obtain a user health state prediction result.

3. The health condition monitoring method according to claim 2, wherein The performing a health state prediction according to the user state evaluation data includes: Performing a regression analysis on the user state evaluation data through a time series model for health state prediction.

4. The health condition monitoring method according to claim 1, wherein The smart home device with an image acquisition device includes a smart screen and / or a smart mirror.

5. The health condition monitoring method according to claim 2, characterized in that, The method further includes: Automatically adjusting device parameters of the smart home device according to at least one of the user state evaluation data, the user health state evaluation result, and the user health state prediction result.

6. The health condition monitoring method according to claim 2, characterized in that, The method further includes: Giving at least one feedback information of diet advice, exercise advice, skin care advice, rest advice, medical advice, etc. according to the user health state evaluation result and the user health state prediction result.

7. The health condition monitoring method according to claim 1, characterized in that Before performing the health state evaluation according to the user state evaluation data, the method further includes: Collecting user physiological data through at least one physiological signal acquisition device other than the smart home device with an image acquisition device, and supplementing the user physiological data collected by the smart home device with an image acquisition device to obtain updated user physiological data.

8. The health condition monitoring method according to claim 7, characterized in that, The supplementing the user physiological data collected by the smart home device with an image acquisition device to obtain updated user physiological data includes: Obtaining the same type of data in the user physiological data collected by the physiological signal acquisition device and the smart home device; Retaining the same type of data collected by the physiological signal acquisition device and removing the same type of data collected by the smart home device; Taking the union of the user physiological data collected by the physiological signal acquisition device and the user physiological data collected by the smart home device to obtain the updated user physiological data.

9. The health condition monitoring method according to claim 8, wherein The obtaining the user state evaluation data according to the user face data includes: Performing a health data clustering analysis on the user face data based on a machine learning model to obtain the user state evaluation data.

10. The health status monitoring method according to claim 9, wherein The method further includes: Using the same type of data collected by the physiological signal acquisition device to assist in training the machine learning model.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program executes the method according to any one of claims 1 to 10 when running.

12. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 10 through the computer program.

Images