Health monitoring method and system applied to fitness mirror and storage medium

Abstract

The invention provides a health monitoring method and system applied to a body-building mirror and a storage medium. The method comprises the following steps: acquiring a color image and an infrared thermal imaging image of a mirror entering object of the body-building mirror; determining a target area according to the color image of the in-mirror object, and determining a detection area in the infrared thermal imaging image based on the target area in the color image; and according to the infrared thermal imaging data in the detection area, determining a body health index and a body temperature detection result of the mirror entering object. Comprehensive health monitoring and personalized fitness suggestions can be provided for the user, and review and analysis of the user are facilitated.

Description

Technical Field

[0001] The present invention relates to the technical field of health monitoring, and more specifically, to a health monitoring method, system and storage medium applied to a fitness mirror. Background Art

[0002] With the advancement of science and technology, people's demand for health monitoring is growing, especially in the field of home fitness. Traditional health monitoring methods usually rely on manual measurement and recording, which is not only time-consuming and labor-intensive, but also difficult to achieve continuous and comprehensive monitoring. In addition, existing fitness mirror products often lack intelligent health monitoring functions and cannot provide personalized fitness advice and health guidance. In the existing technology, although some devices can perform simple health monitoring through image recognition technology, these technologies are often limited to a single physiological parameter, such as heart rate or body temperature, and cannot comprehensively analyze the overall health status of an individual.

[0003] In the process of implementing the embodiments of the present invention, the inventors found that there are at least the following problems or defects in the prior art: the existing health monitoring equipment cannot effectively combine multiple physiological parameters for comprehensive analysis, lacks intelligent personalized health monitoring and suggestions, and has imperfect data storage and retrospective analysis functions, and cannot meet users' needs for comprehensive, continuous and personalized health monitoring. Summary of the invention

[0004] The invention provides a health monitoring method, system and storage medium applied to a fitness mirror.

[0005] In a first aspect of the present invention, a health monitoring method applied to a fitness mirror is provided, comprising:

[0006] Collect color images and infrared thermal imaging images of objects in the fitness mirror;

[0007] Determine a target area according to the color image of the object in the image, and determine a detection area in the infrared thermal imaging image based on the target area in the color image;

[0008] The physical health index and body temperature detection result of the object in the image are determined according to the infrared thermal imaging data in the detection area.

[0009] Furthermore, the fitness mirror includes one of a full-length mirror and a half-length mirror.

[0010] Furthermore, collecting the color image and infrared thermal imaging image of the object in the fitness mirror includes: obtaining the color image and infrared thermal imaging image of the object in a non-contact and non-sensitive manner, wherein the fitness mirror can be set in the user's indoor, outdoor and other scenes.

[0011] Further, determining a target area according to the color image of the object in the image, and determining a detection area in the infrared thermal imaging image based on the target area in the color image includes:

[0012] Identify the object in the color image and determine the face area in the color image;

[0013] The color image is matched with the infrared thermal imaging image to determine a detection area in the infrared thermal imaging image corresponding to the human face area.

[0014] Further, determining the body temperature detection result of the object in the image according to the infrared thermal imaging data in the detection area includes:

[0015] Determine the temperature value of the detection area according to the infrared thermal imaging data in the detection area;

[0016] Based on the preset temperature threshold, normally the temperature value of the detection area will not exceed the preset temperature threshold, and the body temperature detection result of the object in the camera will be output; if the temperature value of the detection area exceeds the preset temperature threshold, the health detection result of whether the health status of the object in the camera is abnormal will be output.

[0017] Furthermore, it also includes:

[0018] Based on the preset identity registration information, identifying the identity of the object in the color image to determine the preset bound electronic device of the object;

[0019] The health check result of the subject in the camera is transmitted to the pre-bound electronic device, and each health check result of the subject in the camera is archived.

[0020] Furthermore, it also includes:

[0021] Based on the color image of the subject, the face detection technology is used to intelligently capture the head portrait of the person, allowing the user to select the image independently and decide whether to export the captured image to other electronic products;

[0022] Based on the character's portrait picture, the character's current mental state is quantified through model analysis; an intelligent recommendation system is introduced to recommend the most suitable shooting angle, lighting and even fitness movements to the user based on the style and frequency of pictures selected by the user in the past, as well as the mental state index obtained through model analysis. It automatically detects the moments when the user's mental state is high and captures the image. It can also automatically save the best photos to the user's personal gallery regularly or according to specific conditions based on user preferences.

[0023] In a second aspect of the present invention, a health monitoring system applied to a fitness mirror is provided, comprising:

[0024] A collection module, which is arranged on the fitness mirror and is used to collect a color image and an infrared thermal imaging image of an object in the fitness mirror;

[0025] A recognition module, used to determine a target area according to the color image of the object in the image, and determine a detection area in the infrared thermal imaging image based on the target area in the color image;

[0026] An analysis module, used to determine the mental health test result of the subject according to the human image data of the recognition module;

[0027] The face recognition module is used to process the color images collected by the acquisition module and crop the images to collect the color images of faces;

[0028] The expression model calculates the mental outlook of a person based on his / her facial photo;

[0029] The physical health index module comprehensively analyzes body temperature and mental outlook scores to obtain personnel health information, provide personnel with guidance, and save data.

[0030] Furthermore, the recognition module is also used to identify the object in the color image and determine the face area in the color image; match the color image with the infrared thermal imaging image to determine the detection area in the infrared thermal imaging image corresponding to the face area.

[0031] In a third aspect of the present invention, a computer-readable storage medium is provided, which includes instructions, and when the instructions are executed on a computer, the computer is caused to execute the method according to any one of the first aspects.

[0032] The above-mentioned embodiments of the present invention have at least the following beneficial effects: The beneficial effect of the present invention is that a comprehensive health monitoring method can be provided, which can accurately determine the physical health index and body temperature detection results of the subject in the camera by combining color images and infrared thermal imaging images. This monitoring method can not only obtain data without feeling or contact, but also can be applied in a variety of scenarios such as indoors and outdoors of the user, thereby improving the convenience and applicability of monitoring. In addition, by intelligently identifying and analyzing the mental outlook of the subject in the camera, personalized fitness advice and health guidance can be provided to the user, thereby helping the user to perform fitness and health management more effectively.

[0033] In addition, the health monitoring system and computer storage medium of the present invention can realize automatic archiving and retrospective analysis of health data. This means that users can view their health history data at any time to better understand their health status and changing trends. This data archiving and analysis function can not only provide users with a convenient tool to track and evaluate their health status, but also help users develop more effective health plans and goals. In this way, the present invention can improve users' health awareness and quality of life. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The above and other objects, features and advantages of the exemplary embodiments of the present invention will become readily understood by reading the following detailed description with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present invention are shown in an exemplary and non-limiting manner, in which:

[0035] Figure 1 A schematic flow chart of a health monitoring method applied to a fitness mirror provided by an embodiment of the present invention;

[0036] Figure 2 A schematic diagram of the structure of a health monitoring system applied to a fitness mirror provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0037] The principles and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present invention, and are not intended to limit the scope of the present invention in any way. On the contrary, these embodiments are provided to make the present invention more thorough and complete, and to fully convey the scope of the present invention to those skilled in the art.

[0038] Those skilled in the art will appreciate that the embodiments of the present invention may be implemented as a system, device, apparatus, method or computer program product. Therefore, the present invention may be implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0039] It should be noted that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction and does not have any limiting meaning.

[0040] Reference below Figure 1 , Figure 1 FIG. 1 is a flow chart of a health monitoring method applied to a fitness mirror provided by an embodiment of the present invention. Figure 1 As shown, a health monitoring method 100 applied to a fitness mirror includes:

[0041] Step 101, collecting a color image and an infrared thermal imaging image of an object in the fitness mirror;

[0042] Step 102, determining a target area according to the color image of the object in the image, and determining a detection area in the infrared thermal imaging image based on the target area in the color image;

[0043] Step 103, determining the health index and body temperature detection result of the object in the image according to the infrared thermal imaging data in the detection area.

[0044] It should be noted that this embodiment relates to a health monitoring method applied to a fitness mirror, the core of which is to perform health monitoring by collecting color images and infrared thermal imaging images of the object in the fitness mirror. The fitness mirror mentioned here refers to a special mirror, which not only has the reflection function of an ordinary mirror, but also integrates image acquisition and thermal imaging technology, so that users can perform health monitoring while using the mirror. The color image refers to an image containing color information captured by a camera, which can help identify and locate the specific area of ​​the object in the mirror; the infrared thermal imaging image is an image captured by an infrared sensor, which reflects the body temperature distribution of the object in the mirror.

[0045] Specifically, the color image acquisition module of the fitness mirror can use a high-resolution camera to ensure the clarity and details of the image. The acquisition of infrared thermal imaging images requires the use of special infrared sensors that can capture the infrared radiation emitted by the human body and convert it into thermal imaging images. When determining the target area, image processing techniques such as edge detection and region segmentation can be used to identify specific parts of the object in the mirror, such as the face or other parts of the body. For the determination of the detection area, the target area in the color image can be matched with the infrared thermal imaging image to find the corresponding area. This matching can be achieved through image recognition algorithms, such as feature matching or template matching.

[0046] Preferably, in order to improve the accuracy of health monitoring, multiple preset temperature thresholds can be set, which can be adjusted according to different health standards and application scenarios. For example, one threshold can be set for detecting fever and another threshold for monitoring hypothermia.

[0047] Furthermore, machine learning algorithms can be used to optimize the identification process of the target area and the detection area to make it more accurate and efficient. In the output of the temperature detection results, in addition to providing specific temperature values, a more comprehensive health assessment can be given in combination with the health history data of the subject in the mirror. For identity recognition, facial recognition technology can be used to achieve this, which requires the fitness mirror to have a certain amount of computing power and storage space to store and process a large amount of facial data.

[0048] In some embodiments, the fitness mirror includes one of a full-length mirror and a half-length mirror.

[0049] It should be noted that the fitness mirror involved in this embodiment can be a full-body mirror or a half-body mirror. The full-body mirror here refers to a mirror that can cover the user's entire body when the user stands in front of it, and is suitable for full-body health monitoring; while the half-body mirror refers to a mirror that covers part of the user's body, such as the upper body or lower body, and is suitable for local health monitoring. This design allows the fitness mirror to be flexibly applied to different environments and purposes according to different usage scenarios and needs.

[0050] Specifically, the choice between a full-length mirror and a half-length mirror can be determined based on the actual needs of the user and the space conditions. For example, in a home environment, if the user needs to monitor the health of the whole body, a full-length mirror can be selected; while in places with limited space such as gyms or locker rooms, a half-length mirror can be selected to monitor the health of specific parts.

[0051] More specifically, the designs of full-length mirrors and half-length mirrors can also include different sizes and shapes to adapt to different installation locations and user heights. For example, the height of a full-length mirror can be designed to cover the entire height from the ground to the top of the head, while the height of a half-length mirror can be designed to cover the area from the waist to the top of the head.

[0052] Preferably, in order to improve the monitoring accuracy and user experience, the full-length mirror and the half-length mirror can be equipped with corresponding image acquisition and processing equipment. For example, the full-length mirror can be equipped with multiple cameras and infrared sensors to ensure that clear color images and infrared thermal imaging images are captured from different angles and areas. The half-length mirror can be equipped with one or two cameras and infrared sensors to capture images of local areas.

[0053] Furthermore, the fitness mirror can also be equipped with an intelligent lighting system to ensure high-quality images under different lighting conditions. In terms of image processing, advanced image recognition and analysis algorithms such as deep learning and pattern recognition can be used to improve the recognition accuracy of target areas and detection areas.

[0054] In some embodiments, collecting the color image and infrared thermal imaging image of the object in the fitness mirror includes: obtaining the color image and infrared thermal imaging image of the object in a non-contact and non-sensitive manner, wherein the fitness mirror can be set in the user's indoor, outdoor and other scenes.

[0055] It should be noted that the health monitoring method in this embodiment uses a non-contact and non-sense method to collect color images and infrared thermal imaging images of the objects in the fitness mirror. The so-called non-contact and non-sense means that when the user uses the fitness mirror, the image can be collected without any physical contact, such as touching the screen or button. In addition, the setting scene of the fitness mirror is very flexible and can be any location indoors or outdoors, which makes health monitoring more convenient and popular.

[0056] Specifically, non-contact and non-sensitive image acquisition can be achieved through advanced cameras and infrared sensors built into fitness mirrors. These devices can automatically detect the presence of objects in the mirror and capture images at the appropriate distance and angle. For example, the camera can be set to automatically start when the user enters the field of view of the mirror, while the infrared sensor can detect the thermal radiation of the user's body to obtain infrared thermal imaging images. The resolution and frame rate of these images can be adjusted according to actual needs to ensure the quality of the image and the accuracy of monitoring. In addition, the fitness mirror can also optimize the image acquisition process through built-in software algorithms, such as motion detection and image processing technology, to ensure clear images under different lighting and environmental conditions.

[0057] Preferably, in order to further enhance the user experience and monitoring accuracy, the fitness mirror can be equipped with advanced image processing technology, such as deep learning algorithms, to automatically identify and adjust the parameters of image acquisition. For example, when the ambient light is dim, the camera can automatically increase the exposure time or increase the ISO value to obtain a clearer color image. At the same time, the infrared sensor can adjust its sensitivity to adapt to different temperature changes to ensure the accuracy of the infrared thermal imaging image.

[0058] Furthermore, the fitness mirror can also provide manual adjustment options through the user interface, allowing users to adjust image acquisition settings according to personal preferences and needs, such as image brightness, contrast, and color saturation. Such a design not only improves the flexibility of monitoring, but also increases the user's sense of control and satisfaction with the fitness mirror.

[0059] In some embodiments, determining a target area according to the color image of the object in the image, and determining a detection area in the infrared thermal imaging image based on the target area in the color image includes:

[0060] Identify the object in the color image and determine the face area in the color image;

[0061] The color image is matched with the infrared thermal imaging image to determine a detection area in the infrared thermal imaging image corresponding to the human face area.

[0062] It should be noted that the health monitoring method involved in this embodiment includes a key step: determining the target area based on the color image of the object in the image, and determining the detection area in the infrared thermal imaging image based on the target area in the color image. The target area here refers to the part of the color image that needs special attention, such as the face or other specific areas of the body; and the detection area is the part of the infrared thermal imaging image that corresponds to the target area in the color image, which is used for further analysis and monitoring. This process is the basis for achieving accurate health monitoring because it ensures the effective correspondence and analysis of the color image and the infrared thermal imaging image.

[0063] Specifically, the process of determining the target area can be achieved through image recognition technology, such as using facial recognition algorithms to locate the face area in a color image. These algorithms are usually based on machine learning models and can accurately identify faces from complex backgrounds. Once the face area is determined, it can be used as a reference to find the corresponding detection area in the infrared thermal imaging image through image matching technology. Image matching can use a variety of methods, such as feature point matching or template matching, to ensure accurate correspondence of the detection area. In addition, the determination of the target area can also include the identification of other parts of the body, such as arms or legs, which requires more complex image processing techniques, such as human posture estimation or key point detection.

[0064] Preferably, in order to improve the accuracy of determining the target area and the detection area, more advanced image processing techniques can be used, such as deep learning networks, especially convolutional neural networks (CNNs), which perform well in image recognition and matching. In addition, multiple sensor data can be combined, such as color images and depth images, to improve the accuracy of target area recognition. In practical applications, user interaction can also be used to assist in determining the target area. For example, the user can select or confirm the target area by touching the screen or voice command.

[0065] Furthermore, in order to adapt to different usage scenarios and user needs, the fitness mirror can preset a variety of combinations of target areas and detection areas, and users can choose the most appropriate combination for health monitoring according to their needs.

[0066] In some embodiments, determining the body temperature detection result of the object in the image according to the infrared thermal imaging data in the detection area includes:

[0067] Determine the temperature value of the detection area according to the infrared thermal imaging data in the detection area;

[0068] Based on the preset temperature threshold, normally the temperature value of the detection area will not exceed the preset temperature threshold, and the body temperature detection result of the object in the camera will be output; if the temperature value of the detection area exceeds the preset temperature threshold, the health detection result of whether the health status of the object in the camera is abnormal will be output.

[0069] It should be noted that, in this embodiment, the body temperature detection result of the object in the image is determined based on the infrared thermal imaging data in the detection area, which involves analyzing the temperature value of a specific area in the infrared thermal imaging image. The detection area here refers to the part of the infrared thermal imaging image that corresponds to the target area in the color image, which is used for accurate measurement of body temperature. By analyzing the infrared thermal imaging data of these areas, the temperature value can be calculated to evaluate the body temperature status of the object in the image. In addition, a preset temperature threshold is also involved, which is a pre-set reference value used to determine whether the body temperature is normal.

[0070] Specifically, the analysis of infrared thermal imaging data can be achieved through specialized image processing software that can identify and analyze pixel values ​​in infrared thermal imaging images, which are proportional to temperature. The software converts the value of each pixel into a corresponding temperature reading to generate a temperature distribution map. The preset temperature threshold can be set according to medical standards or specific application scenarios. For example, the normal body temperature range is usually between 36.5°C and 37.5°C. If the temperature value of the detection area exceeds this range, the system will be judged as abnormal and output the corresponding health test results. In addition, different temperature thresholds can be set according to different health conditions and environmental conditions to meet different monitoring needs.

[0071] Preferably, in order to improve the accuracy and reliability of body temperature detection, more advanced image processing techniques and algorithms can be used, such as using machine learning models to automatically identify and analyze abnormal areas in infrared thermal imaging images. In addition, multiple sensor data, such as heart rate monitoring data, can be combined to provide a more comprehensive health assessment.

[0072] Furthermore, in practical applications, user interaction can also be used to assist in determining the preset temperature threshold. For example, the user can adjust the temperature threshold by touching the screen or using voice commands according to their health status and environmental conditions. Such interaction can not only improve the user experience, but also reduce the error of the automatic recognition algorithm to a certain extent.

[0073] Furthermore, in order to adapt to different usage scenarios and user needs, the system can preset multiple combinations of temperature thresholds, and users can choose the most appropriate combination for body temperature monitoring according to their needs.

[0074] In some embodiments, it also includes:

[0075] Based on the preset identity registration information, identifying the identity of the object in the color image to determine the preset bound electronic device of the object;

[0076] The health check result of the subject in the camera is transmitted to the pre-bound electronic device, and each health check result of the subject in the camera is archived.

[0077] It should be noted that the health monitoring method mentioned in this embodiment also includes identifying the identity of the object in the mirror based on the preset identity registration information, and determining the preset bound electronic device of the object. The preset identity registration information here refers to the identity information registered by the user through the system before using the fitness mirror, such as name, facial features, etc., for subsequent identity identification. The preset bound electronic device refers to the device specified by the user when registering to receive the health monitoring results, such as a smart phone, tablet computer, etc. This process enables the health monitoring results to be delivered to the user in a timely and accurate manner, enhancing the personalization and convenience of monitoring.

[0078] Specifically, the collection of identity registration information can be achieved through facial recognition technology. When a user uses a fitness mirror for the first time, he needs to face the camera for a facial scan. The system will record the user's facial features and associate them with the user's identity information. The process of pre-binding an electronic device requires the user to provide the device's identification information, such as the device model, serial number, etc., or directly pair it with the fitness mirror through a wireless connection such as Bluetooth or Wi-Fi. During the identity recognition process, the system will compare the real-time captured facial image with the registered facial features. Once the recognition is successful, the system will send the health monitoring results to the user's preset binding electronic device. In addition, in order to ensure the security and privacy of data transmission, encryption technology can be used to encrypt the transmitted data.

[0079] Preferably, in order to improve the accuracy of identity recognition and user experience, more advanced biometric technologies, such as iris recognition or fingerprint recognition, can be used to provide a more secure way of identity authentication. At the same time, the system can provide a variety of options for binding electronic devices, including but not limited to smartphones, tablets, smart watches, etc., to meet the needs of different users. In terms of the transmission of health monitoring results, in addition to real-time transmission, options for scheduled transmission or on-demand transmission can also be provided, allowing users to choose the most appropriate data reception method according to their needs.

[0080] Furthermore, in order to further enhance the user experience, the system can also provide a visual display of health monitoring results, such as intuitively displaying the user's health status through charts, graphs, etc., making it easier for users to understand and analyze their own health data.

[0081] In some embodiments, it also includes:

[0082] Based on the color image of the subject, the face detection technology is used to intelligently capture the head portrait of the person, allowing the user to select the image independently and decide whether to export the captured image to other electronic products;

[0083] Based on the character's portrait picture, the character's current mental state is quantified through model analysis; an intelligent recommendation system is introduced to recommend the most suitable shooting angle, lighting and even fitness movements to the user based on the style and frequency of pictures selected by the user in the past, as well as the mental state index obtained through model analysis. It automatically detects the moments when the user's mental state is high and captures the image. It can also automatically save the best photos to the user's personal gallery regularly or according to specific conditions based on user preferences.

[0084] It should be noted that the health monitoring method mentioned in this embodiment also includes intelligently capturing portrait images of people through face detection technology, and allowing users to independently select images and decide whether to export the captured images to other electronic products. The face detection technology here is an image processing technology used to identify and locate faces in color images. User autonomous selection of images means that users can participate in the image selection process and choose the images they think are best. Exporting to other electronic products means transferring the selected images to other devices of the user, such as a smartphone or computer, for further use or storage.

[0085] Specifically, face detection technology can be implemented through pre-trained machine learning models that can recognize faces in images and extract key feature points, such as the location of eyes, nose, and mouth. The process of user autonomous image selection can be achieved by providing multiple candidate images on the interface of the fitness mirror and allowing users to select their favorite one through touch or voice command. Exporting to other electronic products can be achieved through wireless transmission technologies such as Wi-Fi or Bluetooth, and users need to establish a connection between the fitness mirror and the target device. In addition, some parameters such as image resolution, format, and compression rate can also be set to adapt to different transmission and storage requirements. For example, users may want to save images at high resolution for best quality, or choose a lower resolution to save storage space.

[0086] Preferably, in order to enhance the user experience, the fitness mirror can provide a more intuitive and user-friendly user interface, allowing users to easily browse and select images. In addition, an intelligent recommendation system can be introduced to automatically recommend the best images for users to choose based on the user's past selection preferences and image quality. In terms of image export, in addition to wireless transmission, wired connection options such as USB interfaces can also be provided to support faster or more stable transmission.

[0087] Furthermore, in order to protect the privacy of users, the system can provide the option of encrypted transmission to ensure the security of images during transmission. You can also set the automatic save function to automatically save the best photos to the user's personal gallery regularly or under certain conditions according to the user's preferences, so that users do not need to manually select and export images, greatly simplifying the operation process.

[0088] The above-mentioned embodiments of the present invention have the following beneficial effects: the health monitoring method described in the present invention can realize a comprehensive health assessment of the subject in the fitness mirror, and by collecting color images and infrared thermal imaging images, the physical health index and body temperature detection results of the subject in the mirror can be accurately determined. This method can not only obtain data without feeling or contact, thereby improving the user experience, but also can be applied in a variety of scenarios such as indoors and outdoors, thereby improving the convenience and applicability of monitoring. In addition, the method can also provide users with personalized fitness advice and health guidance by intelligently identifying and analyzing the mental outlook of the subject in the mirror, thereby helping users to perform fitness and health management more effectively.

[0089] Furthermore, this health monitoring method can also realize automatic archiving of health data and personalized image processing. By transmitting the health test results to pre-bound electronic devices and archiving them, users can view their health history data at any time, so as to better understand their health status and changing trends. In addition, through face detection technology and intelligent recommendation system, users can independently select images and decide whether to export the captured images to other electronic products. At the same time, according to the style and frequency of pictures selected by users in the past, as well as the mental outlook index obtained through model analysis, the most suitable shooting angle, light and even fitness movements can be recommended to users, and the user's mental state is automatically detected at the moment of high spirits and image capture is performed, thereby improving the user's satisfaction and interactive experience.

[0090] like Figure 2 As shown, in some embodiments, a health monitoring system 200 applied to a fitness mirror includes:

[0091] A collection module 201, which is provided on the fitness mirror and is used to collect a color image and an infrared thermal imaging image of an object in the fitness mirror;

[0092] The recognition module 202 is used to determine the target area according to the color image of the object in the image, and determine the detection area in the infrared thermal imaging image based on the target area in the color image;

[0093] An analysis module 203 is used to determine the mental health test result of the subject according to the human body image data of the recognition module;

[0094] The face recognition module 204 is used to process the color image collected by the collection module, and to crop the image to collect the color image of the face;

[0095] The expression model 205 is used to score the mental outlook of the person according to the face photo;

[0096] The physical health index module 206 comprehensively analyzes the body temperature and mental outlook scores to obtain personnel health information, provide personnel with guidance, and save data.

[0097] It is understandable that the modules described in the health monitoring system 200 applied to the fitness mirror are similar to those described in the reference Figure 1 Therefore, the operations, features and beneficial effects described above for the health monitoring method applied to the fitness mirror are also applicable to the health monitoring system 200 applied to the fitness mirror and the modules contained therein, and will not be repeated here.

[0098] In some embodiments, the recognition module is also used to identify the object in the color image and determine the face area in the color image; match the color image with the infrared thermal imaging image to determine the detection area in the infrared thermal imaging image corresponding to the face area.

[0099] It should be noted that the health monitoring system involved in this embodiment includes an identification module, which is not only used to determine the target area based on the color image of the object in the image, but also used to determine the detection area in the infrared thermal imaging image. The identification module here refers to the part of the system responsible for image analysis and processing. It can identify specific target areas, such as faces or other parts of the body, from the color image and find the corresponding detection area in the infrared thermal imaging image. This recognition and matching process is the key to achieving accurate health monitoring because it ensures that two different types of image data can be effectively associated and analyzed.

[0100] Specifically, the recognition module can use advanced image processing techniques and algorithms, such as deep learning and machine learning models, to automatically identify and locate target areas in color images. These models can be trained to recognize various features, such as the outline of the face, the location of the eyes, nose and mouth, and key points of other body parts. Once the target areas are determined, the recognition module will match these areas with the infrared thermal imaging image to find the corresponding detection area. This matching process involves complex image processing techniques, such as feature point matching, template matching or image fusion technology. In addition, the recognition module can also optimize the recognition and matching process according to preset parameters and rules, such as adjusting the sensitivity, accuracy and speed of matching to adapt to different usage scenarios and needs.

[0101] Preferably, in order to improve the performance of the recognition module and the user experience, a more advanced image recognition technology may be used, such as using a convolutional neural network (CNN) to improve the accuracy of target area recognition.

[0102] More specifically, a real-time feedback mechanism can be introduced to allow users to see the results of recognition and matching and provide feedback to further optimize the recognition process. In practical applications, the parameters and rules of the recognition module can also be dynamically adjusted based on user feedback and usage to improve the adaptability and flexibility of the system.

[0103] Preferably, in order to protect the privacy and data security of the user, encryption and anonymization techniques can be used to process and store the data generated by the recognition module. It is also possible to consider introducing multimodal recognition technology, combining multiple sensors and data sources, such as sound, motion, and biometrics, to provide more comprehensive and accurate health monitoring.

[0104] Furthermore, the storage medium of the embodiment of the present application stores program instructions that can implement all the above methods, wherein the program instructions can be stored in the above storage medium in the form of a software product, including several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, or terminal devices such as a computer, a server, a mobile phone, and a tablet.

[0105] The above descriptions are only some preferred embodiments of the present invention and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present invention is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present invention to form a technical solution.

Claims

1. A health monitoring method applied to a fitness mirror, characterized in that: include: Collect color images and infrared thermal imaging images of objects in the fitness mirror; Determine a target area according to the color image of the object in the image, and determine a detection area in the infrared thermal imaging image based on the target area in the color image; The physical health index and body temperature detection result of the object in the image are determined according to the infrared thermal imaging data in the detection area.

2. The health monitoring method according to claim 1, characterized in that: The fitness mirror includes one of a full-length mirror and a half-length mirror.

3. The health monitoring method according to claim 1, characterized in that: Collecting the color image and infrared thermal imaging image of the object in the fitness mirror includes: acquiring the color image and infrared thermal imaging image of the object in a non-contact and non-sensitive manner, wherein the fitness mirror can be set in the user's indoor, outdoor and other scenes.

4. The health monitoring method according to claim 1, characterized in that: Determining a target area according to the color image of the object in the image, and determining a detection area in the infrared thermal imaging image based on the target area in the color image includes: Identify the object in the color image and determine the face area in the color image; The color image is matched with the infrared thermal imaging image to determine a detection area in the infrared thermal imaging image corresponding to the human face area.

5. The health monitoring method according to claim 1, characterized in that: Determining the body temperature detection result of the object in the image according to the infrared thermal imaging data in the detection area includes: Determine the temperature value of the detection area according to the infrared thermal imaging data in the detection area; Based on the preset temperature threshold, normally the temperature value of the detection area will not exceed the preset temperature threshold, and the body temperature detection result of the object in the camera will be output; if the temperature value of the detection area exceeds the preset temperature threshold, the health detection result of whether the health status of the object in the camera is abnormal will be output.

6. The health monitoring method according to claim 1, characterized in that: Also includes: Based on the preset identity registration information, identifying the identity of the object in the color image to determine the preset bound electronic device of the object; The health check result of the subject in the camera is transmitted to the pre-bound electronic device, and each health check result of the subject in the camera is archived.

7. The health monitoring method according to claim 1, characterized in that: Also includes: Based on the color image of the subject, the face detection technology is used to intelligently capture the head portrait of the person, allowing the user to select the image independently and decide whether to export the captured image to other electronic products; Based on the character's portrait picture, the character's current mental state is quantified through model analysis; an intelligent recommendation system is introduced to recommend the most suitable shooting angle, lighting and even fitness movements to the user based on the style and frequency of pictures selected by the user in the past, as well as the mental state index obtained through model analysis. It automatically detects the moments when the user's mental state is high and captures the image. It can also automatically save the best photos to the user's personal gallery regularly or according to specific conditions based on user preferences.

8. A health monitoring system applied to a fitness mirror, characterized in that: include: A collection module, which is arranged on the fitness mirror and is used to collect a color image and an infrared thermal imaging image of an object in the fitness mirror; A recognition module, used to determine a target area according to the color image of the object in the image, and determine a detection area in the infrared thermal imaging image based on the target area in the color image; An analysis module, used to determine the mental health test result of the subject according to the human image data of the recognition module; The face recognition module is used to process the color images collected by the acquisition module and crop the images to collect the color images of faces; The expression model calculates the mental outlook of a person based on his / her facial photo; The physical health index module comprehensively analyzes body temperature and mental outlook scores to obtain personnel health information, provide personnel with guidance, and save data.

9. The health monitoring system according to claim 8, characterized in that: The recognition module is also used to recognize the object in the color image and determine the face area in the color image; match the color image with the infrared thermal imaging image to determine the detection area in the infrared thermal imaging image corresponding to the face area.

10. A computer storage medium, characterized in that: The computer storage medium stores instructions for executing the steps in the method according to any one of claims 1 to 7, as well as archiving historical data such as the user's physical health status, for the convenience of user review and analysis.

Images