Health detection system and method

Abstract

The invention discloses a health detection system and method. The health detection system mainly comprises an image acquisition device, a controller and a wearable device, the controller establishes communication connection with the image acquisition device and the wearable device; the image acquisition equipment is configured to acquire image data related to a user; the wearable device is configured to obtain body data information of a user; and the controller is configured to output a health report of the user based on the emotional state information, the identity label and the body data information of the user identified by the image data. According to the embodiment of the invention, by fusing the image data acquired by the image acquisition equipment and the body data information acquired by the wearable equipment, comprehensive analysis and evaluation of the health state of the user are realized under the condition that the user is non-inductive and does not need active cooperation, and comprehensive and accurate analysis is provided for the health state of the user.

Description

Technical Field

[0001] This application relates to the field of terminal control technology, and in particular to a health detection system and method. Background Technology

[0002] With increasing health awareness and the widespread adoption of IoT technology, seamlessly integrating health monitoring functions into the daily home environment has become an important development trend. Traditional health monitoring methods typically require active user cooperation, and the acquired health data generally only involves single-dimensional data, failing to provide real-time, seamless, multi-dimensional comprehensive monitoring and analysis of users' physical and mental health. Summary of the Invention

[0003] This application provides a health detection system and method that integrates and processes user identity information, emotional state information, and physical data information to provide real-time, seamless, multi-dimensional comprehensive detection and analysis of the user's physical and mental health, avoiding inaccurate judgments caused by single-dimensional data.

[0004] On one hand, this application provides a health monitoring system, including: an image acquisition device, a controller, and a wearable device; the controller establishes communication connections with the image acquisition device and the wearable device respectively; the image acquisition device is configured to acquire image data related to a user; the wearable device is configured to acquire the user's body data information; the controller is configured to output a health report of the user based on the user's emotional state information, identity identifier, and body data information identified from the image data.

[0005] In some embodiments, the controller is further configured to send the user's emotional state information, identity identifier, and physical data information to a server, so that the server generates the user's health report based on the emotional state information, identity identifier, and physical data information.

[0006] In some embodiments, the image data includes the user's facial data, and the image acquisition device includes a facial recognition module and an expression recognition module; the facial recognition module is used to determine the user's identity based on the image data; the expression recognition module is used to determine the user's emotional state information based on the image data.

[0007] In some embodiments, the system further includes: an audio acquisition device for acquiring the user's audio data; and a controller configured to output the user's health report based on the emotional state information, the identity identifier, the physical data information, and the audio data.

[0008] In some embodiments, the controller is further configured to determine the user's historical feature data based on the user's identity identifier, and output the user's health report based on the historical feature data, the physical data information, and the emotional state information; wherein the historical feature data includes: historical physical data information corresponding to the user, and historical emotional state information.

[0009] In some embodiments, the system further includes a mobile terminal device; the mobile terminal device is configured to receive and display the user's health report.

[0010] In some embodiments, the controller is further configured to output a prompt message and send it to the mobile terminal device when the health report indicates that the user's status is abnormal; wherein the prompt message includes at least one of the following: alarm information; image data acquired by the image acquisition device when the status is abnormal; and audio data acquired by the audio acquisition device when the status is abnormal.

[0011] In some embodiments, the controller is further configured to: determine the user's usage time, physical data information, and emotional state information when the user is determined to be a minor based on the identity identifier; and output the prompt information when the user's state is determined to be abnormal based on preset anti-addiction rules, the emotional state information, and the physical data information; wherein the preset anti-addiction rules include: the user's usage time exceeds a preset usage time.

[0012] In some embodiments, the controller is further configured to, if the user is determined to be an elderly person based on the identity identifier, determine the user's movement data, the body data information, and the emotional state information; and if the user's state is determined to be abnormal based on the movement data, the emotional state information, and the body data information, output the prompt information.

[0013] On the other hand, this application embodiment also provides a health detection method, applied to any of the health detection systems provided in this application embodiment. The method includes: an image acquisition device acquiring image data related to a user; a wearable device acquiring the user's body data information; and a controller outputting a health report of the user based on the user's emotional state information, identity identifier, and body data information identified from the image data.

[0014] On the other hand, embodiments of this application also provide a computer program product, including a computer program or instructions, which, when executed by a processor, implement the steps in any of the health detection methods provided in embodiments of this application.

[0015] On the other hand, embodiments of this application also provide a computer-readable storage medium storing a computer program or instructions thereon, including a computer program or instructions that, when executed by a processor, implement the steps in any of the health detection methods provided in embodiments of this application.

[0016] On the other hand, embodiments of this application also provide an electronic device, including a memory and a processor, wherein the memory stores a computer program or instructions, and when the computer program or instructions are executed by the processor, the processor performs the steps in any of the health detection methods provided in embodiments of this application.

[0017] This application discloses a health monitoring system and method. The health monitoring system mainly includes: an image acquisition device, a controller, and a wearable device; the controller establishes communication connections with both the image acquisition device and the wearable device; the image acquisition device is configured to acquire image data related to the user; the wearable device is configured to acquire the user's body data information; the controller is configured to output a health report for the user based on the user's emotional state information, identity identifier, and body data information identified from the image data. This application's embodiments, by fusing image data acquired by the image acquisition device and body data information acquired by the wearable device, achieve a comprehensive analysis and assessment of the user's physical and mental health status without the user's awareness or active cooperation, providing a comprehensive and accurate analysis of the user's physical and mental health status. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of the structure of a health monitoring system provided in an embodiment of this application;

[0020] Figure 2 This is a schematic diagram of another health monitoring system provided in the embodiments of this application;

[0021] Figure 3 This is a schematic diagram of another health monitoring system provided in the embodiments of this application;

[0022] Figure 4 This is a flowchart illustrating a health detection method provided in an embodiment of this application;

[0023] Figure 5This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0024] Explanation of reference numerals in the attached figures:

[0025] 100. Health monitoring system; 110. Image acquisition device; 120. Controller; 130. Wearable device; 140. Audio acquisition device; 150. Mobile terminal device. Detailed Implementation

[0026] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0027] In the following description, specific embodiments of this application will be illustrated with reference to steps and symbols performed by one or more computers, unless otherwise stated. Therefore, these steps and operations will be referred to several times as being performed by a computer, and computer execution as referred to herein includes operations by a computer processing unit representing electronic signals of data in a structured format. This operation transforms the data or maintains it at a location in the computer's memory system, which can be reconfigured or otherwise alter the operation of the computer in a manner well known to those skilled in the art. The data structure maintained by the data is the physical location of the memory, which has specific characteristics defined by the data format. However, the principles of the invention described above are not intended to be limiting, and those skilled in the art will understand that many of the steps and operations described below can also be implemented in hardware.

[0028] The terms "module" or "unit" as used herein can be considered as software objects executing on the computing system. The various components, modules, engines, and services described herein can be considered as implementations on the computing system. While the apparatus and methods described herein are preferably implemented in software, they can also be implemented in hardware, both of which are within the scope of this invention.

[0029] Those skilled in the art will understand that, unless specifically stated otherwise, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the term “comprising” as used in this specification means the presence of the stated features, integers, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. It should be understood that when an element is “connected” or “coupled” to another element, it may be directly connected or coupled to the other element, or there may be intermediate elements. Furthermore, “connected” or “coupled” as used herein may include wireless connections or wireless coupling. The term “and / or” as used herein includes all or any units and all combinations of one or more associated listed items.

[0030] Figure 1 This is a schematic diagram illustrating the architecture of a health monitoring system 100 provided in an embodiment of this application. Please refer to [link / reference]. Figure 1 The health monitoring system 100 may include: an image acquisition device 110, a controller 120, and a wearable device 130; the controller 120 establishes communication connections with the image acquisition device 110 and the wearable device 130 respectively; the image acquisition device 110 is configured to acquire image data related to the user; the wearable device 130 is configured to acquire the user's body data information; and the controller 120 is configured to output a health report for the user based on the user's emotional state information, identity identifier, and body data information identified from the image data.

[0031] Image acquisition device 110 is used to capture the user's visual information as the raw data source for system analysis. Specifically, this device may be a high-definition RGB camera capable of acquiring image data including the user's facial features, expression changes, skin tone fluctuations, body posture, and other visual information related to the user. Image acquisition device 110 can directly reuse the built-in camera integrated on a smart TV, or it can use an external camera independent of the smart TV; this application does not limit this choice. Based on the acquired image data, the system can further identify the user's identity and emotional state information. In some embodiments, the image data includes the user's facial data, and image acquisition device 110 includes: a facial recognition module and an expression recognition module; the facial recognition module is used to determine the user's identity based on the image data; the expression recognition module is used to determine the user's emotional state information based on the image data.

[0032] The facial recognition module is mainly used to verify or identify the user's identity. For example, the facial recognition module can process facial data in image data, detect the position of the face in the image, locate key points (such as the position of the eyes, nose, and corners of the mouth), and then use a deep learning model to extract the feature vector representing the face identity, generate a unique identity identifier for each user, and ensure that the output health report is bound to the correct user identity.

[0033] The facial expression recognition module is mainly used to interpret the emotions and psychological states expressed by a person's face. It focuses on the dynamic and morphological features related to facial expressions. For example, the facial expression recognition module can input the facial expression features extracted from image data into a classifier to determine which category the user's expression belongs to based on the current image data (such as happy, sad, angry, surprised, fearful, disgusted, neutral, etc.). Furthermore, it can also output more refined emotional dimension information, such as the degree of pleasure and excitement.

[0034] Wearable device 130 can be a smartwatch, smart bracelet, or other easily worn peripheral, or it can be a smart ring, smart clothing, smart head-mounted device, etc., and this application does not limit it in this regard. Wearable device 130 is used to acquire the user's body data information, including but not limited to the user's heart rate, blood oxygen saturation, body temperature, blood pressure, etc.

[0035] The controller 120 can directly reuse the main control chip from the smart TV, or it can use electronic devices independent of the smart TV. The image acquisition device 110, wearable device 130, and controller 120 can establish a stable and efficient connection through various communication methods to ensure reliable data transmission and smooth system operation. Specifically, the image acquisition device 110 (such as a camera) and controller 120 can communicate through one or more of the following interfaces:

[0036] MIPI CSI-2 (Mobile Industry Processor Interface Camera Serial Interface 2) is the most commonly used high-speed serial interface between high-definition camera modules and the main processor (main control chip) in embedded devices. It features high bandwidth, low electromagnetic interference, and low power consumption, making it suitable for transmitting video stream data from built-in cameras in smart TVs. If the camera is used as an external device, it can be connected to the controller 120 using a USB (Universal Serial Bus) 2.0 / 3.0 interface. The USB interface is highly versatile, supports plug-and-play, and facilitates expansion and compatibility with different camera models. The I2C (Inter-Integrated Circuit) bus, as a control interface, can be used to transmit control commands and configuration parameters. It is a synchronous, serial, half-duplex, multi-master / slave architecture communication protocol, primarily used for short-distance, low-speed communication between board-level devices. This application does not limit the communication connection method between the image acquisition device 110 and the controller 120; the system can choose a suitable method based on the actual architecture and requirements.

[0037] The wearable device 130 (such as a smart bracelet) and the controller 120 are primarily connected via wireless communication technology to ensure unrestricted user freedom of movement. The communication connection can be established in the following ways:

[0038] The smart bracelet establishes a low-power connection with the controller 120 via Bluetooth (Bluetooth & BLE - Bluetooth Low Energy) and periodically transmits collected body data such as heart rate and blood oxygen saturation to the controller 120. Some high-performance wearable devices 130 support direct communication with the controller 120 on the network via Wi-Fi, enabling real-time transmission of large amounts of data. This application does not limit the communication method between the wearable device 130 and the controller 120; the system can choose a suitable method based on its actual architecture and requirements.

[0039] Based on the acquired emotional state information, identity information, and physical data, the controller 120 outputs a health report for the user. It should be noted that the generation of this health report can be completed at different locations depending on the actual system resource configuration: if the health report is generated locally on the controller 120, the controller 120 needs to have high computing power to independently complete real-time analysis of multimodal data and report generation; if the system is in a cloud-based collaborative mode, the health report can also be generated on the server side to reduce the computational load on the local controller 120. In some embodiments, the controller 120 is also configured to send the user's emotional state information, identity information, and physical data to the server, so that the server can generate the user's health report based on the emotional state information, identity information, and physical data.

[0040] After receiving user identification, emotional state information, and physical data from controller 120, the server can invoke a pre-set health analysis algorithm to generate a real-time health report for the user. This report may include a health score, anomaly alerts, trend charts, and improvement suggestions. Controller 120 can then download the server-generated health report to its local machine for parsing and output. For example, the pre-set health analysis algorithm may include, but is not limited to, multimodal data fusion models, time-series analysis models, and personalized baseline comparisons; this application does not impose any limitations on these algorithms.

[0041] For example, when the controller 120 is the main control chip of a smart TV, and the image acquisition device 110 reuses the camera integrated into the smart TV, a facial recognition module and an expression recognition module can be added to the camera to continuously identify and record the user's emotional state information during TV viewing. Simultaneously, wearable devices such as wristbands 130 worn by the user can monitor the user's heart rate, blood oxygen saturation, and other physical data in real time while watching TV. During the detection process, the dynamic physical data collected by the wristband and camera is uploaded to the server, which calls a pre-set health analysis algorithm to generate a personalized health report for the user in real time. The controller 120 on the smart TV can then download the health report locally via the network and present it to the user through a screen interface, voice broadcast, or other interactive methods.

[0042] To facilitate users' access to health reports at any time, in some embodiments, the system further includes a mobile terminal device 150; the mobile terminal device 150 is used to receive and display the user's health report. The mobile terminal device 150 can be a smartphone, tablet, smartwatch, or smart bracelet, etc. Users can view and download health reports generated by the server through WeChat mini-programs, apps, etc., on the mobile terminal device 150. This enables family sharing functionality, such as allowing users to view the health reports of other family members to understand their health status.

[0043] The health monitoring system 100 provided in this application embodiment integrates image data collected by image acquisition device 110 and body data information obtained by wearable device 130, and realizes comprehensive analysis and evaluation of the user's physical and mental health status without the user's awareness or active cooperation, providing a comprehensive and accurate analysis of the user's physical and mental health status.

[0044] It should be understood that in some extreme scenarios, facial recognition alone may not be able to accurately distinguish user identities, such as when users are twins with highly similar appearances. To address such situations, the system can also incorporate audio data as an auxiliary feature to accurately distinguish user identities. Figure 2 This is a schematic diagram of another health monitoring system 100 provided in an embodiment of this application, as shown below. Figure 2 As shown, in some embodiments, the system further includes: an audio acquisition device 140 for acquiring the user's audio data; and a controller 120 configured to output a user's health report based on emotional state information, identity information, physical data information, and audio data.

[0045] The audio acquisition device 140 is used to capture the user's audio data. It can directly reuse the microphone array built into the smart TV, or it can be an external microphone independent of the smart TV. This application does not limit this. The audio acquisition device 140 establishes a communication connection with the controller 120, which can be achieved through a USB interface or an I2C bus, etc. This application does not limit the method of establishing the communication connection, and the system can make a reasonable choice according to the actual architecture and requirements.

[0046] If the facial recognition module cannot accurately identify the user's identity, audio data can be combined to generate a unique identity for the user, thereby increasing the accuracy of the health report.

[0047] Furthermore, audio data can also serve as a data source for generating health reports. The system can not only acquire users' emotional state information through facial expression recognition modules, but also improve the accuracy of emotional state recognition by combining audio data analysis. For example, audio data can be converted into text based on speech recognition technology to assess users' emotional stress or cognitive state; users' emotional states can also be assessed by analyzing information such as tone, speed, and volume in the audio data. For instance, a user's tone may rise when emotionally agitated; their speech may increase when anxious or excited, and decrease when depressed or fatigued; their volume may increase when angry, and decrease when sad; the system can also capture users' coughs, throat clearings, sneezes, etc., and analyze their frequency to determine if users have respiratory health problems.

[0048] The health monitoring system 100 provided in this application embodiment can improve the accuracy of user identification by introducing an audio acquisition device 140. At the same time, it can also add rich data sources to the user's health report, make up for the shortcomings of pure visual analysis in emotion judgment, realize audiovisual fusion emotion analysis, and provide users with multi-dimensional, more comprehensive and accurate health monitoring.

[0049] In some embodiments, the controller 120 is further configured to determine the user's historical characteristic data based on the user's identity identifier, and output the user's health report based on the historical characteristic data, physical data information, and emotional state information; wherein the historical characteristic data includes: historical physical data information corresponding to the user, and historical emotional state information.

[0050] It should be understood that historical characteristic data can be stored on local devices or on the server, and the specific storage location can be flexibly configured according to the actual system resources and architecture. Based on the identity identifier, the historical characteristic data of a specific user can be extracted, specifically including the user's historical physical data and historical emotional state information. The system can learn and model the patterns of changes in physical state based on the user's historical characteristic data, thereby enabling a more accurate assessment of the user's current health status.

[0051] For example, the system can record data feature points indicating significant changes in a user's state, such as a change in facial expression from calm to agitation, a change in heart rate from stable to rising, or dramatic fluctuations in blood oxygen saturation. By combining currently collected real-time physical and emotional state data with historical feature data, the system establishes a personalized behavior-state model for the user. Based on historical health patterns, the system can assess the user's current health status and output a health report for the user's reference.

[0052] This application embodiment introduces users' historical characteristic data to provide a historical data reference dimension for judging health status, thereby supporting the generation of more accurate and personalized health reports.

[0053] To facilitate rapid identification and timely intervention of abnormal user health status, in some embodiments, the controller 120 is further configured to output a prompt message and send it to the mobile terminal device 150 when the health report indicates that the user's status is abnormal; wherein, the prompt message includes at least one of the following: alarm information; image data acquired by the image acquisition device 110 when the status is abnormal; audio data acquired by the audio acquisition device 140 when the status is abnormal.

[0054] It should be understood that the notification messages can be displayed directly on the smart TV screen to promptly remind the user, or pushed to the associated user's mobile terminal device 150. For example, if the current user is a minor and exhibits abnormal physical or mental health conditions, a corresponding notification can be displayed directly on the screen, and the message can also be sent to their parents, who can then provide timely feedback and adjustments. Similarly, if the current user is an elderly person and exhibits abnormal physical or mental health conditions, a corresponding notification can be displayed directly on the screen, and the message can be sent to their children or other guardians. Depending on the severity of the abnormal condition, the system can directly contact pre-set medical and health institutions to ensure the elderly person's safety.

[0055] Alarm messages can provide different levels of alerts based on the severity of the anomaly, such as mild fatigue reminders, warnings of severe emotional fluctuations, and emergency health risk alerts. Corresponding adjustment suggestions can also be attached, such as suggesting immediate rest or deep breathing to relax.

[0056] Image snapshots are images of the user's facial expressions or body postures captured by the image acquisition device 110 when the state is abnormal, providing a visual basis for prompting information; audio clips are environmental sounds or user voice clips recorded by the audio acquisition device 140 during the abnormal period, used to assist in judging abnormal situations, such as violent coughing, abnormal breathing sounds, or shouting.

[0057] Furthermore, when a user's health status is abnormal, the notification message can include data on body parameters such as heart rate and blood oxygen saturation at the time of the abnormality, as well as short-term change curves, thus clearly demonstrating the development trend of the user's abnormal health status.

[0058] This application embodiment improves the timeliness, reliability, and operability of the system by providing alerts to notify users of abnormal user status. Users can undergo effective health checks without being aware of it or needing to actively cooperate, even while watching TV, and the system can promptly transmit abnormal information to the relevant guardians or the user themselves, facilitating timely monitoring of their physical and mental health.

[0059] It should be noted that this system not only supports conventional TV viewing scenarios but can also be extended to home entertainment scenarios. For example, when a user connects a home game console such as a Switch, PlayStation, or Wii to a smart TV and plays games, the system can continuously monitor the user's health status based on cameras and wristbands. For underage users, this health monitoring system 100 can also be combined with anti-addiction mechanisms to monitor the user's physical and mental health status in real time during gameplay. In some embodiments, the controller 120 is further configured to, when determining that the user is a minor based on identification, determine the user's usage time, physical data information, and emotional state information; and when determining that the user's state is abnormal based on preset anti-addiction rules, emotional state information, and physical data information, output a prompt message; wherein the preset anti-addiction rules include: the user's usage time exceeds a preset usage time.

[0060] Anti-addiction systems can monitor users' (especially minors') usage behavior on specific devices or applications and proactively intervene and guide them in a timely manner when excessive use may have a negative impact on their physical and mental health.

[0061] For example, when a user experiences emotional distress or a spike in heart rate during gameplay, the system can quickly identify the abnormal state and send a snapshot of the abnormal situation, video playback, or other information as part of a notification to the parent's pre-set mobile device 150, allowing for timely parental intervention. After receiving the notification, the parent can directly connect to the smart TV via a WeChat mini-program or app on the mobile device 150 to conduct voice calls with the current user.

[0062] Furthermore, based on preset anti-addiction rules, when a user's game time exceeds the preset usage time, the system can directly display a prompt message such as "Game time has expired" on the TV screen, and at the same time send the corresponding prompt message to the parents. The parents can then analyze whether to extend the user's game time based on the prompt message and information such as the user's emotional state and physical data.

[0063] The health monitoring system 100 provided in this application embodiment introduces anti-addiction rules for the special user group of minors, which helps parents remotely understand their children's physical and mental health status and behavior during games or smart TV use, and to some extent reduces the burden on parents in daily supervision.

[0064] Furthermore, as another special group using smart TVs, the system can also be used to continuously monitor the physical and mental health of the elderly. In some embodiments, the controller 120 is further configured to determine the user's movement data, physical data information, and emotional state information when the user is identified as an elderly person based on their identity; and to output a prompt message when the user's condition is determined to be abnormal based on the movement data, emotional state information, and physical data information.

[0065] For example, when a user exercises while watching Tai Chi, Wu Qin Xi, or other physical activities on a smart TV, the system can comprehensively analyze the user's current health status based on their exercise data, physical data, and emotional state information. The system can directly display the user's various physical data on the TV screen, allowing the user to intuitively understand their current health status. When an abnormality is detected, the system will output a prompt message to the screen and send it to a preset mobile terminal device 150. Furthermore, the system can analyze whether it needs to send the prompt message to a preset medical or health institution. The prompt message may include image snapshots from the camera, video playback, and audio data from the microphone, used to accurately determine the severity of the user's current physical and mental health abnormality. When an abnormality is detected, the system can also evaluate the user's current exercise data and provide relevant exercise suggestions.

[0066] For example, the system can also learn from users' historical feature data to recommend more suitable sports and enrich users' usage scenarios.

[0067] The health monitoring system 100 provided in this application embodiment is designed for the elderly, a special group, and focuses on their exercise data. It can be used to prevent falls, detect sudden illnesses or emotional problems in a timely manner, and provide elderly users with more reliable physical and mental health monitoring.

[0068] As a concrete example, Figure 3 This is a schematic diagram of another health monitoring system 100 provided in an embodiment of this application. In this health monitoring system 100, the controller 120 is the main control chip of a smart TV, the image acquisition device 110 is a camera built into the smart TV, the audio acquisition device 140 is a microphone built into the smart TV, and the wearable device 130 is a smart bracelet. The communication main control line between the camera and the microphone is connected to the I2C bus of the main control chip of the smart TV, and the main control chip polls the information input from the camera and microphone through the bus; the smart bracelet is connected to the system via Bluetooth.

[0069] When a user uses a smart TV, the camera captures image data and obtains the user's emotional state and identity information through its built-in expression and facial recognition modules. The microphone captures audio data, and the main control chip generates a health report for the user using a pre-set health analysis algorithm. Alternatively, the main control chip can directly send the collected data to a server for processing, where the server generates a health report and downloads it locally. The main control chip can then display the health report directly on the screen. Users can also download and view the health report using mobile devices such as smartphones, for example, through WeChat mini-programs or apps.

[0070] The health monitoring system 100 provided in this application embodiment integrates image data collected by image acquisition device 110 and body data information obtained by wearable device 130, and realizes comprehensive analysis and evaluation of user's health status without the user's awareness or active cooperation, providing a comprehensive and accurate analysis of the user's health status.

[0071] This application also provides a health detection method, applicable to any of the health detection systems 100 provided in this application. Figure 4 This is a flowchart illustrating a health detection method provided in an embodiment of this application, referring to... Figure 4 As shown, this health testing method includes the following steps:

[0072] Step S410: The image acquisition device 110 acquires image data related to the user;

[0073] Step S420: Wearable device 130 acquires the user's body data information;

[0074] Step S430: The controller 120 outputs the user's health report based on the user's emotional state information, identity information and physical data information identified from the image data.

[0075] The health detection method provided in this application embodiment can be applied to any of the health detection systems 100 provided in this application embodiment. The method has all the beneficial effects of the above-mentioned health detection system 100, which will not be repeated here.

[0076] Figure 5 This is a schematic diagram of the structure of an electronic device provided in some embodiments of this application. Figure 5 The dashed line in the text indicates that the unit or module is optional. Figure 5 The electronic device 500 can be used to implement the methods described in the above method embodiments. The electronic device 500 can be a chip, a terminal device, or a first server.

[0077] Electronic device 500 may include one or more processors 510. The processor 510 can support the electronic device 500 in implementing the methods described in the preceding method embodiments. The processor 510 may be a general-purpose processor or a special-purpose processor. For example, the processor may be a Central Processing Unit (CPU). Alternatively, the processor may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0078] The electronic device 500 may also include one or more memories 520. Computer programs are stored on the memories 520. The memories 520 may be independent of the processor 510 or integrated into the processor 510.

[0079] Electronic device 500 may also include transceiver 530. Processor 510 can communicate with other devices or chips via transceiver 530. For example, processor 510 can send and receive data with other devices or chips via transceiver 530.

[0080] The computer program in memory 520 can be executed by processor 510, causing processor 510 to perform the following steps:

[0081] Image acquisition device 110 acquires image data related to the user; wearable device 130 acquires the user's body data information; controller 120 outputs the user's health report based on the user's emotional state information, identity identifier, and body data information identified from the image data.

[0082] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0083] Therefore, embodiments of this application provide a computer-readable storage medium storing a computer program thereon, the computer program being loaded by a processor to execute the steps described in the above-described method embodiments of this application. For example, the computer program, when loaded by a processor, can execute the following steps:

[0084] Image acquisition device 110 acquires image data related to the user; wearable device 130 acquires the user's body data information; controller 120 outputs the user's health report based on the user's emotional state information, identity identifier, and body data information identified from the image data.

[0085] For details on the implementation of each of the above operations / steps, please refer to the previous examples, which will not be repeated here.

[0086] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0087] Since the computer program stored in the computer-readable storage medium can execute the steps in any of the above method embodiments provided in the embodiments of this application, the beneficial effects that the methods described in any of the above method embodiments can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0088] This application also provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the methods provided in the various optional implementations of the above embodiments.

[0089] The above provides a detailed description of a health detection system 100 and method provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A health detection system, characterized by, The system comprises: an image acquisition device, a controller and a wearable device; the controller is in communication connection with the image acquisition device and the wearable device respectively; the image acquisition device is configured to acquire image data related to a user; the wearable device is configured to acquire body data information of the user; the controller is configured to output a health report of the user based on emotional state information of the user identified from the image data, an identity of the user and the body data information.

2. The system of claim 1, wherein the controller is further configured to send the emotional state information of the user, the identity of the user and the body data information to a server, so that the server generates the health report of the user according to the emotional state information, the identity of the user and the body data information.

3. The system of claim 1, wherein, the image data contains face data of the user, and the image acquisition device comprises a face recognition module and an expression recognition module; the face recognition module is configured to determine the identity of the user based on the image data; the expression recognition module is configured to determine the emotional state information of the user based on the image data.

4. The system of claim 1, wherein, The system further comprises an audio acquisition device for acquiring audio data of the user; the controller is configured to output the health report of the user based on the emotional state information, the identity of the user, the body data information and the audio data.

5. The system of any one of claims 1 to 4, wherein the controller is further configured to determine historical feature data of the user based on the identity of the user, and output the health report of the user based on the historical feature data, the body data information and the emotional state information; wherein the historical feature data comprises historical body data information and historical emotional state information corresponding to the user.

6. The system of claim 1, wherein, The system further comprises a mobile terminal device; the mobile terminal device is configured to receive and display the health report of the user.

7. The system of claim 6, wherein the controller is further configured to output prompt information and send it to the mobile terminal device in the case that the health report indicates that the state of the user is abnormal; wherein the prompt information comprises at least one of the following: alarm information; the image data acquired by the image acquisition device when the state is abnormal; audio data acquired by an audio acquisition device when the state is abnormal.

8. The system of claim 7, wherein the controller is further configured to determine a use duration of the user, the body data information and the emotional state information in the case that the user is determined to be a minor based on the identity; output the prompt information in the case that the state of the user is determined to be abnormal based on a preset anti-addiction rule, the emotional state information and the body data information; wherein the preset anti-addiction rule comprises that the use duration of the user exceeds a preset use duration. 9.The system of claim 7, wherein, the controller is further configured to, in a case that the user is determined to be an elderly person based on the identity, determine motion data of the user, the body data information, and the emotional state information; in a case that the state of the user is determined to be abnormal based on the motion data, the emotional state information, and the body data information, output the prompt information.

10. A health detection method characterized by, The method applied to the health detection system of any one of claims 1 to 9, the method comprising: an image acquisition device acquires image data related to a user; a wearable device acquires body data information of the user; a controller outputs a health report of the user based on emotional state information of the user identified from the image data, an identity, and the body data information.

10. The method of claim 9, wherein, the image acquisition device comprises a camera and a microphone; the wearable device comprises a wearable device configured to be worn on a body of the user, and a sensor configured to acquire the body data information of the user; and the controller comprises a processor and a memory, the memory storing a plurality of instructions that, when executed by the processor, cause the processor to: identify the emotional state information of the user from the image data acquired by the image acquisition device; identify the identity of the user from the image data acquired by the image acquisition device; and identify the body data information of the user from the sensor of the wearable device.

Images