State monitoring method, device, equipment, medium and product

Abstract

The invention relates to the technical field of smart home, in particular to a state monitoring method, device and equipment, a medium and a product, and the method comprises the steps: obtaining the biological feature data of a monitoring object collected by smart home equipment; judging whether the state of the monitored object meets a preset condition or not based on the biological characteristic data of the monitored object collected by any smart home device; under the condition that the state of the monitored object is judged to meet a preset condition based on the biological characteristic data of the monitored object collected by any smart home device, whether the state of the monitored object meets the preset condition is determined in combination with the biological characteristic data of the monitored object collected by other smart home devices; the false alarm rate of monitoring equipment can be reduced.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a state monitoring method, device, equipment, medium and product. Background Art

[0002] Smart bracelets, head-mounted monitoring devices and other related wearable devices can only display the current user's blood pressure and heart rate, and cannot accurately reflect the overall status of the current user. It is also impossible to determine whether it is temporary abnormal data or the user's own blood pressure and heart rate are relatively high, and some false alarms often occur. There is a technical problem in the field that the false alarm rate of monitoring equipment is high. Summary of the invention

[0003] The present invention provides a state monitoring method, device, equipment, medium and product, which solve the technical problem of high false alarm rate of monitoring equipment.

[0004] In a first aspect, the present invention provides a status monitoring method, the method comprising: acquiring biometric data of a monitored object collected by a smart home device; judging whether the status of the monitored object meets a preset condition based on the biometric data of the monitored object collected by any smart home device; and when it is judged that the status of the monitored object meets the preset condition based on the biometric data of the monitored object collected by any smart home device, confirming whether the status of the monitored object meets the preset condition in combination with the biometric data of the monitored object collected by other smart home devices.

[0005] In some embodiments, smart home devices include: wearable devices, audio and video devices; biometric data include: current blood pressure, current heart rate, current body temperature, current breathing rate, current blood oxygen saturation, current sweating level, current audio data and / or current image data.

[0006] In some embodiments, the step of judging whether the status of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device includes: judging whether the status of the monitored object meets the preset conditions based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation, current sweating degree, current audio data and / or current image data collected by a wearable device or an audio and video device.

[0007] In some embodiments, when it is judged that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device, the step of confirming whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices includes: when it is judged that the state of the monitored object meets the preset conditions based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree collected by the wearable device, confirming whether the state of the monitored object meets the preset conditions in combination with the current audio data and / or current image data collected by the audio and video device; when it is judged that the state of the monitored object meets the preset conditions based on the current audio data and / or current image data collected by the audio and video device, confirming whether the state of the monitored object meets the preset conditions in combination with the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree collected by the wearable device.

[0008] In some embodiments, judging whether the state of the monitored object meets preset conditions is based on the current image data collected by the audio and video equipment, including: collecting current image data at preset time intervals; sending the current image data to a cloud server for image analysis; upon receiving a warning from the cloud server that the state meets the preset conditions, if the newly collected current image data is the same as the previous image data, then judging that the state of the monitored object meets the preset conditions.

[0009] In some embodiments, the method further includes: outputting an alarm when confirming that the state of the monitored object meets a preset condition.

[0010] In a second aspect, the present invention provides a status monitoring device, which includes: a collection module for acquiring biometric data of a monitored object collected by a smart home device; a judgment module for judging whether the status of the monitored object meets preset conditions based on the biometric data of the monitored object collected by any smart home device; and a confirmation module for confirming whether the status of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices when it is judged that the status of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device.

[0011] In a third aspect, the present invention provides a computer device, comprising a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of any of the condition monitoring methods in the above aspects.

[0012] In a fourth aspect, the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of any of the condition monitoring methods in the above aspects.

[0013] In a fifth aspect, the present invention provides a computer program product, comprising a computer program, which, when executed by a processor, implements the steps of any of the condition monitoring methods in the above aspects.

[0014] The present invention provides a state monitoring method, device, equipment, medium and product, wherein the method comprises: acquiring biometric data of a monitoring object collected by a smart home device; judging whether the state of the monitoring object meets a preset condition based on the biometric data of the monitoring object collected by any smart home device; when judging that the state of the monitoring object meets the preset condition based on the biometric data of the monitoring object collected by any smart home device, confirming whether the state of the monitoring object meets the preset condition in combination with the biometric data of the monitoring object collected by other smart home devices; and being able to reduce the false alarm rate of the monitoring device. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The present invention will be described in more detail below based on embodiments and with reference to the accompanying drawings:

[0016] Figure 1 A schematic diagram of a flow chart of a state monitoring method provided by an embodiment of the present invention;

[0017] Figure 2 A schematic diagram of the structure of a state monitoring device provided by an embodiment of the present invention;

[0018] Figure 3 A schematic diagram of the architecture of an overall linked home host provided as an application example of the present invention.

[0019] In the drawings, the same reference numerals are used for the same components, and the drawings are not drawn to scale. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the scheme of the present invention, and to fully understand and implement how the present invention applies technical means to solve technical problems and achieve the corresponding technical effects, the technical scheme in the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiment of the present invention. Obviously, the described embodiment is only an embodiment of a part of the present invention, not all of the embodiments. The embodiments of the present invention and the various features in the embodiments can be combined with each other without conflict, and the technical schemes formed are all within the scope of protection of the present invention. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work should fall within the scope of protection of the present invention.

[0021] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0022] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0023] Smart bracelets, head-mounted monitoring devices and other related wearable devices can only display the current user's blood pressure and heart rate, and cannot accurately reflect the overall status of the current user. It is also impossible to determine whether it is temporary data that meets the preset conditions or the user's own blood pressure and heart rate are relatively high, and some false alarms often occur. There is a technical problem in the field that the false alarm rate of monitoring equipment is high.

[0024] In order to solve the technical problem of the high false alarm rate of the above-mentioned monitoring equipment, the present invention proposes a state monitoring method, device, equipment, medium and product. The implementation details of the present invention are described in detail below. The following content is only for the convenience of understanding the implementation details and is not necessary for the implementation of this solution.

[0025] Embodiment 1

[0026] Figure 1 is a flow chart of a state monitoring method provided in an embodiment of the present application, such as Figure 1 As shown, in the technical solution of this embodiment, a state monitoring method is provided, and the method includes: acquiring biometric data of the monitored object collected by the smart home device; judging whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device; when it is judged that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device, confirming whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices.

[0027] The technical problem to be solved by this embodiment is how to reduce the false alarm rate of the monitoring equipment.

[0028] In the technical solution of this embodiment, the user's home smart home wearable device is first connected to the home host (such as through WiFi LAN AP link, Bluetooth mesh networking connection, serial port 485 direct connection, etc.) to collect the user's health data, including blood pressure, heart rate, body temperature, respiratory rate, sweating, etc. At the same time, the image data of the user in the house (such as user facial and action behavior data) and audio data (such as coughing, breathing sounds, etc.) are collected from the camera. When the state of the monitored object is judged to meet the preset conditions based on the biometric data of the monitored object collected by any smart home device, such as the wearable device detects a sudden increase in heart rate, it will not alarm immediately, but confirm it in combination with the biometric data of the monitored object collected by other smart home devices. For example, check whether the user collected by the camera has body characteristics that meet the preset conditions, such as covering the chest with hands, breathing heavily, etc., and whether there are long-term coughing or rapid breathing sounds that meet the preset conditions in the audio data. By integrating and analyzing the data collected by multiple devices, it is possible to avoid the situation where a single device data meets the preset conditions and false alarms, thereby reducing the false alarm rate.

[0029] The technical solution of this embodiment, through the above-mentioned multi-device data fusion analysis method, comprehensively considers the user's various physical characteristics information, and no longer relies solely on a certain health data of a single wearable device. For example, for a user who has high blood pressure but no other physical discomfort, when the wearable device detects that the blood pressure is slightly higher than the normal range, it may be a false alarm if it is based only on this data, but combined with the camera to observe that the user moves freely, has a normal expression, and the audio data is normal, it can be judged that the user has no acute health problems at this time, avoiding unnecessary alarms. This method greatly improves the accuracy and reliability of monitoring, reduces the false alarm rate, and provides users with more accurate health monitoring services, especially for people such as middle-aged and elderly people who need to pay special attention to their health conditions, reducing the troubles caused by false alarms, and also ensuring that accurate alarms can be issued in time when a dangerous situation really occurs, protecting the life safety and health of users.

[0030] Embodiment 2

[0031] Based on the above embodiment, smart home devices include: wearable devices, audio and video devices; biometric data include: current blood pressure, current heart rate, current body temperature, current breathing rate, current blood oxygen saturation, current sweating level, current audio data and / or current image data.

[0032] In the technical solution of this embodiment, the smart home device includes a wearable device and an audio / video device. The wearable device is mainly used to collect the user's physiological data, for example, it can monitor the user's blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation, sweating degree and other information in real time, and can intuitively reflect the basic physiological state of the user's body. The audio and video equipment includes a camera and an audio acquisition device. The camera is responsible for collecting the image data of the user in the house, such as the user's posture, movement, facial expression, etc., which can assist in judging whether the user's physical state is normal, such as whether there are postures that meet the preset conditions such as falling to the ground, lying on the side, covering the chest with hands, rolling eyes, etc. The audio acquisition device can collect audio data such as the user's cough and breathing sound. For example, by analyzing the duration, frequency and rapidity of the cough audio, the user's health status can be further judged, and the user's status can be more targeted and comprehensively monitored, giving full play to the advantages of different devices, and improving the accuracy and reliability of monitoring.

[0033] According to the technical solution of this embodiment, for a user suffering from cardiovascular disease, for example, the wearable device can continuously monitor key physiological indicators such as blood pressure and heart rate. Once a fluctuation that meets the preset conditions occurs, the audio and video equipment can quickly supplement more information. If the camera captures images of the user's pale face and hand on the wall, and the audio device collects the sound of shortness of breath, this information combined with the data of the wearable device can provide a more comprehensive understanding of the user's physical condition and provide a richer basis for subsequent judgment and processing. This clear device classification and data collection method not only improves the accuracy of user health status monitoring, but also makes it easier to build and maintain the system in actual applications, reduces the risk of missing or inaccurate data collection due to unclear equipment, and provides users with a more stable and reliable health monitoring service.

[0034] Embodiment 3

[0035] On the basis of the above embodiments, the step of judging whether the status of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device includes: judging whether the status of the monitored object meets the preset conditions based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation, current sweating degree, current audio data and / or current image data collected by a wearable device or an audio and video device.

[0036] The technical problem solved by this embodiment is how to determine whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device.

[0037] In the technical solution of this embodiment, it is determined whether the state of the monitored object meets the preset conditions based on a variety of biometric data collected by wearable devices or audio and video devices. For the current blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation, sweating degree and other data collected by the wearable device, the threshold range of the corresponding preset conditions is set. For example, when the blood pressure is lower than 90 / 60mmHg or higher than 180 / 110mmHg, it indicates that the body may be in a state that meets the preset conditions; a heart rate higher than 100 beats / minute or lower than 40 beats / minute may also indicate physical discomfort; a body temperature lower than 35°C or higher than 38°C also requires attention; a respiratory rate that is too fast or too slow, a blood oxygen saturation that is lower than the normal range, and a sweating degree that meets the preset conditions are all signals that the body may meet the preset conditions. There is also a corresponding judgment method for the current audio data and / or current image data collected by the audio and video device. If the audio data contains a long cough (more than 30 seconds), rapid breathing, or groaning that meets the preset conditions, it means that the user may have a physical problem; if the user is observed to fall to the ground, lie on his side, cover his chest with his hands, roll his eyes, or have body twitches in the image data, it also indicates that the user's state meets the preset conditions. Through comprehensive analysis of these different types of data and threshold judgment, it is possible to more accurately judge whether the state of the monitored object meets the preset conditions and avoid misjudgment of single data.

[0038] The technical solution of this embodiment improves the accuracy of judging whether the state of the monitored object meets the preset conditions by setting and analyzing the thresholds of various data collected by the wearable device and the audio and video device in a refined manner. For example, when an elderly person is in daily activities, the wearable device detects that his heart rate suddenly rises to 110 beats / minute, which may cause initial concern, but this data alone is not enough to determine that the elderly person has serious physical problems. At this time, combined with the image data collected by the audio and video device, if it is found that the elderly person has a normal complexion and is only doing some mild physical activities, such as walking slowly, packing items, etc., the image data of each time is very different and not the same, and the breathing in the audio data is stable, and there is no cough or shortness of breath that meets the preset conditions, then it can be judged that the elderly person’s heart rate increase at this time may be caused by normal activities, rather than acute diseases in the body. This method based on comprehensive judgment of multiple data effectively reduces the occurrence of misjudgment, provides users with more scientific and accurate health monitoring services, and ensures that when health risks really occur, they can be discovered and taken corresponding measures in time to protect the user’s physical health and life safety.

[0039] Embodiment 4

[0040] On the basis of the above embodiments, when it is judged that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device, the step of confirming whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices includes: when it is judged that the state of the monitored object meets the preset conditions based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree collected by the wearable device, confirming whether the state of the monitored object meets the preset conditions in combination with the current audio data and / or current image data collected by the audio and video device; when it is judged that the state of the monitored object meets the preset conditions based on the current audio data and / or current image data collected by the audio and video device, confirming whether the state of the monitored object meets the preset conditions in combination with the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree collected by the wearable device.

[0041] The technical problem solved by this embodiment is how to confirm whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices when it is judged that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device.

[0042] In the technical solution of this embodiment, when the state of the monitored object is judged to meet the preset conditions based on the current blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation and / or current sweating degree collected by the wearable device, for example, the wearable device detects that the user's blood pressure drops suddenly, the heart rate is too fast and the sweating increases, the system will quickly confirm it in combination with the current audio data and / or current image data collected by the audio and video device. Analyze whether there are rapid breathing sounds, painful groans or long coughs that meet the preset conditions from the audio data; check whether the user has obvious physical discomfort postures from the image data, such as covering the chest with hands, falling to the ground, pale face, etc. Correspondingly, when the state of the monitored object is judged to meet the preset conditions based on the current audio data and / or current image data collected by the audio and video device, such as the camera captures the user suddenly falling to the ground, and the audio device detects a shouting sound that meets the preset conditions, the system will combine the current blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation and / or current sweating degree data collected by the wearable device to further verify the user's physical condition. Through this multiple data combination and confirmation mechanism, the actual status of the monitored object can be judged more comprehensively and accurately, avoiding misjudgment caused by a single device data meeting the preset conditions.

[0043] The technical solution of this embodiment greatly improves the accuracy and reliability of the state judgment of the monitored object through a variety of data combination and confirmation methods. For example, in a family scene, when the user is resting at night, the wearable device detects that his heart rate fluctuates briefly in accordance with the preset conditions, but because the user is in a sleeping state, his posture and behavior cannot be directly observed. At this time, the role of the audio and video equipment is highlighted. The infrared function of the camera collects the user's sleep image, and it is found that the user's sleeping posture is normal, and there is no struggle, twitching and other actions that meet the preset conditions. There is no breathing or coughing that meets the preset conditions in the audio data. Therefore, it can be preliminarily judged that the user's heart rate meets the preset conditions. It may be caused by short-term physiological fluctuations in sleep, rather than an acute disease attack. On the contrary, if the audio and video equipment first detects that the user suddenly falls to the ground while being active in the living room, and at the same time makes a painful cry, at this time, combined with the data of the wearable device, if it is found that the blood pressure drops sharply and the heart rate accelerates in accordance with the preset conditions, it can be more determined that the user has a serious problem with the body and needs to take emergency measures immediately. This method of mutual verification of multi-device data effectively reduces the false alarm rate, provides users with more accurate and reliable health monitoring services, and ensures the life safety and health of users in a home environment.

[0044] Embodiment 5

[0045] On the basis of the above embodiment, judging whether the state of the monitored object meets the preset conditions is based on the current image data collected by the audio and video equipment, including: collecting current image data at preset time intervals; sending the current image data to the cloud server for image analysis; upon receiving a warning from the cloud server that the state meets the preset conditions, if the newly collected current image data is the same as the previous image data, then judging that the state of the monitored object meets the preset conditions.

[0046] The technical problem solved by this embodiment is how to determine whether the state of the monitored object meets the preset conditions based on the current image data collected by the audio and video equipment.

[0047] In the technical solution of this embodiment, it is first set to collect the current image data once every preset time (for example, every 10 seconds), and then send these image data to the cloud server for image analysis. The cloud server uses advanced image recognition technology and display algorithms to analyze the user's posture, movement, expression, etc. to determine whether there is a situation that meets the preset conditions. For example, the cloud server can compare the continuously collected images to detect whether the user suddenly falls to the ground, lies on his side for a long time, shakes violently, covers his chest with his hands, and other postures that meet the preset conditions. After receiving the warning that the status meets the preset conditions fed back by the cloud server, the home host will not immediately determine that the status of the monitored object meets the preset conditions, but further compare the newly collected current image data with the previous image data to see if they are the same. If the newly collected image data and the previous image data show that the user is still in the same posture that meets the preset conditions, such as falling to the ground continuously or keeping the posture of covering the chest with hands for more than a certain time (for example, 5 seconds), it is determined that the status of the monitored object meets the preset conditions. By combining this method of cloud server analysis and local image data comparison, it is possible to more accurately determine whether the status of the monitored object meets the preset conditions based on the current image data collected by the audio and video equipment, and reduce the false alarm caused by misjudgment of image data. Moreover, since the image analysis is performed through the cloud server, the image comparison is performed on the local home host after confirming that the preset conditions are met, it can be determined more quickly whether the user status meets the preset conditions without waiting for the home host to communicate with the cloud server.

[0048] The technical solution of this embodiment significantly improves the accuracy of judging whether the state of the monitored object meets the preset conditions based on the image data of the audio and video equipment through the image analysis capability of the cloud server and the comparison and verification of the local image data. For example, in the home of an elderly person living alone, the camera collects the image data of the elderly at a set time interval and sends it to the cloud server. When analyzing the image, the cloud server may misjudge the posture of the elderly as meeting the preset conditions due to the short-term influence of factors such as light and angle, but when the home host compares the newly collected image with the previous image, it is found that the elderly only bends down briefly to pick up something, and then resumes normal activities, thereby avoiding a false alarm. In a real emergency, such as a sudden heart attack and falling to the ground, the cloud server can issue an early warning in time through the analysis of continuous images. After the home host confirms that the elderly has been in a state of falling to the ground recently through image comparison, it quickly determines that the elderly's body meets the preset conditions and starts the alarm and rescue program in time. This precise image data judgment method not only reduces the occurrence of false alarms, but also can quickly and accurately discover the health crisis of users at critical moments, providing more reliable security for people who need to be focused on, such as elderly people living alone, ensuring that they can receive timely and effective health monitoring and rescue in a home environment.

[0049] Embodiment 6

[0050] Based on the above embodiment, the method further includes: outputting an alarm when confirming that the state of the monitored object meets the preset conditions.

[0051] The technical problem solved by this embodiment is how to output an alarm.

[0052] In the technical solution of this embodiment, when it is confirmed that the state of the monitored object meets the preset conditions, the home host will start the alarm program. The home host sends an alarm message to the user's preset emergency contact through a built-in communication module (such as a push notification function connected to a mobile phone APP, a text message notification function, or a voice alarm function with a smart speaker or other device), including the user's current location information (obtained through the positioning function of the home host or the linkage with the indoor positioning device), a description of the state that meets the preset conditions (such as the blood pressure and heart rate data detected by the wearable device that meet the preset conditions, and the user's body shape and audio collected by the audio and video device that meet the preset conditions, etc.), so that the emergency contact can quickly understand the user's general situation and take corresponding rescue measures. At the same time, the home host also establishes a direct communication connection with the local emergency center, community medical service agency, etc., automatically dials the emergency number and provides detailed user health information and home address to the emergency personnel, ensuring that the emergency personnel can arrive at the scene for rescue in the shortest time. In addition, the home host will also control the smart lighting equipment, smart door locks and other equipment in the house, turn on the lighting to allow rescue personnel to enter the house, and unlock the door locks to facilitate the rescue operation. Through these various alarm outputs, relevant personnel can be quickly notified when the user's status meets the preset conditions, maximizing rescue time and ensuring the user's life safety.

[0053] The technical solution of this embodiment provides users with all-round protection in emergency situations through a variety of alarm output methods. For example, a user suddenly develops an acute disease at home. After the home host detects that his status meets the preset conditions, it immediately sends an alarm message to the user's children through the mobile phone APP. The children can see that their parents' health data meets the preset conditions and the home location at the first time. At the same time, the home host calls the local emergency number and sends the user's detailed health records (such as past medical history, recent physical examination data, etc., which can be pre-stored in the cloud server and associated with the home host) to the emergency center, so that the emergency personnel can have a preliminary understanding of the patient's condition on the way and make corresponding emergency preparations. When the emergency personnel arrive at the door, the smart door lock has been automatically unlocked and the indoor lighting has been turned on, which provides convenience for the rescue operation. This efficient and comprehensive alarm output mechanism improves the timeliness and success rate of rescue, and protects the life and health of users, especially for those who are more fragile and prone to sudden illness, such as the elderly or patients with chronic diseases. It can play a vital role at critical moments and reduce the serious consequences caused by untimely rescue.

[0054] Embodiment 7

[0055] Figure 2 is a schematic diagram of the structure of a state monitoring device provided in an embodiment of the present application, such as Figure 2 As shown, in the technical solution of this embodiment, a state monitoring device is provided, and the device includes: a collection module, which is used to obtain biometric data of the monitored object collected by the smart home device; a judgment module, which is used to judge whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device; a confirmation module, which is used to confirm whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices when it is judged that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device.

[0056] The technical problem to be solved by this embodiment is how to reduce the false alarm rate of the monitoring equipment.

[0057] In the technical solution of this embodiment, the smart home wearable device of the user's home is first connected through the home host (such as through WiFi LAN AP link, Bluetooth mesh networking connection, serial port 485 direct connection, etc.) to collect the user's health data, including blood pressure, heart rate, body temperature, respiratory rate, sweating, etc. At the same time, the picture data of the user in the house (such as user facial and action behavior data) and audio data (such as coughing, breathing sounds, etc.) are collected from the camera. When the state of the monitored object is judged to meet the preset conditions based on the biometric data of the monitored object collected by any smart home device, such as the wearable device detects a sudden increase in heart rate, it will not alarm immediately, but confirm it in combination with the biometric data of the monitored object collected by other smart home devices. For example, check whether the user collected by the camera has body features that meet the preset conditions, such as covering the chest with hands, breathing heavily, etc., and whether there are long coughs or rapid breathing sounds that meet the preset conditions in the audio data. By integrating and analyzing the data collected by multiple devices, it is avoided that the single device data meets the preset conditions and the false alarm is false, thereby reducing the false alarm rate.

[0058] The technical solution of this embodiment, through the above-mentioned multi-device data fusion analysis method, comprehensively considers the user's various physical characteristics information, and no longer relies solely on a certain health data of a single wearable device. For example, for a user who has high blood pressure but no other physical discomfort, when the wearable device detects that the blood pressure is slightly higher than the normal range, it may be a false alarm if it is based only on this data, but combined with the camera to observe that the user moves freely, has a normal expression, and the audio data is normal, it can be judged that the user has no acute health problems at this time, avoiding unnecessary alarms. This method greatly improves the accuracy and reliability of monitoring, reduces the false alarm rate, and provides users with more accurate health monitoring services, especially for people such as middle-aged and elderly people who need to pay special attention to their health conditions, reducing the troubles caused by false alarms, and also ensuring that accurate alarms can be issued in time when a dangerous situation really occurs, protecting the life safety and health of users.

[0059] Based on the above embodiment, smart home devices include: wearable devices, audio and video devices; biometric data include: current blood pressure, current heart rate, current body temperature, current breathing rate, current blood oxygen saturation, current sweating level, current audio data and / or current image data.

[0060] In the technical solution of this embodiment, the smart home device includes a wearable device and an audio / video device. The wearable device is mainly used to collect the user's physiological data, for example, it can monitor the user's blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation, sweating degree and other information in real time, and can intuitively reflect the basic physiological state of the user's body. The audio and video equipment includes a camera and an audio acquisition device. The camera is responsible for collecting the image data of the user in the house, such as the user's posture, movement, facial expression, etc., which can assist in judging whether the user's physical state is normal, such as whether there are postures that meet the preset conditions such as falling to the ground, lying on the side, covering the chest with hands, rolling eyes, etc. The audio acquisition device can collect audio data such as the user's cough and breathing sound. For example, by analyzing the duration, frequency and rapidity of the cough audio, the user's health status can be further judged, and the user's status can be more targeted and comprehensively monitored, giving full play to the advantages of different devices, and improving the accuracy and reliability of monitoring.

[0061] According to the technical solution of this embodiment, for a user suffering from cardiovascular disease, for example, the wearable device can continuously monitor key physiological indicators such as blood pressure and heart rate. Once a fluctuation that meets the preset conditions occurs, the audio and video equipment can quickly supplement more information. If the camera captures images of the user's pale face and hand on the wall, and the audio device collects the sound of shortness of breath, this information combined with the data of the wearable device can provide a more comprehensive understanding of the user's physical condition and provide a richer basis for subsequent judgment and processing. This clear device classification and data collection method not only improves the accuracy of user health status monitoring, but also makes it easier to build and maintain the system in actual applications, reduces the risk of missing or inaccurate data collection due to unclear equipment, and provides users with a more stable and reliable health monitoring service.

[0062] On the basis of the above embodiments, the step of judging whether the status of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device includes: judging whether the status of the monitored object meets the preset conditions based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation, current sweating degree, current audio data and / or current image data collected by a wearable device or an audio and video device.

[0063] The technical problem solved by this embodiment is how to determine whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device.

[0064] In the technical solution of this embodiment, it is determined whether the state of the monitored object meets the preset conditions based on a variety of biometric data collected by wearable devices or audio and video devices. For the current blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation, sweating degree and other data collected by the wearable device, a corresponding threshold range that meets the preset conditions is set. For example, when the blood pressure is lower than 90 / 60mmHg or higher than 180 / 110mmHg, it indicates that the body may meet the preset conditions; a heart rate higher than 100 beats / minute or lower than 40 beats / minute may also indicate physical discomfort; a body temperature lower than 35°C or higher than 38°C also requires attention; a respiratory rate that is too fast or too slow, a blood oxygen saturation lower than the normal range, and a sweating degree that meets the preset conditions are all signals that the body may meet the preset conditions. For the current audio data and / or current image data collected by the audio and video device, there is also a corresponding judgment device. If the audio data contains a long cough (more than 30 seconds), rapid breathing, or groaning that meets the preset conditions, it means that the user may have a physical problem; if the user is observed to fall to the ground, lie on his side, cover his chest with his hands, roll his eyes, or have body twitches in the image data, it also indicates that the user's state meets the preset conditions. Through comprehensive analysis of these different types of data and threshold judgment, it is possible to more accurately judge whether the state of the monitored object meets the preset conditions and avoid misjudgment of single data.

[0065] The technical solution of this embodiment improves the accuracy of judging whether the state of the monitored object meets the preset conditions by setting and analyzing the thresholds of various data collected by the wearable device and the audio and video device in a refined manner. For example, when an elderly person is in daily activities, the wearable device detects that his heart rate suddenly rises to 110 beats / minute, which may cause initial concern, but this data alone is not enough to determine that the elderly person has serious physical problems. At this time, combined with the image data collected by the audio and video device, if it is found that the elderly person has a normal complexion and is only doing some mild physical activities, such as walking slowly, packing items, etc., the image data of each time is very different and not the same, and the breathing in the audio data is stable, and there is no cough or shortness of breath that meets the preset conditions, then it can be judged that the elderly person’s heart rate increase at this time may be caused by normal activities, rather than acute diseases in the body. This method based on comprehensive judgment of multiple data effectively reduces the occurrence of misjudgment, provides users with more scientific and accurate health monitoring services, and ensures that when health risks really occur, they can be discovered and taken corresponding measures in time to protect the user’s physical health and life safety.

[0066] On the basis of the above embodiments, when it is judged that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device, the step of confirming whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices includes: when it is judged that the state of the monitored object meets the preset conditions based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree collected by the wearable device, confirming whether the state of the monitored object meets the preset conditions in combination with the current audio data and / or current image data collected by the audio and video device; when it is judged that the state of the monitored object meets the preset conditions based on the current audio data and / or current image data collected by the audio and video device, confirming whether the state of the monitored object meets the preset conditions in combination with the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree collected by the wearable device.

[0067] The technical problem solved by this embodiment is how to confirm whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices when it is judged that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device.

[0068] In the technical solution of this embodiment, when the state of the monitored object is judged to meet the preset conditions based on the current blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation and / or current sweating degree collected by the wearable device, for example, the wearable device detects that the user's blood pressure drops suddenly, the heart rate is too fast and the sweating increases, the system will quickly confirm it in combination with the current audio data and / or current image data collected by the audio and video device. Analyze whether there are rapid breathing sounds, painful groans or long coughs that meet the preset conditions from the audio data; check whether the user has obvious physical discomfort postures from the image data, such as covering the chest with hands, falling to the ground, pale face, etc. Correspondingly, when the state of the monitored object is judged to meet the preset conditions based on the current audio data and / or current image data collected by the audio and video device, such as the camera captures the user suddenly falling to the ground, and the audio device detects a shouting sound that meets the preset conditions, the system will further verify the user's physical condition in combination with the current blood pressure, heart rate, body temperature, respiratory rate, blood oxygen saturation and / or current sweating degree data collected by the wearable device. Through this multiple data combination and confirmation mechanism, the actual status of the monitored object can be judged more comprehensively and accurately, avoiding misjudgment caused by a single device data meeting the preset conditions.

[0069] The technical solution of this embodiment greatly improves the accuracy and reliability of the state judgment of the monitored object through a variety of data combination and confirmation methods. For example, in a family scene, when the user is resting at night, the wearable device detects that his heart rate fluctuates briefly in accordance with the preset conditions, but because the user is in a sleeping state, his posture and behavior cannot be directly observed. At this time, the role of the audio and video equipment is highlighted. The infrared function of the camera collects the user's sleep image, and it is found that the user's sleeping posture is normal, and there is no struggle, twitching and other actions that meet the preset conditions. There is no breathing or coughing that meets the preset conditions in the audio data. Therefore, it can be preliminarily judged that the user's heart rate meets the preset conditions. It may be caused by short-term physiological fluctuations in sleep, rather than an acute disease attack. On the contrary, if the audio and video equipment first detects that the user suddenly falls to the ground while being active in the living room, and at the same time makes a painful cry, at this time, combined with the data of the wearable device, if it is found that the blood pressure drops sharply and the heart rate accelerates in accordance with the preset conditions, it can be more determined that the user has a serious problem with his body and needs to take emergency measures immediately. This device with multiple device data corroborating each other effectively reduces the false alarm rate, provides users with more accurate and reliable health monitoring services, and ensures the life safety and health of users in a home environment.

[0070] On the basis of the above embodiment, judging whether the state of the monitored object meets the preset conditions is based on the current image data collected by the audio and video equipment, including: collecting current image data at preset time intervals; sending the current image data to the cloud server for image analysis; upon receiving a warning from the cloud server that the state meets the preset conditions, if the newly collected current image data is the same as the previous image data, then judging that the state of the monitored object meets the preset conditions.

[0071] The technical problem solved by this embodiment is how to determine whether the state of the monitored object meets the preset conditions based on the current image data collected by the audio and video equipment.

[0072] In the technical solution of this embodiment, it is first set to collect the current image data once every preset time (for example, every 10 seconds), and then send these image data to the cloud server for image analysis. The cloud server uses advanced image recognition technology and display algorithms to analyze the user's posture, movement, expression, etc. to determine whether there is a situation that meets the preset conditions. For example, the cloud server can compare the continuously collected images to detect whether the user suddenly falls to the ground, lies on his side for a long time, shakes violently, covers his chest with his hands, and other postures that meet the preset conditions. After receiving the warning that the status meets the preset conditions fed back by the cloud server, the home host will not immediately determine that the status of the monitored object meets the preset conditions, but further compare the newly collected current image data with the previous image data to see if they are the same. If the newly collected image data and the previous image data show that the user is still in the same posture that meets the preset conditions, such as falling to the ground continuously or keeping the posture of covering the chest with hands for more than a certain time (for example, 5 seconds), it is determined that the status of the monitored object meets the preset conditions. By combining this method of cloud server analysis and local image data comparison, it is possible to more accurately determine whether the status of the monitored object meets the preset conditions based on the current image data collected by the audio and video equipment, and reduce the false alarm caused by misjudgment of image data. Moreover, since the image analysis is performed through the cloud server, the image comparison is performed on the local home host after confirming that the preset conditions are met, it can be determined more quickly whether the user status meets the preset conditions without waiting for the home host to communicate with the cloud server.

[0073] The technical solution of this embodiment significantly improves the accuracy of judging that the state of the monitored object meets the preset conditions based on the image data of the audio and video equipment through the image analysis capability of the cloud server and the comparison and verification of the local image data. For example, in the home of an elderly person living alone, the camera collects the image data of the elderly at a set time interval and sends it to the cloud server. When analyzing the image, the cloud server may misjudge the posture of the elderly as a posture that meets the preset conditions due to the short-term influence of factors such as light and angle. However, when the home host compares the newly collected image with the previous image, it is found that the elderly only bends down to pick up something for a short time, and then resumes normal activities, thereby avoiding a false alarm. In a real emergency, such as a sudden heart attack and falling to the ground, the cloud server can issue an early warning in time through the analysis of continuous images. After the home host confirms that the elderly has been in a state of falling to the ground recently through image comparison, it quickly determines that the elderly's body meets the preset conditions and starts the alarm and rescue program in time. This precise image data judgment device not only reduces the occurrence of false alarms, but also can quickly and accurately discover the health crisis of users at critical moments, providing more reliable security for people who need to be focused on, such as elderly people living alone, and ensuring that they can receive timely and effective health monitoring and rescue in a home environment.

[0074] Based on the above embodiment, the device further includes: outputting an alarm when confirming that the state of the monitored object meets the preset conditions.

[0075] The technical problem solved by this embodiment is how to output an alarm.

[0076] In the technical solution of this embodiment, when it is confirmed that the state of the monitored object meets the preset conditions, the home host will start the alarm program. The home host sends an alarm message to the user's preset emergency contact through a built-in communication module (such as a push notification function connected to a mobile phone APP, a text message notification function, or a voice alarm function with a smart speaker or other device), including the user's current location information (obtained through the positioning function of the home host or the linkage with the indoor positioning device), abnormal state description (such as blood pressure and heart rate abnormal data detected by the wearable device, and user posture and audio abnormalities collected by the audio and video device, etc.), so that the emergency contact can quickly understand the user's general situation and take corresponding rescue measures. At the same time, the home host also establishes a direct communication connection with the local emergency center, community medical service agency, etc., automatically dials the emergency number and provides detailed user health information and home address to the emergency personnel, ensuring that the emergency personnel can arrive at the scene for rescue in the shortest time. In addition, the home host will also control the smart lighting equipment, smart door locks and other equipment in the house, turn on the lighting to allow rescue personnel to enter the house, and unlock the door locks to facilitate the rescue operation. Through these various alarm outputs, relevant personnel can be quickly notified when the user's status meets the preset conditions, maximizing rescue time and ensuring the user's life safety.

[0077] The technical solution of this embodiment provides users with all-round protection in emergency situations through a variety of alarm output methods. For example, a user suddenly develops an acute disease at home. After the home host detects that its status meets the preset conditions (i.e., the conditions that require an alarm), it immediately sends an alarm message to the user's children through the mobile phone APP. The children can see the abnormal health data and home location of their parents at the first time. At the same time, the home host calls the local emergency number and sends the user's detailed health file (such as past medical history, recent physical examination data, etc., which can be pre-stored in the cloud server and associated with the home host) to the emergency center, so that the emergency personnel can have a preliminary understanding of the patient's condition on the way and make corresponding emergency preparations. When the emergency personnel arrive at the door of the house, the smart door lock has been automatically unlocked and the indoor lighting has been turned on, which provides convenience for the rescue operation. This efficient and comprehensive alarm output mechanism improves the timeliness and success rate of rescue, and protects the life and health of users, especially for those who are more fragile and prone to sudden illness, such as the elderly or patients with chronic diseases. It can play a vital role at critical moments and reduce the serious consequences caused by untimely rescue.

[0078] Embodiment 8

[0079] In the technical solution of this embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory, and the processor executes the computer program to implement the steps of any one of the state monitoring methods in the above embodiments.

[0080] In the technical solution of this embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the state monitoring methods in the above embodiments are implemented.

[0081] In the technical solution of this embodiment, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps of any of the state monitoring methods in the above embodiments are implemented.

[0082] The processor may include, but is not limited to, for example, one or more processors or microprocessors. Each processor may be an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a controller, a microcontroller, a microprocessor or other electronic components to implement the method in the above embodiment. The computer readable storage medium may be implemented by any type of volatile or non-volatile storage device or a combination thereof, and the computer readable storage medium may include, but is not limited to, for example, a random access memory (RAM), a read-only memory (ROM), a flash memory, an EPROM memory, an EEPROM memory, a register, a computer storage medium (such as a hard disk, a floppy disk, a solid state drive, a removable disk, a CDROM, a DVDROM, a Blu-ray disc, etc.).

[0083] The computer-readable storage medium may also store at least one computer executable program / instruction, which may be, for example, a computer-readable instruction. The computer-readable storage medium includes, but is not limited to, for example, a volatile memory and / or a non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The computer-readable storage medium may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. For example, a non-transitory computer-readable storage medium may be connected to a computing device such as a computer, and then, when the computing device runs the computer-readable instructions stored on the computer-readable storage medium, the various methods described above may be performed.

[0084] In addition, the computer device may also include (but not limited to) a data bus, an input / output (I / O) bus, a display, and an input / output device (e.g., a keyboard, a mouse, a speaker, etc.). The processor may communicate with external devices via the I / O bus via a wired or wireless network. In one embodiment, the at least one computer executable instruction may also be compiled into or constitute a software product / computer program product, wherein one or more computer executable instructions are executed by the processor to perform the various functions and / or steps of the method in the embodiments described in the present technology.

[0085] Embodiment 9

[0086] Based on the above embodiments, this embodiment provides an application example.

[0087] This application example provides a method for implementing monitoring of abnormal conditions such as myocardial infarction by smart home monitoring hardware based on a home central control host.

[0088] In recent years, with the increase in social life pressure, it is not uncommon for people to be in dangerous physical conditions, such as myocardial infarction, myocardial thrombosis, acute angina pectoris and other dangerous conditions that require timely medical treatment, otherwise there may be a risk of death within a short period of time.

[0089] For example, the common myocardial infarction (MI) is one of them. The disease is mainly caused by coronary artery obstruction leading to myocardial hypoxia and necrosis. Its onset characteristics include sudden onset of severe chest pain, which lasts for a long time and is difficult to relieve, and may be accompanied by symptoms such as nausea, vomiting, and sweating. Myocardial infarction is extremely harmful. Acute myocardial infarction can lead to changes in blood pressure, heart rate, and heart rhythm. At the beginning of the onset, symptoms of heart failure such as chest tightness, shortness of breath, difficulty breathing, and cough will appear, or shock symptoms such as confusion, pale skin, cold limbs, sweating all over the body, and low blood pressure will appear.

[0090] The incidence and mortality of myocardial infarction have shown an upward trend in my country in recent years. It is no longer a disease exclusive to the elderly. The incidence of myocardial infarction among young people is also increasing year by year. According to data from the Chinese Center for Disease Control and Prevention, the number of patients with acute myocardial infarction among young people aged 25 to 44 in my country increased by 36% from 1990 to 2019.

[0091] Related wearable devices (such as smart bracelets, head-mounted monitoring devices, etc.) can only display the current user's blood pressure and heart rate, and cannot accurately reflect the overall status of the current user. It is also impossible to determine whether it is temporary abnormal data or the user's own blood pressure and heart rate are relatively high, resulting in some false alarms. There is no way to compare and analyze the user's usual data.

[0092] There is a technical problem in this field that the false alarm rate of monitoring equipment is high.

[0093] The technical solution of the present invention, based on the home host, can be connected to the mainstream smart home wearable devices on the market (including but not limited to WiFi LAN AP link, Bluetooth mesh networking connection, serial port 485 direct connection, etc.), and can collect user health data of smart wearable devices, so as to compare the data that currently meets the preset conditions and needs to be alarmed with the normal data for evaluation, and conduct in-depth analysis of the actual data images and audio data obtained through other monitoring and voice control devices, so as to judge the actual status of the user, and thus perform corresponding rescue and alarm functions, rather than frequent false alarms through data obtained from a single wearable device.

[0094] The technical solution of the present invention integrates and analyzes the user's existing physical condition data and the warning information currently collected in the wearable device or data information that meets preset conditions (such as a sudden increase in blood pressure data, a sudden increase in heart rate, etc.) to determine whether the user's current heart rate is normal and meets the preset conditions or is suffering from an acute disease such as a sudden myocardial infarction. It can more accurately call for help and alarm the user, solve the defect of false alarm in the existing single wearable device technology that obtains a certain health data that meets the preset conditions, and provide safer, more efficient and convenient health protection for middle-aged and elderly people.

[0095] The technical solution of the present invention integrates and analyzes the user's usually collected physical condition data and the warning information currently collected in the wearable device or data information that meets the preset conditions (such as a sudden drop in blood pressure data, a sudden drop in heart rate, etc.) and the user's current video data and audio data captured by the surveillance camera to determine whether the user's current heart rate is normal and meets the preset conditions or has an acute disease such as a sudden myocardial infarction. It can more accurately call for help and alarm the user, solve the defect of false alarm that obtains a certain health data that meets the preset conditions in the existing single wearable device technology, and provide safer, more efficient and convenient health protection for middle-aged and elderly people.

[0096] Figure 3 This is a schematic diagram of the overall architecture of the home host of the present invention. Figure 3 Based on the home host, it can connect to the mainstream smart home wearable devices or head-mounted devices on the market (including but not limited to WiFi LAN AP link, Bluetooth mesh networking connection, serial port 485 direct connection, etc.), and can collect user health data of smart wearable devices, including collecting 1. Collecting the user's blood pressure, heart rate, body temperature, respiratory rate, sweating or not from the smart home wearable device; 2. Collecting the user's picture data in the house from the camera, such as the user's face and action behavior data, to determine whether the user's physical state is normal; when it is determined that the user's state meets the preset conditions, call for help. In addition, the home host is also connected to the cloud server to send the data of wearable devices, head-mounted devices, cameras and other devices to the cloud server for statistical analysis. For example, the pictures collected by the camera are sent to the cloud server for analysis every 10 seconds to analyze whether the user is in a position such as falling to the ground or lying on his side. When the cloud server continuously feeds back information that the user is in a position such as falling to the ground or lying on his side, if the picture collected by the home host from the camera is the same as the above two pictures, the output of the user's physical state meets the preset conditions. At this time, the user's physical condition is determined in combination with the data from the wearable device and / or the audio device, and an alarm is issued when the condition meets the preset conditions.

[0097] When judging that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device, the biometric data of the monitored object collected by other smart home devices are combined to judge whether the state of the monitored object meets the preset conditions. For example, when judging that the state of the detected object meets the preset conditions based on the current body temperature data collected by the wearable device, the current image data collected by the video device are combined to judge whether the state of the monitored object meets the preset conditions.

[0098] When judging whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices, the detection threshold of other smart home devices is lowered. For example, the video device collects images every 10 seconds and then collects images every 5 seconds, and judges whether the previous and next images are the same.

[0099] First, the user's data is saved, and the 24-hour data changes are extracted as the basis for the user's baseline data. For example, if the standard blood pressure value is 110 / 90mmhg and the user's normal blood pressure is 120 / 100mmhg, the blood pressure data will be used as the basis for the overall comparison of subsequent data to determine the surge or drop in the user's blood pressure.

[0100] When acute myocardial infarction occurs and other conditions meet the preset conditions, it can lead to changes in blood pressure, heart rate, and heart rhythm. At the beginning of the disease, symptoms of heart failure such as chest tightness, shortness of breath, difficulty breathing, and coughing will appear, or shock symptoms such as confusion, pale skin, cold limbs, sweating all over the body, and low blood pressure will appear. Therefore, the following data are compared:

[0101] 1. Analyze the user's blood pressure, heart rate, body temperature, sweating or not and other data collected by the wearable device. For example, record the situation where the blood pressure is lower than 90 / 60mmhg; at the same time, if the heart rate increases to more than 100 beats / minute or decreases to less than 40 beats / minute, compare the data with the user's own baseline data. If it is found that the data exceeds or decreases by 30% of the baseline data, report an abnormal reminder to the system service. At this time, the system service needs to compare the data as a whole. At the same time, if the body temperature data is below 35 degrees Celsius or the device detects that the sweat humidity is high, it means that the user has cold arms and sweats a lot. It is also necessary to report the abnormal reminder system service and compare the data as a whole.

[0102] 2. The camera device collects the user's body feature data and uniformly transmits the body feature data to the host video data recognition service. The service collects and recognizes the data. If there is screen data of the user breathing heavily, coughing, covering the chest with hands, rolling eyes, falling to the ground, etc., it will be saved first. If the user is in the same falling or side-lying posture for more than 30 seconds, the system service will be reported to remind the abnormality, and the system service will also compare and judge the data as a whole;

[0103] 3. The audio data collected by the sound receiving end of the camera device is uniformly transmitted to the host audio data recognition service, which collects and recognizes the data. Ordinary coughs or breathing are short-term audio data. For example, ordinary coughs are audio data within 3 seconds. If there is cough audio data of more than 30 seconds or rapid breathing audio data, the system service will report the abnormal reminder, and the system service will also compare and judge the data as a whole;

[0104] In summary, the system service uses the abnormal reminders reported when these three data points occur at the same time to judge that the user's actual state is very unwell (with a high probability of symptoms consistent with acute myocardial infarction), so as to perform corresponding calls for help and alarm functions, rather than frequent false alarms through data obtained from a single wearable device. This includes the user's wearable devices connected in sequence, providing the AP connection point required for networking through WiFi routing, or connecting to the home host terminal application platform through Bluetooth.

[0105] The cloud server includes a data acquisition module, a data processing module, a data transmission module, a security monitoring module and a data feedback module; the data acquisition module, the data processing module, the data transmission module, the security monitoring module and the data feedback module are all connected to the home host through the network, and are used to save a large amount of user data and to take actions such as a help alarm when the home host determines that the user is in a dangerous state; the home host is equipped with a control chip and a device interface, and the control chip includes a timing module, an alarm module, a scene module and a security module; the device interface includes but is not limited to WiFi, Bluetooth, serial port (232 format), serial port (485 format), USB, network interface (RJ45), HDMI and other commonly used device interfaces for existing home appliances; the home appliance layer includes multiple home appliances, and the data acquisition module and the data feedback module are connected to multiple home appliances through the home host.

[0106] The home host terminal application platform is Android system or Apple system. According to actual needs, this terminal application platform can also be a commonly used platform such as WeChat applet, smart home application APP, etc. The home host is a small computing device / computer device that looks like a router and a tablet computer in one. It is the hub of the user's home device network, responsible for communicating with home devices, controlling the operation of home devices, processing data generated in the user's daily life and making corresponding judgments to make the user's life more comfortable. It is also responsible for connecting the user's home device network with the Internet.

[0107] This solution integrates and analyzes the user's previously collected physical condition data and the warning information currently collected in the wearable device or data information that meets the preset conditions (such as a sudden drop in blood pressure data, a sudden drop in heart rate, etc.) and the user's current video data and audio data captured by the surveillance camera to determine whether the user is currently in a normal heart rate abnormality or a sudden dangerous state. It can more accurately call for help and alarm the user, solving the defect of false alarms of abnormalities in the existing single wearable device technology when obtaining a certain health data, and providing a safer, more efficient and convenient health protection for the middle-aged and elderly. The entire system solution is used to better solve the user's emergency calls and alarms, similar to in related scenarios, it can better determine whether an alarm is needed.

[0108] In the embodiments provided by the present invention, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the above-mentioned module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0109] It should be noted that, in the present invention, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element limited by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0110] Although the embodiments disclosed in the present invention are as above, the above contents are only embodiments adopted for facilitating the understanding of the present invention and are not intended to limit the present invention. Any technician in the technical field to which the present invention belongs can make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed in the present invention, but the patent protection scope of the present invention shall still be subject to the scope defined in the attached claims.

Claims

1. A condition monitoring method, characterized in that: The method comprises: Obtain biometric data of the monitored object collected by the smart home device; Determine whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device; When it is determined that the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device, the biometric data of the monitored object collected by other smart home devices are combined to confirm whether the state of the monitored object meets the preset conditions.

2. The condition monitoring method according to claim 1, characterized in that: The smart home devices include: wearable devices, audio and video devices; The biometric data includes: current blood pressure, current heart rate, current body temperature, current breathing rate, current blood oxygen saturation, current sweating level, current audio data and / or current image data.

3. The condition monitoring method according to claim 2, characterized in that: The step of judging whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device comprises: Based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation, current sweating degree, current audio data and / or current image data of the monitored object collected by the wearable device or audio and video equipment, it is judged whether the state of the monitored object meets the preset conditions.

4. The condition monitoring method according to claim 3, characterized in that: The step of determining whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device comprises: In the case where it is determined that the state of the monitored object meets the preset conditions based on the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree of the monitored object collected by the wearable device, confirm whether the state of the monitored object meets the preset conditions in combination with the current audio data and / or current image data collected by the audio and video device; When it is judged that the state of the monitored object meets the preset conditions based on the current audio data and / or current image data collected by the audio and video equipment, the current blood pressure, current heart rate, current body temperature, current respiratory rate, current blood oxygen saturation and / or current sweating degree collected by the wearable device are combined to confirm whether the state of the monitored object meets the preset conditions.

5. The condition monitoring method according to claim 4, characterized in that: Based on the current image data collected by the audio and video equipment, it is judged that the state of the monitored object meets the preset conditions, including: Collect current image data at preset time intervals; Sending the current image data to a cloud server for image analysis; In the case of receiving a warning that the state meets the preset condition fed back by the cloud server, if the newly collected current image data is the same as the previous image data, it is determined that the state of the monitored object meets the preset condition.

6. The condition monitoring method according to claim 1, characterized in that: The method further comprises: When it is confirmed that the state of the monitored object meets the preset conditions, an alarm is output.

7. A condition monitoring device, characterized in that: The device comprises: A collection module, used to obtain biometric data of the monitored object collected by the smart home device; A judgment module, used to judge whether the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device; The confirmation module is used to determine whether the state of the monitored object meets the preset conditions in combination with the biometric data of the monitored object collected by other smart home devices when the state of the monitored object meets the preset conditions based on the biometric data of the monitored object collected by any smart home device.

8. A computer device comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the condition monitoring method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the condition monitoring method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the condition monitoring method according to any one of claims 1 to 6 are implemented.

Images