Intelligent household equipment with multi-mode monitoring function and use method thereof

Abstract

The invention relates to the technical field of intelligent medical treatment, and particularly discloses intelligent household equipment with a multi-mode monitoring function and a use method of the intelligent household equipment. An intelligent medicine bin is installed on one side of the bottom box wall of the management box, a replaceable infusion bag and an infusion tube are placed on the side, close to the intelligent medicine bin, of the bottom box wall of the management box, an electrocardiogram detection main control board is installed on the other side of the side box wall of the management box, and an STM32 single-chip microcomputer is installed on the other side of the bottom box wall of the management box. The peristaltic pump is adopted for extrusion infusion, free movement of a patient is facilitated, meanwhile, the liquid level detection sensor is combined to accurately control and stop liquid, the problem of blood suck-back is effectively solved, psychological burdens of the patient and nurses are relieved, in addition, liquid medicine can be heated through the constant-temperature heating rod, and the liquid medicine can be heated through the constant-temperature heating rod. It is ensured that the infusion temperature is kept at a relatively constant level, and therefore the pain feeling brought by low-temperature infusion to a patient is reduced.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent medical treatment, and particularly relates to an intelligent household device with multimodal monitoring functions and a using method thereof. Background Art

[0003] During the traditional infusion process, blood backflow may occur. In addition, the traditional infusion usually fails to control the temperature well, with a large difference from the human body temperature, and there is also a risk of drug sensitivity reaction. Moreover, the traditional "Morphine" infusion method relies on gravity and requires an infusion stand for fixation, which greatly restricts the patient's freedom of movement. Summary of the Invention

[0004] The purpose of the present invention is to provide an intelligent household device with multimodal monitoring functions and a using method thereof to solve the problems raised in the above background art.

[0005] To achieve the above purpose, the present invention provides the following technical solutions:

[0006] An intelligent household device with multimodal monitoring functions, comprising:

[0007] A management box;

[0008] On one side of the bottom box wall of the management box, an intelligent medicine bin is installed. On one side of the bottom box wall of the management box close to the intelligent medicine bin, a replaceable infusion bag and an infusion tube are placed. On the other side of the side box wall of the management box, a main control board for electrocardiogram detection is installed. On the other side of the bottom box wall of the management box, an STM32 single-chip microcomputer is installed. On one side of the bottom box wall of the management box close to the STM32 single-chip microcomputer, a peristaltic pump body is installed, and a liquid level detection sensor is installed on the outer wall of the peristaltic pump body;

[0009] An intelligent medical infusion system, which includes a software system and a hardware system, and the intelligent medical infusion system can realize functions such as constant temperature control, physiological monitoring, and drug sensitivity early warning of the intelligent health management device.

[0010] Preferably, the top of the management box is installed with a box cover through a hinge. On one side of the top of the box cover, an electronic display screen is installed. In the middle of the top of the box cover, a storage groove is opened. Inside the storage groove, a handle is installed. On the other side of the top of the box cover, a temperature display and a power on / off key are installed. On the outer wall of the box cover, two box lock catches are installed.

[0011] Preferably, two mounting brackets are installed on the upper part of the outer wall of the management box, and a constant temperature heating rod is jointly installed between the two mounting brackets.

[0012] Preferably, the mounting bracket is set as a hook-shaped structure, the top surface of the intelligent medicine bin is lower than the top surface of the management box, and the intelligent medicine bin, the electrocardiogram detection main control board, the STM32 single-chip microcomputer, and the liquid level detection sensor are all electrically connected to the electronic display screen.

[0013] Preferably, the software system includes intelligent liquid control and stop technology, non-invasive wearable physiological monitoring technology, non-contact peristaltic pump and liquid level detection technology, and deep learning and recurrent neural network technology.

[0014] Preferably, the intelligent liquid control and stop technology uses an STM32F103C8T6 microcontroller with an ARM Cortex-M3 core, integrating temperature monitoring, flow rate control, physiological parameter monitoring, and wireless communication. The non-invasive wearable physiological monitoring technology is based on the HU0854 sensor and integrates PPG and FMCW technologies to achieve electrocardiogram, blood oxygen, and body temperature measurement functions. The non-contact peristaltic pump and liquid level detection technology controls the flow rate and flow of infusion by adjusting the rotation speed of the peristaltic pump body through motor control. The MCU can receive and process the liquid level information transmitted back by the liquid level detection sensor. The deep learning and recurrent neural network technology combines the deep learning model recurrent neural network RNN and the PID control algorithm to analyze the health status based on the collected data and generate a health report.

[0015] Preferably, the hardware system includes a physiological monitoring module, a constant temperature control module, a liquid control and stop module, a medication management module, and a control algorithm module.

[0016] Preferably, the controller of the physiological monitoring module is based on the HU0854 reflective sensor, and the controller functions are divided into electrocardiogram measurement, blood oxygen measurement, and body temperature measurement. The constant temperature control module uses an STM32 microcontroller to achieve efficient real-time temperature control, and the PTC heating wire is used as a heating element to ensure effective heat transfer. The liquid control and stop module integrates peristaltic pump and liquid level detection technology to achieve precise control of drug delivery. The medication management module is based on a strain gauge pressure sensor of a Wheatstone bridge, and the data is processed and controlled by an STM32 microcontroller through an AD620 differential amplifier. The control algorithm module uses a high-precision STM32 microcontroller to integrate the recurrent neural network (RNN) and the proportional-integral-derivative (PID) control algorithm.

[0017] A usage method of an intelligent household device with multimodal monitoring functions includes the following steps:

[0018] Step 1. Medication management: The STM32 single-chip microcomputer can be used to give a voice reminder to the user to take medicine, clearly express the current medication time and the next medication time, and voice broadcast the medicine box in the opened intelligent medicine bin. When the medication time arrives, the electromagnetic lock of the intelligent medicine bin is automatically controlled to open, and it can also remind the expiration date and remaining amount of the medicine in the intelligent medicine bin, realizing the medication management function;

[0019] Step 2: Physiological monitoring: Use non-invasive wearable physiological monitoring technology for physiological monitoring. Users wear sensors to collect various physiological sign data through EreeRTOS. Photoplethysmography (PPG) is used to monitor heart rate and blood oxygen saturation in real time through transmissive photoelectric sensors. RNN deep learning is used and uploaded to the cloud for comparison to generate health reports and provide guidance on diet and exercise.

[0020] Step 3: Intelligent infusion: Using the peristaltic pump body as the electric power source for infusion, it reduces the restrictions of the infusion stand on the patient and solves the problem of inconvenience in movement. The peristaltic pump body combined with the liquid level detection sensor can accurately control the liquid and stop the liquid, which can solve the psychological burden caused by blood reflux and attention to progress. By using a constant temperature heating rod on the periphery of the infusion tube to heat the liquid at a constant temperature, the local pain caused by low temperature stimulating the blood vessels can be relieved;

[0021] Step 4: Drug sensitivity alarm: The physiological monitoring module is combined with deep learning and recurrent neural network technology to monitor physiological parameters such as heart rate variability, blood pressure and blood oxygen saturation in real time, and the user's real-time data is compared with the set values. If the data is abnormal, an alarm will be automatically issued to detect drug sensitivity reactions in time.

[0022] Compared with the prior art, the present invention has the following beneficial effects:

[0023] (1) The present invention arranges a peristaltic pump body, a liquid level detection sensor and a constant temperature heating rod inside the management box, and adopts a peristaltic pump for extrusion infusion, which facilitates the patient's free movement. At the same time, the liquid level detection sensor is combined to achieve precise liquid control and stoppage, thereby effectively solving the problem of blood back-absorption and reducing the psychological burden of patients and nurses. In addition, the constant temperature heating rod can heat the liquid medicine to ensure that the infusion temperature is maintained at a relatively constant level, thereby reducing the pain caused to the patient by low-temperature infusion.

[0024] (2) The present invention sets up a software system in the intelligent medical infusion system to collect multiple physiological parameters and combine them with a recurrent neural network to realize dynamic monitoring research. After real-time monitoring for 30 seconds, a mathematical model of physiological parameters can be established to generate a health report to predict possible health problems, which is helpful for early detection of disease risks and taking corresponding preventive measures. It also generates personalized treatment plans and health guidance opinions based on the individual characteristics and historical data of patients. By providing scientific medical advice and health management plans, it helps people develop healthy living habits and reduce the occurrence of diseases. This is consistent with the healthy and harmonious lifestyle advocated by ecological civilization.

[0025] (3) The present invention sets up a hardware system in the intelligent medical infusion system, aiming to achieve constant temperature control, physiological monitoring, drug sensitivity warning, etc., to solve many pain points of home care, elderly care needs and traditional infusion. At the same time, the intelligent medical system uses a PTC heating wire in cooperation with an STM32 series microcontroller to achieve high-efficiency temperature control, applies optical knowledge, uses photoplethysmography to monitor heart rate and blood oxygen saturation, and applies electromagnetic knowledge to achieve remote transmission and control, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is a perspective view of the present invention;

[0027] Figure 2 is an open perspective view of the present invention;

[0028] Figure 3 is the present invention Figure 2 an enlarged view of A in;

[0029] Figure 4 is a flow chart of the intelligent medical infusion system of the present invention;

[0030] Figure 5 is a flow chart of the software system of the present invention;

[0031] Figure 6 is a flow chart of the hardware system of the present invention;

[0032] Figure 7 is a flow chart of the intelligent infusion of the present invention;

[0033] Figure 8 is a flow chart of the medication management and health report of the present invention;

[0034] In the figure: 1, management box; 2, box cover; 3, electronic display screen; 4, storage groove; 5, handle; 6, temperature display; 7, power on / off key; 8, box lock; 9, intelligent medicine warehouse; 10, replaceable infusion bag; 11, infusion tube; 12, electrocardiogram detection main control board; 13, STM32 single-chip microcomputer; 14, peristaltic pump body; 15, liquid level detection sensor; 16, mounting rack; 17, constant temperature heating rod; 18, intelligent medical infusion system; 19, software system; 20, hardware system; 21, intelligent liquid control and stop technology; 22, non-invasive wearable physiological monitoring technology; 23, non-contact peristaltic pump and liquid level detection technology; 24, deep learning and recurrent neural network technology; 25, physiological monitoring module; 26, constant temperature control module; 27, liquid control and stop module; 28, medication management module; 29, control algorithm module. DETAILED DESCRIPTION OF THE INVENTION

[0035] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0036] Embodiment 1:

[0037] Please refer to Figures 1 to 8 as shown, an intelligent household device with multimodal monitoring function and its usage method, including:

[0038] Management box 1;

[0039] On one side of the bottom box wall of the management box 1, an intelligent medicine bin 9 is installed. On the side of the bottom box wall of the management box 1 close to the intelligent medicine bin 9, a replaceable infusion bag 10 and an infusion tube 11 are placed. On the other side of the side box wall of the management box 1, an electrocardiogram detection main control board 12 is installed. On the other side of the bottom box wall of the management box 1, an STM32 single-chip microcomputer 13 is installed. On the side of the bottom box wall of the management box 1 close to the STM32 single-chip microcomputer 13, a peristaltic pump body 14 is installed. A liquid level detection sensor 15 is installed on the outer wall of the peristaltic pump body 14;

[0040] An intelligent medical infusion system 18, which includes a software system 19 and a hardware system 20, and the intelligent medical infusion system 18 can realize functions such as constant temperature control, physiological monitoring, and drug sensitivity warning of this intelligent health management device.

[0041] It can be Figures 1 to 3 seen that the top of the management box 1 is installed with a box cover 2 through a hinge. On one side of the top of the box cover 2, an electronic display screen 3 is installed. In the middle of the top of the box cover 2, a storage groove 4 is opened. A handle 5 is installed inside the storage groove 4. On the other side of the top of the box cover 2, a temperature display 6 and a power on / off key 7 are installed. Two box lock catches 8 are installed on the outer wall of the box cover 2;

[0042] On the upper part of the outer wall of the management box 1, two mounting brackets 16 are installed, and a constant temperature heating rod 17 is jointly installed between the two mounting brackets 16.

[0043] As described above, first, open the box lock 8 to cancel the fixation of the box cover 2. Subsequently, the box cover 2 can be opened to expose the equipment inside the management box 1. The nurse puts the replaceable infusion bag 10 containing medicine into the management box 1, then connects the infusion tube 11 to the replaceable infusion bag 10, and successively connects it to the peristaltic pump body 14, the liquid level detection sensor 15, and the constant temperature heating rod 17. Finally, the nurse inserts the needle on the infusion tube 11 into the patient's blood vessel. At this time, the peristaltic pump body 14 is used to squeeze and infuse the patient, replacing the traditional "Morphine" infusion method. The traditional gravity power source is changed to the peristaltic pump electric power source for squeezing and infusion, enabling the patient to be no longer restricted by the infusion stand, realizing a portable and movable design. In addition, this design combines the liquid level detection sensor 15 to accurately control the infusion process, including precise liquid control and timely liquid stop, realizing the function of intelligent liquid control and liquid stop, effectively solving the problem of blood backflow, and reducing the psychological burden on patients and nurses who need to continuously pay attention to the infusion progress, thereby reducing the workload of nurses. At the same time, the constant temperature heating rod 17 heats the liquid medicine flowing in the infusion tube 11 to ensure that the infusion temperature is maintained at a relatively constant level, thus effectively reducing the pain caused to the patient by low-temperature infusion. In addition, the electrocardiogram detection main control board 12 can continuously monitor the patient's physiological signs, collect various physiological data of the user and compare them with the system set values. If the data is abnormal, the system will automatically alarm and call the medical staff in order to timely detect whether the patient has a drug sensitivity reaction. Through the combination of the intelligent medicine warehouse 9 and the STM32 single-chip microcomputer 13, the patient can be reminded to take medicine in time, and the types, quantities, and times of taking medicine are broadcast, thereby realizing the functions of tracking medication management and intelligent access to drugs.

[0044] Specifically, referring to Figures 1 to 3 as shown, the mounting bracket 16 is set as a hook-shaped structure. The top surface of the intelligent medicine warehouse 9 is lower than the top surface of the management box 1, and the intelligent medicine warehouse 9, the electrocardiogram detection main control board 12, the STM32 single-chip microcomputer 13, and the liquid level detection sensor 15 are all electrically connected to the electronic display screen 3.

[0045] As can be seen from the above, the hook-shaped mounting bracket 16 can provide stable support and fixation, ensuring that the constant temperature heating rod 17 can be firmly installed in the specified position, enabling the intelligent medicine warehouse 9 to be better stored in the management box 1 without affecting the closing of the box cover 2. Some information monitored by the management equipment can be displayed through the electronic display screen 3. Through the electrical connection and collaborative work among various components, the entire intelligent medical infusion system 18 can achieve intelligent management and control.

[0046] Embodiment 2:

[0047] Referring to Figure 4 and Figure 5As shown, the software system 19 includes intelligent liquid control and stop technology 21, non-invasive wearable physiological monitoring technology 22, non-contact peristaltic pump and liquid level detection technology 23, and deep learning and recurrent neural network technology 24;

[0048] The intelligent liquid control and stop technology 21 uses the STM32F103C8T6 microcontroller with an ARM Cortex-M3 core, integrating temperature monitoring, flow rate control, physiological parameter monitoring, and wireless communication. The non-invasive wearable physiological monitoring technology 22 is based on the HU0854 sensor, integrating PPG and FMCW technologies to achieve functions of electrocardiogram, blood oxygen, and body temperature measurement. The non-contact peristaltic pump and liquid level detection technology 23 controls the flow rate and volume of infusion by adjusting the rotation speed of the peristaltic pump body 14 through motor control. The MCU can receive and process the liquid level information transmitted back by the liquid level detection sensor 15. The deep learning and recurrent neural network technology 24 combines the deep learning model recurrent neural network RNN and the PID control algorithm, analyzes the health status based on the collected data, and generates a health report.

[0049] As can be seen from the above, the core of the entire intelligent medical infusion system 18 is the STM32F103C8T6 microcontroller based on the ARM Cortex-M3 kernel. The system adopts the advanced intelligent liquid control and stopping technology 21. Through the collaborative work of the PT100 temperature sensor and the MCP6004 amplifier, this technology can adjust the infusion temperature in real time to ensure the stability and efficacy of the drug. At the same time, the combination of the infrared photoelectric sensor and the peristaltic pump realizes the intelligent liquid control and stopping function, which can accurately adjust the infusion speed. In addition, with the support of the ZigBee wireless communication technology, data can be transmitted remotely to achieve real-time monitoring. In terms of physiological monitoring, the system adopts the non-invasive wearable physiological monitoring technology 22. Based on the HU0854 sensor, this technology can convert the electrocardiogram signal converted by the electrode into a voltage signal. After being amplified by the MCP6004 amplifier, these signals are captured, recorded and filtered by the STM32 single-chip microcomputer 13, so as to extract the characteristic waveform of the heart. At the same time, the system also adopts the Van Slyke manometry method and the photoplethysmography method for blood oxygen detection to ensure that the patient's vital signs are comprehensively monitored. In order to control the infusion flow rate and volume, the system integrates the non-contact peristaltic pump and liquid level detection technology 23. This technology combines the peristaltic pump body 14 and the liquid level detection sensor 15, which can monitor the liquid level change in the infusion bag in real time, so as to judge whether the infusion is completed or abnormal. In terms of data processing and health management, the system introduces the deep learning and recurrent neural network technology 24. This technology combines the deep learning model recurrent neural network (RNN) and the PID control algorithm to analyze the collected physiological data to evaluate the patient's health status. Through closed-loop control, the system can return the output value to the control algorithm, and then adjust the system input to improve the stability and robustness of the system. RNN is mainly responsible for processing time series physiological data, performing pattern recognition and early health risk warning. By dynamically adjusting the physiological monitoring and drug management strategies, the system can achieve precise health management. The closed-loop design not only strengthens the stability and robustness of the system, but also can adapt to the user's physiological changes. The output of the PID controller is a linear combination of the three parameters of proportional, integral and differential, ensuring the accuracy and response speed of the system control.

[0050] Embodiment 3:

[0051] Reference Figure 4 and Figure 6 As shown, the hardware system 20 includes a physiological monitoring module 25, a constant temperature control module 26, a liquid control and stopping module 27, a medication management module 28 and a control algorithm module 29;

[0052] The controller of the physiological monitoring module 25 is based on the HU0854 reflective sensor, and the controller functions are divided into electrocardiogram measurement, blood oxygen measurement and body temperature measurement. The constant temperature control module 26 adopts the STM32 microcontroller to achieve efficient real-time temperature control. The PTC heating wire is the heating element to ensure the effective transfer of heat energy. The liquid control and stop module 27 integrates the peristaltic pump and liquid level detection technology to achieve precise control of drug delivery. The medication management module 28 is based on the strain gauge pressure sensor of the Wheatstone bridge, and the STM32 microcontroller performs data processing and control through the AD620 differential amplifier. The control algorithm module 29 adopts a high-precision STM32 microcontroller to integrate the recurrent neural network (RNN) and proportional-integral-differential (PID) control algorithm.

[0053] As can be seen from the above, the physiological monitoring module 25 relies on the HU0854 reflective sensor. During ECG detection, the electrode is responsible for converting the ECG signal into a voltage signal, while the pulse sensor collects the heart rate signal and transmits it to the STM32 microcontroller 13 after amplification. The microcontroller can capture each high and low level, record and filter it, so as to extract the characteristic waveform of the human heart. At the same time, the module also uses Van S l yke pressure detection method, oxygen electrode polarization technology and photoelectric volumetric pulse wave recording method are used to accurately detect blood oxygen levels; the constant temperature control module 26 adopts STM32 microcontroller to achieve efficient and real-time temperature control. It has a built-in high-precision MF58 thermistor probe, which is pre-buried in the heating tube. It can monitor and feedback temperature data in real time, and then adjust the power output of the PTC heating wire to ensure constant temperature; the liquid control and liquid stop module 27 integrates a non-contact peristaltic pump and liquid level detection technology 23. The peristaltic pump body 14 is closely matched with the roller screw transmission mechanism to ensure the fine-tuning accuracy of the flow rate, and the liquid level detection sensor 15 can accurately capture the liquid level changes and pass the data to the STM32 microcontroller for processing and decision-making; the medication management module 28 is based on the barrier-free ARM7 system LPC21 microcontroller, and is equipped with an STM32F1 main control chip and an ATK-ESP8266 module. The module converts the serial port to WIFI The STA mode connects to the network to achieve remote monitoring. The combination of intelligent voice and magnetic lock technology makes the opening and closing of the smart medicine warehouse 9 more convenient. At the same time, the gravity sensor can analyze the slight changes in the pressure of the medicine in the warehouse, and transmit the electrical signal output by the weight sensor to the MCU microcontroller for digital information processing and analysis. When the weight of the medicine is lower than the set value, the system will automatically send a reminder message to the family’s mobile phone App to prompt them to add medicine. In addition, the module also integrates the RTC real-time clock module, intelligent voice and buzzer, which can accurately set and remind users of medication time; the control algorithm module 29 adopts the PID algorithm to ensure that the deviation between the system output and user needs is minimized to achieve accurate health management. The closed-loop design further enhances the stability and robustness of the system, enabling it to better adapt to the user's physiological changes.

[0054] Example 4:

[0055] Refer to Figures 1 to 8 As shown, a method for using an intelligent household device with multimodal monitoring functions includes the following steps:

[0056] Step 1, Medication management: The STM32 single-chip microcomputer 13 can be used to remind the user to take medicine by voice, clearly express the current medication time and the next medication time, and voice broadcast the medicine box in the opened intelligent medicine bin 9. When the medication time arrives, the electromagnetic lock of the intelligent medicine bin 9 is automatically controlled to open, and it can also remind the expiration date and remaining amount of the medicine in the intelligent medicine bin 9, realizing the medication management function;

[0057] Step 2, Physiological monitoring: Non-invasive wearable physiological monitoring technology 22 is used for physiological monitoring. The user wears a sensor to collect various physiological sign data through EreeRTOS. The photoplethysmography (PPG) method is adopted to continuously monitor the heart rate and blood oxygen saturation in real time through a transmissive optoelectronic sensor. The RNN deep learning is used to upload and compare with the cloud to generate a health report and give guidance on diet and exercise, etc.;

[0058] Step 3, Intelligent infusion: The peristaltic pump body 14 is used to squeeze the infusion as an electric power source, reducing the limitation of the infusion stand on the patient and solving the problem of inconvenient movement. The peristaltic pump body 14 combined with the liquid level detection sensor 15 can achieve accurate liquid control and stop, which can solve the psychological burden caused by blood reflux and the progress of infusion. By using a constant temperature heating rod 17 to heat the infusion liquid constantly around the infusion tube 11, it can relieve the local pain caused by the low temperature stimulating the blood vessels;

[0059] Step 4, Drug sensitivity alarm: The physiological monitoring module 25 is used in combination with deep learning and recurrent neural network technology 24 to continuously monitor physiological parameters such as heart rate variability, blood pressure, and blood oxygen saturation, compare the real-time data of the user with the set value, and if the data is abnormal, it will automatically alarm to detect the drug sensitivity reaction in time.

[0060] Application example:

[0061] This design is applied in multiple environments such as medical institutions, community health service centers, and home health management. In places such as the outpatient department, inpatient department, and emergency room of a hospital, this device can perform intelligent infusion for patients and provide comprehensive physiological parameter monitoring, such as blood pressure, heart rate, body temperature, blood oxygen saturation, etc. By integrating a variety of sensors and detection devices, this intelligent health management device can continuously monitor the user's vital signs and health indicators. At the same time, the device combines a non-contact peristaltic pump and liquid level detection technology 23 with intelligent liquid control and stop technology 21 to achieve precise liquid control and stop, avoiding problems such as blood backflow, thereby ensuring the comfort and safety of the infusion process and reducing the patient's pain. In addition, through non-invasive wearable physiological monitoring technology 22 combined with deep learning and recurrent neural network technology 24, multi-physiological parameters are collected and combined with recurrent neural networks to achieve dynamic monitoring research. A physiological parameter mathematical model can be established within 30 seconds of real-time monitoring to generate a health report and predict possible health problems, so as to provide accurate health assessment results. Furthermore, it can quickly complete the measurement of multiple health indicators, reduce the patient's waiting time in the hospital, and assist doctors in making rapid diagnoses, improving the overall medical service efficiency. NLP natural language processing technology is used to achieve human-computer interaction. Based on the constructed natural language dialogue system, relevant responses regarding medicine storage, medicine retrieval, remaining expiration date of medicine, and medicine quantity are made, enabling users to easily understand the usage method of the device and health suggestions.

[0062] Although the embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A smart home device with multimodal monitoring function, characterized in that: include: Management box (1); A smart medicine bin (9) is installed on one side of the bottom wall of the management box (1); a replaceable infusion bag (10) and an infusion tube (11) are placed on the side of the bottom wall of the management box (1) close to the smart medicine bin (9); an electrocardiogram detection main control board (12) is installed on the other side of the side wall of the management box (1); an STM32 single-chip computer (13) is installed on the other side of the bottom wall of the management box (1); a peristaltic pump body (14) is installed on the side of the bottom wall of the management box (1) close to the STM32 single-chip computer (13); and a liquid level detection sensor (15) is installed on the outer wall of the peristaltic pump body (14); An intelligent medical infusion system (18), the intelligent medical infusion system (18) comprising a software system (19) and a hardware system (20), and the intelligent medical infusion system (18) can realize the functions of the intelligent health management device such as constant temperature control, physiological monitoring, and drug sensitivity warning.

2. The smart home device with multimodal monitoring function according to claim 1, characterized in that: The top of the management box (1) is equipped with a box cover (2) via a hinge, an electronic display screen (3) is installed on one side of the top of the box cover (2), a storage slot (4) is opened in the middle of the top of the box cover (2), a handle (5) is installed inside the storage slot (4), a temperature display (6) and a power button (7) are installed on the other side of the top of the box cover (2), and two box locks (8) are installed on the outer wall of the box cover (2).

3. The smart home device with multi-modal monitoring function according to claim 2, characterized in that: Two mounting frames (16) are installed on the upper part of the outer wall of the management box (1), and a constant temperature heating rod (17) is installed between the two mounting frames (16).

4. The smart home device with multi-modal monitoring function according to claim 3, characterized in that: The mounting frame (16) is configured as a hook-shaped structure, the top surface of the intelligent medicine bin (9) is lower than the top surface of the management box (1), and the intelligent medicine bin (9), the electrocardiogram detection main control board (12), the STM32 single-chip computer (13) and the liquid level detection sensor (15) are all electrically connected to the electronic display screen (3).

5. The smart home device with multi-modal monitoring function according to claim 1, characterized in that: The software system (19) includes intelligent liquid control and liquid stopping technology (21), non-invasive wearable physiological monitoring technology (22), non-contact peristaltic pump and liquid level detection technology (23) and deep learning and recurrent neural network technology (24).

6. The smart home device with multi-modal monitoring function according to claim 5, characterized in that: The intelligent liquid control and stopping technology (21) adopts the STM32F103C8T6 microcontroller with ARM Cortex-M3 core, integrating temperature monitoring, flow rate control, physiological parameter monitoring and wireless communication. The non-invasive wearable physiological monitoring technology (22) is based on the HU0854 sensor, integrating PPG and FMCW technology to realize electrocardiogram, blood oxygen and body temperature measurement functions. The non-contact peristaltic pump and liquid level detection technology (23) controls the flow rate and flow of the infusion by adjusting the rotation speed of the peristaltic pump body (14) through motor control. The MCU can receive and process the liquid level information sent back by the liquid level detection sensor (15). The deep learning and recurrent neural network technology (24) combines the deep learning model recurrent neural network RNN ​​and PID control algorithm, combines the collected data to analyze the health status and generate a health report.

7. The smart home device with multi-modal monitoring function according to claim 1, characterized in that: The hardware system (20) comprises a physiological monitoring module (25), a constant temperature control module (26), a liquid control and liquid stopping module (27), a medication management module (28) and a control algorithm module (29).

8. The smart home device with multi-modal monitoring function according to claim 7, characterized in that: The controller of the physiological monitoring module (25) is based on a HU0854 reflective sensor, and the controller functions are divided into electrocardiogram measurement, blood oxygen measurement and body temperature measurement. The constant temperature control module (26) adopts an STM32 microcontroller to achieve efficient real-time temperature control. The PTC heating wire is a heating element to ensure effective heat transfer. The liquid control and liquid stop module (27) integrates a peristaltic pump and liquid level detection technology to achieve precise control of drug delivery. The medication management module (28) is based on a strain gauge pressure sensor of a Wheatstone bridge, and is processed and controlled by an STM32 microcontroller through an AD620 differential amplifier. The control algorithm module (29) adopts a high-precision STM32 microcontroller to integrate a recurrent neural network (RNN) and a proportional-integral-differential (PID) control algorithm.

9. A method for using a smart home device with a multimodal monitoring function, applicable to the smart home device with a multimodal monitoring function as claimed in claims 1 to 8, characterized in that: The following steps are involved: Step 1, medication management: The STM32 single chip microcomputer (13) can be used to remind the user to take medicine by voice, and clearly express the time of taking medicine this time and the time of taking medicine next time, and voice broadcast the medicine box in the opened smart medicine warehouse (9). When the medication time is up, the electromagnetic lock of the smart medicine warehouse (9) is automatically controlled to open, and the use period and remaining amount of the medicine in the smart medicine warehouse (9) can be reminded, so as to realize the medication management function; Step 2: Physiological monitoring: Use non-invasive wearable physiological monitoring technology (22) for physiological monitoring. Users wear sensors to collect various physiological sign data through EreeRTOS. Photoplethysmography (PPG) is used to monitor heart rate and blood oxygen saturation in real time through transmissive photoelectric sensors. RNN deep learning is used and uploaded to the cloud for comparison to generate health reports and provide guidance on diet and exercise. Step 3, intelligent infusion: using the peristaltic pump body (14) to squeeze as the electric power source for infusion, reducing the restrictions on the patient by the infusion stand and solving the problem of inconvenience in movement, and the peristaltic pump body (14) combined with the liquid level detection sensor (15) can achieve accurate liquid control and stop, can solve the blood reflux and the psychological burden caused by paying attention to the progress, and by using a constant temperature heating rod (17) on the periphery of the infusion tube (11) to heat the liquid medicine at a constant temperature, local pain caused by low temperature stimulating blood vessels can be relieved; Step 4: Drug sensitivity alarm: A physiological monitoring module (25) is used in combination with deep learning and recurrent neural network technology (24) to monitor physiological parameters such as heart rate variability, blood pressure and blood oxygen saturation in real time, and the user's real-time data is compared with the set value. If the data is abnormal, an alarm is automatically issued to detect drug sensitivity reactions in a timely manner.

Images