Medicine taking behavior supervision method and system based on intelligent medicine cabinet and intelligent medicine cabinet

Abstract

The invention discloses a medicine taking behavior supervision method and system based on an intelligent medicine cabinet and the intelligent medicine cabinet, and the method comprises the steps: obtaining the information of a self-contained medicine and the information of a hospital distributed medicine when the self-contained medicine and the hospital distributed medicine are put into the intelligent medicine cabinet; image information and sensing information of the user before and after medicine taking are obtained according to the medicine information, behavior modes of the user are recognized according to the image information and the sensing information, and the behavior modes comprise true medicine taking behaviors and non-medicine taking behaviors; if the current time exceeds the set time after medicine taking or the behavior mode is a non-medicine-taking behavior, warning information of overtime non-medicine-taking is sent to a nurse station until the behavior mode is a true medicine taking behavior, and supervision of the medicine taking behavior is completed. The double-medicine missing rate can be reduced, the manual checking time of nurses is shortened, and therefore the situation that the treatment effect is delayed due to the fact that medicine is not taken is prevented.

Description

Technical Field

[0001] The present application relates to the technical field of medical intelligent devices, and in particular to a method and system for monitoring medication behavior based on a smart medicine cabinet, a smart medicine cabinet, and a computer-readable storage medium. Background Art

[0002] In hospitals, many patients with chronic diseases have their own oral medications, such as long-term medications for hypertension, diabetes, etc. At the same time, during hospitalization, nurses will distribute oral medications prescribed by hospital doctors. Generally, the distribution time is earlier than the medication time. Nurses often do not know whether patients have taken oral medications on time. During hospitalization, patients are required to take both their own oral medications and oral medications distributed by the hospital. Patients are prone to confusion or missed medications, and rely on nurses to manually check the medication status. The workload is heavy and real-time monitoring is impossible. There is no active warning mechanism after patients miss medications, and it can only be discovered through ward rounds, resulting in delayed treatment.

[0003] Therefore, the existing technology still needs to be improved and developed. Summary of the Invention

[0004] The main purpose of this application is to provide a medication behavior supervision method, system and smart medicine cabinet based on a smart medicine cabinet, aiming to solve the problem in the existing technology that when patients take their own medicines and oral medicines issued by the hospital during hospitalization, they rely on manual verification of medication status, and patients are prone to missing medications.

[0005] A first aspect of an embodiment of the present application provides a method for supervising medication behavior based on a smart medicine cabinet, and the method for supervising medication behavior based on a smart medicine cabinet includes the following steps: when it is detected that self-prepared medicines and hospital-dispensed medicines are placed in the smart medicine cabinet, obtaining drug information of the self-prepared medicines and the hospital-dispensed medicines; obtaining image information and sensor information of the user before and after taking the medicine based on the drug information, and identifying the user's behavior pattern based on the image information and the sensor information, wherein the behavior pattern includes true medication behavior and non-medication behavior; if the current time exceeds the set medication post-time or the behavior pattern is non-medication behavior, sending a warning message of timeout for not taking the medicine to the nurse station until the behavior pattern is true medication behavior, so as to complete the supervision of medication behavior.

[0006] Optionally, in one embodiment of the present application, the drug information includes the first drug name, first drug dosage, first medication time of the self-prepared medicine and the second drug name, second drug dosage, and second medication time of the hospital-distributed medicine; when it is detected that the self-prepared medicine and the hospital-distributed medicine are placed in the smart medicine cabinet, the drug information of the self-prepared medicine and the hospital-distributed medicine is obtained, specifically including: the smart medicine cabinet receives drug information, and the drug information is obtained after a scanner scans the self-prepared medicine and the hospital-distributed medicine respectively, the self-prepared medicine is stored in a storage bin of the smart medicine cabinet, and the hospital-distributed medicine is stored in another storage bin of the smart medicine cabinet; after the drug information is compared with the medicines in the corresponding storage bin, the first drug name, first drug dosage, first medication time of the self-prepared medicine and the second drug name, second drug dosage, and second medication time of the hospital-distributed medicine are obtained.

[0007] Optionally, in one embodiment of the present application, the obtaining of drug information of the self-prepared medicine and the hospital-dispensed medicine also includes: if the current time is within the threshold range of the first medication time, a self-prepared medicine taking reminder is issued to the user; if the current time is within the threshold range of the second medication time, a hospital-dispensed medicine taking reminder is issued to the user.

[0008] Optionally, in one embodiment of the present application, the image information includes action images and drug images, and the sensor information includes the change in drug weight; the image information and sensor information before and after the user takes the medicine is obtained based on the drug information, specifically: based on the first drug name, the first drug dosage, the second drug name and the second drug dosage, the action image of the user taking the self-prepared medicine or the hospital-dispensed medicine and the drug image containing the medicine in the user's medicine taking action are obtained, as well as the change in drug weight before and after the user takes the medicine from the storage bin of the smart medicine cabinet.

[0009] Optionally, in one embodiment of the present application, the identifying of the user's behavior based on the image information and the sensor information specifically includes: when it is determined based on the action image and the medicine image that the amount of medicine has decreased, and the changed weight of the medicine matches the single dose of the corresponding medicine in the storage bin, it is determined that the user has taken out the medicine to be taken; after the user takes out the medicine to be taken, and no user behavior operation is received within a preset time, it is determined that the user's behavior is a non-medication behavior of having taken the medicine; when responding to the user's medicine confirmation operation for the smart medicine cabinet, it is identified that the behavior corresponding to the medicine confirmation operation is a true medicine taking behavior.

[0010] Optionally, in one embodiment of the present application, when no user action operation is received within a preset time, the user's behavior is determined to be a non-medication behavior of having taken medicine, specifically including: obtaining a video image of the user before the medication confirmation operation; if it is identified from the video image that the user has not taken medicine, and no response action from the user to the smart medicine cabinet is received within a preset time, the user's behavior is determined to be a non-medication behavior of having taken medicine.

[0011] Optionally, in one embodiment of the present application, the warning information includes a first warning for not taking self-prepared medicine and a second warning for not taking hospital-dispensed medicine; if the current time exceeds the set time after taking medicine or the behavior is non-medication behavior, a warning message of timeout for not taking medicine is sent to the nurse station, specifically including: if the current time exceeds the preset value after the first medication time, and the user's behavior is non-medication behavior of not taking medicine without opening the counter or non-medication behavior of not taking medicine without taking medicine or non-medication behavior of having taken medicine, a first warning of timeout for not taking the self-prepared medicine is sent to the nurse station; if the current time exceeds the preset value after the second medication time, and the user's behavior is non-medication behavior of not taking medicine without opening the counter or non-medication behavior of not taking medicine without taking medicine or non-medication behavior of having taken medicine, a second warning of timeout for not taking the hospital-dispensed medicine is sent to the nurse station.

[0012] A second aspect of the present application further provides a medication behavior monitoring system based on a smart medicine cabinet, wherein the medication behavior monitoring system based on the smart medicine cabinet includes:

[0013] A dual drug recognition module is used to obtain drug information of the self-prepared drugs and the hospital-dispensed drugs when detecting that the self-prepared drugs and the hospital-dispensed drugs are placed in the smart medicine cabinet;

[0014] A behavior determination module is used to obtain image information and sensor information of the user before and after taking medicine, and identify the user's behavior based on the image information and the sensor information, wherein the behavior includes actual medication taking behavior and non-medication taking behavior;

[0015] The missed medication monitoring module is used to send a warning message of missed medication to the nurse station if the current time exceeds the set medication time or the behavior is not medication behavior, until the behavior is true medication behavior, so as to complete the supervision of medication behavior.

[0016] The third aspect of the embodiment of the present application also provides a smart medicine cabinet, wherein the smart medicine cabinet includes: a memory, a processor, and a medication behavior monitoring program based on the smart medicine cabinet stored on the memory and runnable on the processor, and when the medication behavior monitoring program based on the smart medicine cabinet is executed by the processor, the steps of the medication behavior monitoring method based on the smart medicine cabinet as described above are implemented.

[0017] The fourth aspect of the embodiment of the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a medication behavior monitoring program based on a smart medicine cabinet, and when the medication behavior monitoring program based on a smart medicine cabinet is executed by a processor, the steps of the medication behavior monitoring method based on a smart medicine cabinet are implemented as described above.

[0018] Beneficial effects: The present application provides a medication behavior supervision method, system and smart medicine cabinet based on a smart medicine cabinet. The present application places self-prepared medicines and hospital-dispensed medicines in different storage bins of the smart medicine cabinet, performs image recognition and sensor detection on both self-prepared medicines and hospital-dispensed medicines to verify medication behavior to determine whether the user has taken the medicine, and issues an alert to the nurse after confirming that the user has not taken the medicine, thereby reducing the missed dose rate of both drugs and reducing the manual checking time of nurses, thereby preventing delays in treatment effects due to non-dosing of medicines. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 This is a schematic diagram of the structure of the smart medicine cabinet in the medication behavior supervision method based on the smart medicine cabinet of the present application;

[0021] Figure 2 This is a flow chart of a preferred embodiment of the present invention's method for monitoring medication behavior based on a smart medicine cabinet;

[0022] Figure 3 This is a structural diagram of a preferred embodiment of the medication behavior monitoring system based on the smart medicine cabinet of the present application;

[0023] Figure 4 This is a structural diagram of a preferred embodiment of the smart medicine cabinet of this application.

[0024] Description of reference numerals:

[0025] 100. Dual drug identification module; 200. Behavior determination module; 300. Missed dose monitoring module. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solutions and effects of this application clearer and more specific, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. The described embodiments are only possible technical implementations of this application and are not all possible implementations. Based on the embodiments in this application, those skilled in the art can fully combine the embodiments of this application to obtain other embodiments without creative work, and these embodiments are also within the scope of protection of this application.

[0027] In related technologies, medicine boxes only support simple packaging and alarm reminders, have not established a closed-loop supervision system for medication behavior, have not integrated a multi-role collaborative notification module (medical staff / family members / guardians), and have no graded warning mechanism (such as a delay of 15 minutes without taking the medicine will automatically trigger a second-level reminder).

[0028] This application addresses the technical issue of patients taking both self-prepared and hospital-issued oral medications during hospitalization, which often leads to missed medications due to reliance on manual verification. This application places self-prepared and hospital-issued medications in different storage compartments of a smart medicine cabinet, performs image recognition and sensor detection on both types of medication to verify medication behavior and determine whether the user has taken the medication. After confirming that the user has not taken the medication, an alert is sent to the nurse, thereby reducing the missed medication rate and the time nurses spend manually verifying medications, thereby preventing delays in treatment due to missed medications.

[0029] The following specific embodiments are used to describe the technical solution of the present application in detail. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0030] First, the hardware components of the smart medicine cabinet in this application are described. The smart medicine cabinet includes: a sealed medicine cabinet with an electronic lock (moisture-proof and child-proof), a compartmentalized storage compartment (divided by medication time, with built-in weight / photoelectric sensor detection for medication removal), a touch screen (displaying medication information: such as fasting, morning, noon, evening, and bedtime medication), an audio and visual reminder module (LED flashing + voice broadcast), and a communication module (WiFi / Bluetooth, connected to the nurse station terminal).

[0031] It should be noted that Figure 1 The drawers in the drawer store self-prepared medicines and hospital-issued medicines according to the time of taking the medicines, and the self-prepared medicines and hospital-issued medicines that need to be taken at the corresponding time are placed in different storage compartments after being partitioned in the drawer, and warnings are issued separately for the taking status of self-prepared medicines and hospital-issued medicines in the future.

[0032] Figure 1There are five drawers in the cabinet, corresponding to medication for fasting, morning medication, noon medication, evening medication and bedtime medication. The difference between medication for fasting and medication in the morning is whether there is eating behavior after getting up. It is understandable that, if the medicine for high blood pressure needs to be taken three times a day, then the patient needs a whole box, which should be taken in the morning, at noon, and at night. After admission, a whole box of medicine (self-prepared medicine) is distributed before being put into the cabinet, and then placed in the corresponding drawer. The medicines issued by the hospital are already packaged in a small bag, but the self-prepared medicine is a whole bottle or box. To distribute the self-prepared medicine first, the tablets are placed directly in the cup of the drawer. The drawer of the smart medicine cabinet of this application is provided with a container (such as a cup) for holding the packaged tablets.

[0033] The bedside smart medicine cabinet of this application integrates drug storage, timed reminders, missed medication warnings, and remote monitoring functions. It stores the patient's own medications (such as self-prepared oral medications) and hospital-issued medications (medications issued by the hospital) in the smart medicine cabinet and sets a timed reminder function. If the patient has not opened the medicine cabinet for more than one hour after the required medication time (a reminder has been sent to the patient half an hour after the medication time), it will be reflected that the patient has not taken the medication on time. At the same time, the nurse can receive a prompt warning and remind the patient to take the medication in time. Therefore, the smart medicine cabinet can prevent patients from missing medication, ensure the effectiveness of treatment, reduce the burden on nurses, unify drug management, facilitate patients, and improve patient satisfaction.

[0034] Smart medicine cabinets employ dual medication management, supporting the unified placement of both patient-provided and hospital-issued medications. Both self-provided and hospital-issued medications are subject to the doctor's prescription. Self-provided medications may remain in their original packaging, while hospital-issued medications are packaged in separate bags, grouped by dosing schedule (e.g., for morning medications, three medications are packaged in one bag). Smart medicine cabinets can reduce missed doses and reduce nurses' manual verification time. Centralized management reduces the risk of missed and incorrect medications, improving the patient experience and both patient and nurse satisfaction.

[0035] The preferred embodiment of this application describes a method for monitoring medication behavior based on a smart medicine cabinet, such as Figure 2 As shown, the medication behavior supervision method based on the smart medicine cabinet includes the following steps:

[0036] In step S101, when it is detected that self-prepared medicines and hospital-dispensed medicines are placed in the smart medicine cabinet, drug information of the self-prepared medicines and the hospital-dispensed medicines is obtained.

[0037] In one possible implementation, the drug information includes a first drug name, a first drug dosage, and a first medication time for the self-provided drug, and a second drug name, a second drug dosage, and a second medication time for the hospital-dispensed drug. The smart medicine cabinet receives the drug information, which is obtained by scanning the self-provided drug and the hospital-dispensed drug respectively with a scanner, stores the self-provided drug in one storage bin of the smart medicine cabinet, and stores the hospital-dispensed drug in another storage bin of the smart medicine cabinet; and after comparing the drug information with the drugs in the corresponding storage bins, obtains the first drug name, first drug dosage, and first medication time for the self-provided drug and the second drug name, second drug dosage, and second medication time for the hospital-dispensed drug.

[0038] Specifically, after a patient (i.e., user) is admitted to the hospital, a nurse enters information about the patient's self-prepared oral medications and hospital-issued medications into the smart medicine cabinet system by scanning a code, including key information such as the drug name, dosage, time of administration, and frequency of administration. However, this is not limited to the above. Alternatively, a scanner can be installed in the smart medicine cabinet to accurately input medication information, or a nurse can directly input information about self-prepared medications based on the medication situation, so that subsequent functions such as timed reminders and medication behavior monitoring can be implemented normally.

[0039] Furthermore, during the scheduled reminder phase, according to the doctor's instructions, patients are given medication reminders at different times (fasting, morning, noon, evening, and before bed). For example, for patients with hypertension, medication times can be set at 8 a.m., 12 p.m., 6 p.m., and 10 p.m. before bed. 15 minutes before the medication is taken, the audio-visual reminder module (LED flashing + voice broadcast) displays the medication information on the touch screen of the smart medicine cabinet and issues a voice reminder, such as "It is 7:45 a.m. now, please prepare to take your morning medication."

[0040] In one possible implementation, if the current time is within the threshold range of the first medication time, a reminder to take self-prepared medicine is issued to the user; if the current time is within the threshold range of the second medication time, a reminder to take hospital-distributed medicine is issued to the user.

[0041] Specifically, the smart medicine cabinet automatically triggers a reminder 15 minutes before the scheduled medication (both self-provided and hospital-issued) based on the recorded medication intake time. This reminder is triggered by a flashing LED and voice notification on the cabinet's display, as well as a touchscreen prompt. Activating the reminder at the set time, guiding patients to take their medication on time, is the first line of defense against missed doses.

[0042] This application ensures that patients receive medication reminders at the correct time, raising their awareness of taking medication on time. Reminding patients 15 minutes in advance gives them time to prepare and avoid forgetting to take their medication due to time constraints.

[0043] In step S102, image information and sensor information of the user before and after taking the medicine are obtained based on the medicine information, and the user's behavior is identified based on the image information and the sensor information, wherein the behavior includes real medicine taking behavior and non-medication taking behavior.

[0044] It is understood that this application uses a dual verification mechanism of "cabinet opening action + image and sensor detection" to verify medication intake. During the cabinet opening detection, when the patient presses the medicine drawer button on the touchscreen (selecting the corresponding time period), the electronic lock opens, allowing the patient to open the corresponding drawer to access medication. At this point, the medicine cabinet's communication module records the cabinet opening action. Weight sensor detection and a visual recognition system verify medication intake to distinguish whether the patient has actually taken the medication or simply removed and put it back, achieving the goal of intelligent medication leakage prevention. Specifically, real-time monitoring of the weight changes in the medicine box can detect the removal of a single pill and perform high-precision weighing. The weight difference between removal and return is recorded to confirm that the medication has been removed and not returned, achieving dual verification. A micro camera is used to capture the user's medication removal action, and the number of pills before and after removal is compared through a pill count. The smart medicine cabinet then issues a voice prompt: "You have removed (can be one pill, or multiple pills, such as two or three) your midday medication. Please confirm whether you have taken it?" After the operation, the patient is required to manually confirm the medication intake on the touchscreen to complete the interactive confirmation mechanism.

[0045] In one possible implementation, the image information includes an action image and a medication image, and the sensor information includes a change in medication weight. Based on the first medication name, the first medication dosage, the second medication name, and the second medication dosage, an action image of a user taking medication from a self-provided medication or a hospital-dispensed medication, an image of the medication contained in the user's medication taking action, and the change in medication weight (i.e., the weight difference) before and after the user takes the medication from the storage compartment of the smart medicine cabinet are obtained.

[0046] In one possible implementation, when it is determined based on the action image and the medicine image that the amount of medicine has decreased, and the changed weight of the medicine matches the single dose of the corresponding medicine in the storage bin, it is determined that the user has taken out the medicine to be taken; after the user takes out the medicine to be taken, and no user behavior operation is received within a preset time, it is determined that the user's behavior is a non-medication behavior of having taken the medicine; when responding to the user's medicine confirmation operation for the smart medicine cabinet, the behavior corresponding to the medicine confirmation operation is identified as a true medicine taking behavior.

[0047] Specifically, for self-prepared medications with a first drug name and a first dosage, and hospital-dispensed medications with a second drug name and a second dosage, a miniature camera captures the user's movements when removing self-prepared or hospital-dispensed medications. Image recognition is used to compare the number of pills before and after removal. If the number of pills decreases, this helps determine whether the patient has removed the medication. High-precision weight sensors are installed in each compartment of the smart medicine cabinet to monitor changes in the weight of the medicine box in real time. When a patient removes medication, the sensor records the weight before and after removal, calculates the difference, and preliminarily determines that the patient has removed the medication if the difference matches the weight of a single pill. Interactive confirmation is then provided. After the patient removes the medication, the medicine cabinet prompts with a voice message, "You have removed your midday medication. Please confirm whether you want to take it?" A confirmation button pops up on the touchscreen, prompting the patient to manually confirm the medication. After the patient clicks the confirmation button, the medicine cabinet records the confirmation.

[0048] In one possible implementation, a video image of the user before confirming the medication is taken is obtained; if it is identified from the video image that the user has not taken the medication, and no response action from the user to the smart medicine cabinet is received within a preset time, it is determined that the user's behavior is a non-medication behavior of having taken the medication.

[0049] In one possible implementation, if it is recognized based on the video image that the user has completed the medication action and responds to the user's medication confirmation operation on the smart medicine cabinet, then the behavior corresponding to the medication confirmation operation is identified as a confirmed true medication behavior; if it is recognized based on the video image that the user has completed the medication action and no response action from the user to the smart medicine cabinet is received within a preset time, then the user's behavior is determined to be an unconfirmed true medication behavior.

[0050] Specifically, true medication behaviors include unconfirmed and confirmed types, and non-medication behaviors include unopened medicine cabinet type, untaken medicine type, and taken medicine type. In the stage of judging missed medication, the first-level judgment is to set the medication time ±1 hour without opening the medicine cabinet to trigger a first-level warning. For example, if the medication time is 8 o'clock in the morning, and the patient does not open the medicine cabinet to take the medicine between 7 and 9 o'clock, it is determined that the patient may be at risk of missing the medication; the second-level judgment is to enter the second-level judgment if the patient still does not open the medicine cabinet to take the medicine for more than 1 hour. At this time, a comprehensive analysis is performed based on the cabinet opening action record, sensor detection data, and interactive confirmation information. If the cabinet opening action does not occur, or the sensor detects that the medicine has not been taken out after opening the cabinet (the weight difference is zero or the number of pills has not decreased), or the patient does not perform interactive confirmation, it is determined that the patient has missed the medication.

[0051] This application uses multi-dimensional monitoring, including cabinet opening detection, weight sensor detection, visual recognition system, and interactive confirmation, to monitor patients' medication-taking behavior from different angles and improve the accuracy of medication-taking behavior judgment. The weight sensor and visual recognition system can objectively record the removal of medication, while interactive confirmation increases the patient's subjective feedback, further ensuring the authenticity of medication-taking behavior.

[0052] In step S103, if the current time exceeds the set medication time or the behavior is not medication behavior, a warning message of timeout and failure to take medication is sent to the nurse station until the behavior is true medication behavior, completing the supervision of medication behavior.

[0053] In one possible implementation, the warning information includes a first warning for not taking self-prepared medication and a second warning for not taking hospital-dispensed medication. If the current time exceeds the preset value after the first medication-taking time, and the user's behavior is not taking medication without opening the counter, not taking medication without taking medication, or not taking medication after taking medication, a first warning for not taking the self-prepared medication within the time limit is sent to the nurse station; if the current time exceeds the preset value after the second medication-taking time, and the user's behavior is not taking medication without opening the counter, not taking medication without taking medication, or not taking medication after taking medication, a second warning for not taking the hospital-dispensed medication within the time limit is sent to the nurse station.

[0054] Specifically, for both self-provided and hospital-dispensed medications, when the medicine cabinet first determines a patient may have missed a dose, it uses an audio and visual reminder module to remind the patient to take their medication, such as "You haven't taken your 8 AM medication yet. Please take it as soon as possible." If the patient fails to take their medication within the prescribed timeframe, the medicine cabinet automatically sends an alert to the nurses' station, such as "Bed 22's antihypertensive medication has not been taken," notifying the nurse. The nurse receives the alert in real time via the nurse app and can remotely view the cabinet's status, including cabinet opening records, sensor data, and interactive confirmation information. This creates a tiered alert system, from initial patient reminders to notifications to nurses if medication is missed within the prescribed timeframe. Finally, medication data is analyzed to generate a patient compliance report, enabling doctors to adjust treatment plans.

[0055] This application's tiered warning mechanism uses primary and secondary judgments to implement different warning measures based on different situations. The primary judgment provides patients with a certain buffer time to avoid misjudgments of missed doses due to unforeseen circumstances. The secondary judgment is more rigorous, integrating multiple information for comprehensive analysis to ensure the accuracy of missed dose judgments. This tiered warning mechanism can effectively remind patients to take their medications on time while reducing the workload of nurses.

[0056] This application enables multi-role collaborative notification. When a patient misses a medication dose, not only the patient is notified, but also nurses and family members, creating a multi-role collaborative notification mechanism. Nurses can promptly monitor the patient's medication status and provide on-site care; family members can remind the patient to take medication, improving medication compliance. This multi-role collaborative notification mechanism can better ensure patient treatment outcomes.

[0057] The following describes the specific implementation of this application in conjunction with a specific application scenario: when a patient is admitted to the hospital, the nurse scans the code to enter the drug information into the medicine cabinet system; the medicine cabinet plays a voice reminder 15 minutes before the medication time; if the medicine is not taken within the time limit, the medicine cabinet automatically sends an "oral medication for bed 22 has not been taken" warning to the nurse station; the nurse remotely checks the status of the medicine cabinet through the APP and handles it on site in a timely manner.

[0058] Next, a medication behavior monitoring system based on a smart medicine cabinet proposed in accordance with an embodiment of the present application will be described with reference to the accompanying drawings.

[0059] Figure 3 This is a structural diagram of a medication behavior monitoring system based on a smart medicine cabinet according to an embodiment of the present application.

[0060] like Figure 3 As shown, the medication behavior monitoring system based on the smart medicine cabinet includes: a dual-drug identification module 100, a behavior determination module 200 and a missed medication monitoring module 300.

[0061] Specifically, the dual drug recognition module 100 is used to obtain drug information of the self-prepared drugs and the hospital-dispensed drugs when it is detected that the self-prepared drugs and the hospital-dispensed drugs are placed in the smart medicine cabinet;

[0062] The behavior determination module 200 is used to obtain image information and sensor information of the user before and after taking medicine, and identify the user's behavior based on the image information and the sensor information, wherein the behavior includes actual medication taking behavior and non-medication taking behavior;

[0063] The missed medication monitoring module 300 is used to send a warning message of missed medication to the nurse station if the current time exceeds the set medication time or the behavior is not medication behavior, until the behavior is true medication behavior, so as to complete the supervision of medication behavior.

[0064] Figure 4 This is a diagram of the structure of the smart medicine cabinet provided in an embodiment of the present application. The smart medicine cabinet may include:

[0065] Memory 501 , processor 502 , and computer programs stored in the memory 501 and executable on the processor 502 .

[0066] When the processor 502 executes the program, the medication behavior monitoring method based on the smart medicine cabinet provided in the above embodiment is implemented.

[0067] Furthermore, the smart medicine cabinet also includes:

[0068] The communication interface 503 is used for communication between the memory 501 and the processor 502 .

[0069] The memory 501 is used to store computer programs that can be run on the processor 502 .

[0070] The memory 501 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0071] If the memory 501, processor 502, and communication interface 503 are implemented independently, the communication interface 503, memory 501, and processor 502 can be connected to each other via a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EIS) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0072] Optionally, in a specific implementation, if the memory 501, the processor 502 and the communication interface 503 are integrated on a chip, the memory 501, the processor 502 and the communication interface 503 can communicate with each other through an internal interface.

[0073] The processor 502 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0074] This embodiment also provides a computer-readable storage medium having a computer program stored thereon. When the program is executed by a processor, the above-mentioned method for monitoring medication behavior based on a smart medicine cabinet is implemented.

[0075] One embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the Figure 2Any of the corresponding embodiments provides a method for supervising medication behavior based on a smart medicine cabinet.

[0076] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to user analysis data, user storage data, user display data, etc.) and signals involved in the present invention are all information, data and signals authorized by the user or fully authorized by all parties; and the collection, use and processing of relevant information, data and signals comply with the laws, regulations and standards of relevant countries and regions.

[0077] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and features of different embodiments or examples without contradiction.

[0078] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Thus, a feature specified as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of this application, "N" means at least two, for example, two, three, etc., unless otherwise specifically defined.

[0079] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing a custom logical function or process step, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed in a different order than shown or discussed, including performing functions in a substantially simultaneous manner or in a reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application pertain.

[0080] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable storage medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable storage medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable storage media include the following: an electrical connection having one or N wires (electronic devices), a portable computer disk cartridge (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disc read-only memory (CDROM). In addition, the computer-readable storage medium may even be paper or other suitable medium on which the program is printed, since the program can be obtained electronically by optically scanning the paper or other medium and then editing, interpreting or processing it in other suitable ways as necessary, and then storing it in a computer memory.

[0081] It should be understood that various parts of the present application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiment, the N steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0082] Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0083] In addition, the functional units in the various embodiments of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into a module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0084] The storage medium mentioned above may be a read-only memory, a magnetic disk, or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application. Persons skilled in the art may make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

[0085] It should be understood that the application of this application is not limited to the above examples. For ordinary technicians in this field, they can make improvements or changes based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to this application.

[0086] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for monitoring medication behavior based on a smart medicine cabinet, characterized in that: The medication behavior supervision method based on the smart medicine cabinet includes: When it is detected that self-prepared medicine and hospital-dispensed medicine are placed in the smart medicine cabinet, drug information of the self-prepared medicine and the hospital-dispensed medicine is obtained; Acquire image information and sensor information of the user before and after taking the medicine based on the medicine information, and identify the user's behavior based on the image information and the sensor information, wherein the behavior includes actual medication taking behavior and non-medication taking behavior; If the current time exceeds the set medication time or the behavior is not medication behavior, a warning message of timeout and failure to take medication will be sent to the nurse station until the behavior is true medication behavior to complete the supervision of medication behavior.

2. The method for monitoring medication behavior based on a smart medicine cabinet according to claim 1 is characterized in that: The drug information includes the first drug name, first drug dosage, first medication time of the self-prepared drug and the second drug name, second drug dosage, and second medication time of the hospital-dispensed drug; When it is detected that self-prepared medicine and hospital-dispensed medicine are placed in the smart medicine cabinet, obtaining drug information of the self-prepared medicine and the hospital-dispensed medicine specifically includes: The smart medicine cabinet receives drug information obtained by scanning self-provided drugs and hospital-dispensed drugs respectively. The self-provided drugs are stored in one storage compartment of the smart medicine cabinet, and the hospital-dispensed drugs are stored in another storage compartment of the smart medicine cabinet. After the drug information is compared with the drugs in the corresponding storage warehouse, the first drug name, first drug dosage, first medication time of the self-prepared drug and the second drug name, second drug dosage, second medication time of the hospital-distributed drug are obtained.

3. The method for monitoring medication behavior based on a smart medicine cabinet according to claim 2 is characterized in that: The step of obtaining drug information of the self-prepared drugs and the hospital-dispensed drugs further includes: If the current time is within the threshold range of the first medication time, a reminder to the user to take the medication is sent; If the current time is within the threshold range of the second medication-taking time, a medication reminder is sent to the user to take the medication issued by the hospital.

4. The method for monitoring medication behavior based on a smart medicine cabinet according to claim 2 is characterized in that: The image information includes an action image and a medicine image, and the sensor information includes a change in weight of the medicine; The method of obtaining image information and sensor information of the user before and after taking the medicine based on the medicine information is specifically as follows: Based on the first drug name, the first drug dosage, the second drug name and the second drug dosage, an action image of the user taking the self-prepared medicine or the hospital-dispensed medicine and an image of the medicine contained in the user's medicine taking action are obtained, as well as the change in weight of the medicine before and after the user takes the medicine from the storage bin of the smart medicine cabinet.

5. The method for monitoring medication behavior based on a smart medicine cabinet according to claim 4 is characterized in that: The identifying the user's behavior based on the image information and the sensor information specifically includes: When it is determined based on the action image and the medicine image that the amount of medicine decreases, and the changed weight of the medicine matches the single dose of the corresponding medicine in the storage bin, it is determined that the user has taken out the medicine to be taken; After the user takes out the medicine to be taken, if no user action is received within a preset time, the user's action is determined to be a non-medication action of having taken the medicine; When responding to the user's medication confirmation operation on the smart medicine cabinet, the behavior corresponding to the medication confirmation operation is identified as a true medication behavior.

6. The method for monitoring medication behavior based on a smart medicine cabinet according to claim 5 is characterized in that: If no user action is received within the preset time, the user's action is determined to be a non-medication action of having taken the medicine, which specifically includes: Obtaining a video image of the user before confirming the medication; If it is identified from the video image that the user has not taken medicine, and no response action from the user to the smart medicine cabinet is received within a preset time, it is determined that the user's behavior is a non-medication behavior of having taken medicine.

7. The method for monitoring medication behavior based on a smart medicine cabinet according to claim 2, characterized in that: The warning information includes a first warning for not taking self-prepared medicine and a second warning for not taking hospital-dispensed medicine; If the current time exceeds the set medication time or the behavior is not medication behavior, a warning message of medication failure is sent to the nurse station, specifically including: If the current time exceeds the preset value after the first medication time, and the user's behavior is not taking the medicine without opening the counter, not taking the medicine without taking the medicine, or not taking the medicine after taking the medicine, a first warning of not taking the self-prepared medicine within the time limit is sent to the nurse station; If the current time exceeds the preset value after the second medication time, and the user's behavior is not taking the medicine without opening the counter, not taking the medicine without taking the medicine, or not taking the medicine after taking the medicine, a second warning is sent to the nurse station that the hospital-dispensed medicine has been taken within the time limit.

8. A medication behavior monitoring system based on a smart medicine cabinet, characterized in that: The medication behavior monitoring system based on the smart medicine cabinet includes: A dual drug recognition module is used to obtain drug information of the self-prepared drugs and the hospital-dispensed drugs when detecting that the self-prepared drugs and the hospital-dispensed drugs are placed in the smart medicine cabinet; A behavior determination module is used to obtain image information and sensor information of the user before and after taking medicine, and identify the user's behavior based on the image information and the sensor information, wherein the behavior includes actual medication taking behavior and non-medication taking behavior; The missed medication monitoring module is used to send a warning message of missed medication to the nurse station if the current time exceeds the set medication time or the behavior is not medication behavior, until the behavior is true medication behavior, so as to complete the supervision of medication behavior.

9. A smart medicine cabinet, characterized in that: The smart medicine cabinet includes: a memory, a processor, and a medication behavior monitoring program based on the smart medicine cabinet stored in the memory and runnable on the processor. When the medication behavior monitoring program based on the smart medicine cabinet is executed by the processor, the steps of the medication behavior monitoring method based on the smart medicine cabinet are implemented as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a medication behavior monitoring program based on a smart medicine cabinet, and when the medication behavior monitoring program based on a smart medicine cabinet is executed by a processor, the steps of the medication behavior monitoring method based on a smart medicine cabinet are implemented.

Images