An intelligent drug discharging device and method based on machine vision

Abstract

The present invention discloses a drug discharge device and method based on machine vision, including a control system, a drug discharge component, a cloud analysis and processing unit, and a remote terminal. The control system includes a power supply unit, an input and output unit, a processing control unit, and a communication unit. The input unit includes an image sensor, keyboard and mouse input, and operation buttons. The output unit includes an alarm, power, display, and printing device. The input and output unit is connected to the processing control unit, and the processing control unit is connected to the cloud analysis and processing unit through the communication unit. The cloud analysis and processing unit has a built-in drug discharge information library and is connected to the remote terminal. The image sensor obtains an image of the drugs to be discharged on the drug discharge component, compares it with the drug discharge information library, confirms drug discharge or alarm prompts, and the power device drives the drug discharge component according to the instructions of the processing control unit to realize drug discharge. The remote terminal performs error operation statistics and presentation. The printing device prints a QR code of medication information to seal the drug discharge box with discharged drugs.

Description

Technical Field

[0001] The present invention relates to the field of smart elderly care technology, and in particular to an intelligent medicine dispensing device and method based on machine vision. Background Art

[0002] Medication management plays a crucial role in the lives of the elderly. The advent of an aging population highlights the risks inherent in medication management. In daily life, whether medication is taken correctly can significantly impact a user's physical and mental health. Consequently, a number of smart or electronic pill boxes have emerged on the market to remind users to take their medications on time.

[0003] However, these pill boxes often have the following disadvantages:

[0004] 1. It is limited to intelligent reminders and remote interaction functions, and does not implement risk control in the upstream drug scheduling link of the medication process. There is no fool-proof design for risk control in the drug scheduling link in drug management. As a result, in actual operations, there are still cases of wrong medication and missed medication due to medication scheduling errors or omissions.

[0005] 2. Multiple drugs are mixed together. In the workflow, multiple drugs are placed into the loading unit at one time, resulting in incorrect or missing quantities of certain drugs.

[0006] 3. The detection methods are backward and mainly rely on manual verification. However, due to the diversity of drug forms, complicated operations and other factors, manual errors are inevitable.

[0007] Therefore, technicians in this field are committed to developing an intelligent drug discharge device and method based on machine vision to ensure that the drug discharge process is accurate and error-free. Summary of the Invention

[0008] In view of the above-mentioned defects of the prior art, the technical problem to be solved by the present invention is how to ensure that the drug discharge process is accurate and error-free.

[0009] To achieve the above-mentioned objectives, the present invention provides a drug discharge device based on machine vision, comprising a control system, a drug discharge component, a cloud analysis and processing unit, and a remote terminal. The control system comprises a power supply unit, an input unit, an output unit, a processing control unit, and a communication unit. The input unit comprises an image sensor, keyboard and mouse input, and an operation button. The output unit comprises an alarm device, a power device, a display device, and a printing device. The power supply unit supplies power to the input unit, the output unit, the processing control unit, and the communication unit. The input unit and the output unit are connected to the processing control unit. The processing control unit is connected to the cloud analysis and processing unit through the communication unit. The cloud analysis and processing unit has a built-in drug discharge information database and is connected to the remote terminal. The image sensor is configured to obtain an image of the drugs to be discharged on the drug discharge component and compare it with the drug discharge information database to confirm drug discharge or alarm prompt. The power device is configured to drive the drug discharge component to discharge drugs according to the instructions of the processing control unit. The remote terminal is configured to perform statistics and presentation of erroneous operations. The printing device is configured to print a QR code of medication information to seal the drug discharge box with discharged drugs.

[0010] Furthermore, the processing control unit adopts one of Raspberry Pi, ARM, single-chip microcomputer, and computer.

[0011] Furthermore, the remote terminal includes one or more of a remote information system and a mobile phone APP.

[0012] Furthermore, the drug discharge assembly includes a drug discharge panel and a push rod. The drug discharge box includes a plurality of drug containing units arranged in rows and columns, which are suitable for being placed under the drug discharge panel. A pair of rotating small covers are provided above each drug containing unit. Each row of rotating small covers is connected into a group of centralized control. The drug discharge panel is provided with drug discharge holes corresponding to the position of each pair of rotating small covers. The push rod is configured to be driven by the power device to drive the rotating small covers, so that the drugs quickly fall into the drug discharge box, and then the rotating small covers are closed.

[0013] Furthermore, the power device includes a pair of steering gears or electromagnets, each of which is connected to one end of the push rod via a crank.

[0014] Furthermore, the medicine row box includes 4×7 medicine containing units.

[0015] Furthermore, the operating angle of the rotating small cover plate is between 0° and 80°.

[0016] The present invention also provides a drug dispensing method based on machine vision, the method comprising the following steps:

[0017] Step 1: Establish a drug discharge information database; then prepare a drug discharge component and place a drug discharge box into the drug discharge component;

[0018] Step 2: Select the drug discharge plan diagram of the user's current drugs to be discharged on the control system. The drug discharge plan diagram displays the type and quantity of drugs to be discharged in each drug storage unit;

[0019] Step 3: Place the surface of the outer packaging of the drug to be sorted with the QR code under the image sensor and press the operation button. The control system will take a photo to identify whether the drug name meets the requirements. If it does, it will proceed to the next step. If it does not, it will trigger an alarm prompt and push the error information to the remote terminal for error operation statistics and presentation;

[0020] Step 4: Place the medicines in the corresponding medicine storage units in the indicated quantity according to the medicine discharge plan. After completion, place the medicine discharge assembly under the image sensor and press the operation button to confirm.

[0021] Step 5: The image sensor takes a photo of the drug discharge assembly where the drugs are placed, and compares it with the drug discharge information database. If the information matches, the processing control unit is triggered to start the power device to discharge the drugs; if the information does not match, the non-compliant area is displayed and an alarm is triggered. At the same time, the error information is pushed to the remote terminal for error operation statistics and presentation;

[0022] Step 6: Repeat steps 2 to 5 until all the medicines to be sorted by the user are sorted; the cloud analysis and processing unit generates a QR code for the medication information of each medicine storage unit;

[0023] Step 7: Print the medication information QR code of each medicine containing unit, take out the medicine arrangement box with the medicines arranged, seal it with the medication information QR code, and complete the medicine arrangement process.

[0024] Furthermore, the medication scheduling information database includes a basic medication information database and a service recipient medication information database, and the basic medication information database includes codes, names, shapes, colors, and sizes.

[0025] Furthermore, the medication information includes the name of the medicine, the quantity, and the corresponding medication time.

[0026] The beneficial effects of the present invention are:

[0027] 1. By changing the mixed discharge of multiple drugs to multiple discharges of a single drug, and combining machine vision to implement automated confirmation and verification of the type, shape, color and quantity of the drugs, the human error factor in the drug discharge process is greatly reduced, and the risk of subsequent medication caused by errors in the drug discharge process is effectively reduced.

[0028] 2. By designing a two-leaf rotating opening and closing structure and using a motor-driven connecting rod to achieve synchronous and rapid opening and closing of all medicine-containing units, it effectively avoids drug misplacement and loss caused by drug rolling, operation jamming, etc. during operation, and greatly improves the efficiency of operation.

[0029] The concept, specific structure and technical effects of the present invention will be further described below in conjunction with the accompanying drawings to fully understand the purpose, characteristics and effects of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 1 is a system schematic diagram of a preferred embodiment of the present invention;

[0031] Figure 2 It is a control principle diagram of a preferred embodiment of the present invention;

[0032] Figure 3 It is a side view of a drug discharge device according to a preferred embodiment of the present invention;

[0033] Figure 4 This is an enlarged view of the driving portion of a preferred embodiment of the present invention;

[0034] Figure 5 It is a schematic structural diagram of a medicine box according to a preferred embodiment of the present invention.

[0035] Among them, 2-drug discharge component, 3-cloud analysis and processing unit, 4-remote terminal, 5-drug discharge information library, 6-drug discharge box, 10-power supply unit, 11-input unit, 12-output unit, 13-processing control unit, 14-communication unit, 15-image sensor, 16-operation button, 17-power device, 18-display device, 19-printing device, 21-drug discharge panel, 22-push rod, 23-rotating small cover, 24-drug discharge hole, 61-drug holding unit. DETAILED DESCRIPTION

[0036] The following describes several preferred embodiments of the present invention with reference to the accompanying drawings to make its technical content clearer and easier to understand. The present invention can be embodied in many different forms of embodiments, and the scope of protection of the present invention is not limited to the embodiments mentioned herein.

[0037] In the drawings, components with identical structures are denoted by the same reference numerals, and components with similar structures or functions are denoted by similar reference numerals. The size and thickness of each component shown in the drawings are arbitrary and are not limited by the present invention. For clarity, the thickness of components in some places in the drawings is appropriately exaggerated.

[0038] In view of the shortcomings of the prior art, the present invention proposes the following innovative solutions:

[0039] 1. Design an operating device and method to break down the discharge of multiple medications into a single, precise placement of each medication into multiple medication compartments for multiple doses. Repeat this process until all medication types are discharged.

[0040] 2. Design an operating method that uses machine vision to compare the shape, color, and quantity of drugs to ensure that each single drug in the process is handled correctly.

[0041] 3. Design a device where each medicine-holding unit is opened and closed by two rotating units, ensuring that the medicine can be easily positioned and smoothly placed into the container during the filling process, avoiding errors caused by sliding or rolling. Simultaneously, a motor drives the connecting rod to move up and down, thereby driving all medicine-holding units to open and close quickly, improving efficiency while preventing other medicines from accidentally entering and effectively preventing errors during the medicine-dispensing process.

[0042] Example 1

[0043] like Figure 1 and Figure 2 As shown, this embodiment provides a drug discharge device based on machine vision, including a control system, a drug discharge component 2, a cloud analysis and processing unit 3, and a remote terminal 4.

[0044] The control system includes a power supply unit 10, an input unit 11, an output unit 12, a processing control unit 13, and a communication unit 14. The input unit 11 includes an image sensor 15, keyboard and mouse input, and an operation button 16. The output unit includes an alarm device, a power device 17, a display device 18, and a printing device 19. The power supply unit 10 supplies power to the input unit 11, the output unit 12, the processing control unit 13, and the communication unit 14. The input unit 11 and the output unit 12 are connected to the processing control unit 13. The processing control unit 13 is connected to the cloud analysis processing unit 3 through the communication unit 14. The cloud analysis processing unit 3 has a built-in drug discharge information library 5 and is connected to the remote terminal 4. The image sensor 15 can obtain an image of the drugs to be discharged on the drug discharge component 2 and compare it with the drug discharge information library 5 to confirm drug discharge or alarm prompt. The power device 17 can drive the drug discharge component 2 to realize drug discharge according to the instructions of the processing control unit 13. The remote terminal 4 can perform error operation statistics and presentation. The printing device 19 is used to print a QR code of medication information to seal the drug discharge box with the drugs discharged.

[0045] In this embodiment, the cloud analysis and processing unit 3 is a cloud server, the processing control unit 13 adopts a Raspberry Pi or an Advanced RISC Machine (ARM) or a single-chip microcomputer or a computer, etc., the image sensor 15 is a camera, the alarm device adopts an audible and visual alarm device, and the printing device 19 is a sticker printer.

[0046] The remote terminal 4 may be a telematics system or a mobile phone application (APP).

[0047] like Figure 5 As shown, the medicine box 6 includes multiple medicine containing units 61, for example, it can include 4×7 medicine containing units 61, where the 4 rows represent morning, noon, evening and before bedtime, and the 7 columns represent Monday, Tuesday, Wednesday, Thursday, Friday, Saturday and Sunday.

[0048] like Figure 3 and Figure 4 As shown, the drug discharge assembly 2 includes a drug discharge panel 21 and a push rod 22. The drug discharge box 6 is suitable for placement below the drug discharge panel 21. A pair of rotating small covers 23 are located above each drug storage unit 61. Each row of rotating small covers 23 is connected into a group for centralized control. The drug discharge panel 2 has drug discharge holes 24 corresponding to each pair of rotating small covers 23. The push rod 22 is driven by the power device 17, driving the rotating small covers 23 to move, allowing the drugs to quickly fall into the drug discharge box 6, and then closing the rotating small covers 23. The operating angle α of the rotating small covers 23 is between 0° and 80°.

[0049] The power device 17 includes a pair of steering gears or electromagnets, each of which is connected to one end of the push rod 22 via a crank.

[0050] Example 2

[0051] This embodiment provides a method for dispensing medicine based on machine vision, comprising the following steps:

[0052] Step 1. Preparation before medication dispensing: Establish a medication dispensing information database, which includes a basic medication information database and a service recipient medication information database. The basic medication information database includes codes, names, shapes, colors, sizes, etc. Then prepare the medication dispensing component and place the medication dispensing box into the medication dispensing component;

[0053] Step 2: Drug discharge: First step: Select the drug discharge plan diagram of the user's current drugs to be discharged on the control system. The drug discharge plan diagram shows the type and quantity of drugs to be discharged in each drug storage unit;

[0054] Step 3, the second step of drug sorting: Place the surface with the QR code on the outer packaging of the drug to be sorted under the image sensor, press the operation button, and the control system takes a photo to identify whether the drug name meets the requirements. If it meets the requirements, it will proceed to the next step. If not, it will trigger an alarm prompt and push the error information to the remote terminal (telematics system or mobile phone APP) for error operation statistics and presentation;

[0055] Step 4: The third step of drug discharging: According to the drug discharging plan, place the drugs in the corresponding drug holding units in the indicated quantity. After completion, place the drug discharging component under the image sensor and press the operation button to confirm.

[0056] Step 5, the fourth step of drug discharge: the image sensor takes a photo of the drug discharge component where the drugs are placed, and compares the shape, quantity, color and other information with the drug discharge information database. If they meet the requirements, the processing control unit is triggered to start the power device (servo in this embodiment), push the push rod, and further drive the rotating small cover of the drug holding unit to move, so that the drugs quickly fall into the drug discharge box and then close it; if they do not meet the requirements, the non-compliant area is displayed and an alarm is triggered. At the same time, the error information is pushed to the remote terminal (remote information system or mobile phone APP) for error operation statistics and presentation;

[0057] Step 6: Repeat steps 2 to 5 until all the medicines to be queued for the user are queued. At the same time, the cloud analysis and processing unit generates a medication information QR code for each medicine storage unit. The medication information QR code includes information such as the medicine name, quantity, and corresponding medication time.

[0058] Step 7: Print the medication information QR code of each medicine storage unit, take out the medicine arrangement box with the medicines arranged, seal it with the medication information QR code, and complete the overall medicine arrangement process.

[0059] The advantages of the present invention are:

[0060] The process was redesigned, changing the process from placing multiple medications into the medicine storage unit at the same time to placing one medication at a time into multiple medicine storage units for multiple doses. This process was repeated until all medication types were discharged.

[0061] The key points of the present invention are:

[0062] 1. Each time a drug is discharged, the quantity, color, and shape of the drug are verified through machine vision. Then, the small rotating cover of the drug-containing unit is opened and closed to complete the loading. The discharge of all types of drugs is completed in this way.

[0063] 2. The holding unit has two small rotating covers, and the design operating angle is between 0° and 80°.

[0064] The preferred embodiments of the present invention have been described in detail above. It should be understood that numerous modifications and variations based on the concepts of the present invention are possible without inventive effort by those skilled in the art. Therefore, any technical solution that can be derived by one skilled in the art through logical analysis, reasoning, or limited experimentation based on the concepts of the present invention and the prior art should be within the scope of protection defined by the claims.

Claims

1. A drug discharging device based on machine vision, characterized in that: The system comprises a control system, a drug discharge component, a cloud analysis and processing unit, and a remote terminal. The control system comprises a power supply unit, an input unit, an output unit, a processing control unit, and a communication unit. The input unit comprises an image sensor, keyboard and mouse input, and operation buttons. The output unit comprises an alarm device, a power device, a display device, and a printing device. The power supply unit supplies power to the input unit, the output unit, the processing control unit, and the communication unit. The input unit and the output unit are connected to the processing control unit. The processing control unit is connected to the cloud analysis and processing unit via the communication unit. The cloud analysis and processing unit has a built-in drug discharge information database and is connected to the remote terminal. The image sensor is configured to obtain an image of the drugs to be discharged on the drug discharge component and compare it with the drug discharge information database to confirm drug discharge or alarm prompt. The power device is configured to drive the drug discharge component to discharge drugs according to instructions from the processing control unit. The remote terminal is configured to perform statistics and presentation of erroneous operations. The printing device is configured to print a QR code of medication information to seal the drug discharge box with discharged drugs. The medicine discharge assembly includes a medicine discharge panel and a push rod. The medicine discharge box includes a plurality of medicine holding units arranged in rows and columns, which are suitable for being placed under the medicine discharge panel. A pair of rotating small covers are provided above each medicine holding unit. Each row of rotating small covers is connected to form a group of centralized control. The medicine discharge panel is provided with medicine discharge holes corresponding to the positions of each pair of rotating small covers. The push rod is configured to be driven by the power device and to achieve up and down movement of the connecting rod through the motor, thereby driving all medicine holding units to achieve rapid opening and closing, so that the medicine quickly falls into the medicine discharge box, and then the rotating small covers are closed; The power device includes a pair of steering gears or electromagnets, each of which is connected to one end of the push rod via a crank.

2. The drug discharging device based on machine vision according to claim 1, characterized in that: The processing control unit adopts one of Raspberry Pi, ARM, single chip microcomputer and computer.

3. The drug discharging device based on machine vision according to claim 1, characterized in that: The remote terminal includes one or more of a remote information system and a mobile phone APP.

4. The drug discharging device based on machine vision according to claim 1, characterized in that: The operating angle of the rotating small cover plate is between 0° and 80°.

5. A drug dispensing method based on machine vision, characterized in that: The method comprises the following steps: Step 1: Establish a drug discharge information database; then prepare a drug discharge component and place a drug discharge box into the drug discharge component; Step 2: Select the drug discharge plan diagram of the user's current drugs to be discharged on the control system. The drug discharge plan diagram displays the type and quantity of drugs to be discharged in each drug storage unit; Step 3: Place the surface of the outer packaging of the drug to be sorted with the QR code under the image sensor and press the operation button. The control system will take a photo to identify whether the drug name meets the requirements. If it does, it will proceed to the next step. If it does not, it will trigger an alarm prompt and push the error information to the remote terminal for error operation statistics and presentation; Step 4: Place the medicines in the corresponding medicine storage units in the indicated quantity according to the medicine discharge plan. After completion, place the medicine discharge assembly under the image sensor and press the operation button to confirm. Step 5: The image sensor takes a photo of the drug discharge assembly where the drugs are placed, and compares it with the drug discharge information database. If the information matches, the processing control unit is triggered to start the power device to discharge the drugs; if the information does not match, the non-compliant area is displayed and an alarm is triggered. At the same time, the error information is pushed to the remote terminal for error operation statistics and presentation; Step 6: Repeat steps 2 to 5 until all the medicines to be sorted by the user are sorted; the cloud analysis and processing unit generates a QR code for the medication information of each medicine storage unit; Step 7: Print the medication information QR code of each medicine containing unit, take out the medicine arrangement box with the medicines arranged, seal it with the medication information QR code, and complete the medicine arrangement process.

6. The drug discharging method based on machine vision according to claim 5, characterized in that: The medication scheduling information database includes a basic medication information database and a service recipient medication information database, and the basic medication information database includes codes, names, shapes, colors, and sizes.

7. The drug discharging method based on machine vision according to claim 5, characterized in that: The medication information includes the name of the medicine, the quantity, and the corresponding medication time.

Images