Intelligent paperless dispensing vehicle fusing RFID and image recognition technology

Abstract

This invention discloses an intelligent paperless dispensing cart integrating RFID and image recognition technologies, belonging to the field of medical equipment technology. The dispensing cart includes a cart body, a verification table, a touch-screen all-in-one machine, a camera, and a power bank; the power bank powers the touch-screen all-in-one machine, and the camera is positioned above the verification table. This invention synchronizes medical orders and compiles drug lists from the HIS system via the touch-screen all-in-one machine; when pharmacists wear wristwatch-style RFID readers to retrieve medications, they read the RFID tags on the medicine cabinets to verify the types of medications; after placing the medications on the verification table, the camera captures images and uses AI vision technology to count the quantities. The dispensing data is processed by the back-end central control system, realizing the synchronization of medical orders, list compilation, verification, and statistics. This invention integrates RFID identification and AI image annotation technologies to achieve paperless verification of drug dispensing, improving work efficiency and dispensing accuracy.

Description

TECHNICAL FIELD

[0001] The application discloses an intelligent paperless medicine delivery vehicle integrating RFID and image recognition technology and relates to the technical field of medical equipment. BACKGROUND

[0002] In daily work of a hospital central pharmacy, a pharmacist usually needs to refer to a paper prescription or an electronic list and arranges a medicine taking path according to personal experience and memory when dispensing medicines; before the dispensing is completed and delivered to a ward, the pharmacist needs to manually check the variety and quantity of medicines one by one. The traditional medicine delivery vehicle is single in function and only serves as a medicine transportation tool and cannot provide intelligent checking support.

[0003] The traditional manual checking mode has the following problems: 1. The pharmacist needs to manually judge, which is high in work intensity and low in efficiency; 2. Long-time work is prone to cause medicine delivery errors due to visual fatigue or distraction; and 3. The dispensing process is difficult to be completely recorded, and only video monitoring is relied on for tracing, which is difficult to quickly locate the problem link when a wrong medicine occurs.

[0004] Therefore, an intelligent medicine delivery vehicle capable of assisting a pharmacist to efficiently and accurately complete medicine dispensing and checking and capable of completely recording the dispensing process is urgently needed. SUMMARY

[0005] The application aims to provide an intelligent paperless medicine delivery vehicle integrating RFID and image recognition technology to solve the problems in the background.

[0006] To achieve the above object, the application provides the following technical scheme. An intelligent paperless medicine delivery vehicle integrating RFID and image recognition technology, comprising: a medicine delivery vehicle body; a checking table arranged on the medicine delivery vehicle body; a touch all-in-one machine arranged on the medicine delivery vehicle body, the touch all-in-one machine being used for data interaction with a hospital HIS system and a background central control system; a mobile power supply for supplying power to the touch all-in-one machine; a camera arranged above the checking table, the camera being connected with the touch all-in-one machine and being used for collecting medicine images; a wristwatch type RFID reader worn on a wrist of the pharmacist, the RFID reader being used for reading an RFID label pasted on a medicine cabinet unit when the medicine is taken and sending a reading result to the touch all-in-one machine through Bluetooth to check the variety of the medicine.

[0007] The touch all-in-one machine accesses a hospital intranet through a wireless network and is connected with the background central control system, is used for synchronously acquiring medical order information and arranging and generating a medicine dispensing list.

[0008] The pharmacist wears a wristwatch type RFID reader on the wrist, which is used to read the RFID tag pasted on the medicine cabinet unit when taking medicine, and sends the reading result to the touch all-in-one machine to check the medicine variety.

[0009] The touch all-in-one machine is connected with an AI visual recognition module through the intranet of the hospital, the AI visual recognition module calls the AI computing resource of the intranet of the hospital, analyzes and processes the medicine image collected by the camera, so as to identify and count the number of medicines.

[0010] The AI visual recognition module supports automatic classification and counting of medium packaging and loose medicine.

[0011] The background central control system is used to perform the following operations: HIS doctor's order synchronization, medicine dispensing list arrangement, RFID reading result analysis and variety checking result generation, medicine image recognition and quantity checking, dispensing process record and workload statistics.

[0012] The dispensing trolley further comprises a soft light plate arranged above the checking table, which is used to provide uniform illumination when the camera collects the medicine image, so as to eliminate the adverse effects of reflection above and on the side of the checking table on the medicine quantity checking.

[0013] Compared with the prior art, the beneficial effects of the present application are: The present application combines RFID identification technology and AI image labeling technology, quickly identifies the variety of medicines through a wristwatch type RFID reader, collects images through a camera and calls the AI computing resource of the intranet of the hospital to intelligently identify the number of medicines, realizes double intelligentization and paperless of variety checking and quantity checking in the medicine dispensing process. The setting of the soft light plate effectively solves the problem of reflection on the surface of the medicine, and improves the accuracy of image recognition. The present application significantly reduces the working intensity of pharmacists, improves the dispensing efficiency and accuracy, and realizes automatic recording and workload statistics in the dispensing process, which is convenient for quality management and problem tracing. BRIEF DESCRIPTION OF DRAWINGS

[0014] The drawings described herein are used to provide further understanding of the present application, and form a part of the present application, but do not constitute improper limitation to the present application, in the drawings: Figure 1 A structure schematic view of an intelligent paperless dispensing trolley combining RFID and image recognition technology is provided for the present application; Figure 2 A schematic view of the application principle of an intelligent paperless dispensing trolley combining RFID and image recognition technology is provided for the present application; Figure 3 A medicine label schematic view involved in the application of the intelligent paperless dispensing trolley provided by the present application; Figure 4A flowchart illustrating the drug dispensing process of the intelligent paperless dispensing vehicle provided by this invention.

[0015] In the image: 1. Dispensing cart body, 2. Touch screen all-in-one machine, 3. Camera, 4. Soft light panel, 5. Checking station, 6. Power bank, 7. Hospital intranet, 8. Server, 9. Transfer box, 10. Medicine basket, 11. Wristwatch RFID reader, 12. Medicine cabinet, 13. Medicine label, 14. RFID tag. Detailed Implementation

[0016] The present invention will now be described in further detail with reference to the accompanying drawings and specific embodiments.

[0017] like Figure 1 As shown, the present invention provides an intelligent paperless medicine dispensing vehicle that integrates RFID and image recognition technologies, including a dispensing vehicle body 1, a verification table 5, a touch screen all-in-one machine 2, a power bank 6, a camera 3, and a soft light panel 6.

[0018] The dispensing cart body 1 serves as the mobile carrier for the entire system, equipped with casters at the bottom for easy movement. The verification table 5 is fixedly installed on the upper surface of the dispensing cart body 1, made of non-slip material, and is used for temporarily placing medicines to be verified. The touchscreen all-in-one machine 2 is installed on one side of the dispensing cart body 1, with a built-in wireless network card, connecting to the hospital's intranet 7 via WiFi to maintain data communication with the central control system and HIS system deployed on the back-end server 8. The power bank 6 is installed below the dispensing cart body 1 and connected to the touchscreen all-in-one machine 2 via a power cord, providing uninterrupted power to ensure the equipment operates continuously without interruption due to power outages.

[0019] Camera 3 is mounted directly above the verification table 5 via a bracket, with its lens pointing vertically downwards at the table surface. It is connected to the touch screen all-in-one machine 2 via a USB data cable to capture images of the medicines on the verification table 5 in real time. A soft light panel 4 is arranged around camera 3. Its material is a semi-transparent soft light material that can evenly scatter ambient light, effectively eliminating top and side reflections from the surface of medicine packaging, especially aluminum foil and ampoules, providing a clear image foundation for AI visual recognition.

[0020] like Figure 2 As shown, the pharmacist wears a wristwatch-style RFID reader 11, which is paired and connected to the touchscreen all-in-one machine 2 via Bluetooth wireless communication protocol. Figure 3As shown, each medicine cabinet unit in the central pharmacy's medicine cabinet 12 has an RFID tag 14 affixed to its medicine label 13, containing storage location information. Pharmacists go to the corresponding medicine cabinet 12 according to the medicine dispensing list displayed on the touchscreen all-in-one machine 2. When reaching for a medicine, the wristwatch-style RFID reader 11 automatically triggers a reading action, reading the location information from the RFID tag 14 and transmitting it back to the touchscreen all-in-one machine 2. The touchscreen all-in-one machine 2 compares the read tag information with the medicine type information in the list. If they match, it indicates correctness; if they don't match, it issues an alarm, thus ensuring the accuracy of the medicine type at the source of dispensing.

[0021] After the pharmacist places the retrieved medication on the verification table 5, camera 3 captures the image and transmits it to the touchscreen all-in-one machine 2. The touchscreen all-in-one machine 2 uses the hospital's intranet 7 to access the AI ​​visual recognition module deployed on the backend server 8, utilizing the high-performance AI computing resources of the hospital's intranet 7 to perform deep analysis of the image. The AI ​​visual recognition module can identify the morphological characteristics of the medication, automatically distinguish between packaged and loose medications, and count their quantities separately. The recognition results are displayed in real-time on the screen of the touchscreen all-in-one machine 2 and compared with the dosage prescribed by the HIS system to complete the quantity verification. If the quantities match, the verification is successful; if they do not match, the pharmacist is prompted to adjust. After the quantity verification of this type of medication is successful, the pharmacist transfers the medication to the transport box 9 below, with fragile and refrigerated medications stored in the medicine basket 10.

[0022] All operational data throughout the dispensing process, including pharmacist identification, medication collection time, drug type verification results, quantity verification results, and identification images, are uploaded by the touchscreen all-in-one machine 2 to the central control system deployed on the back-end server 8 for storage and processing. The back-end central control system is responsible for the synchronous distribution of HIS medical orders, the dynamic arrangement of drug dispensing lists, the parsing of RFID reading results, the fusion and comparison of image recognition results, and finally generates complete dispensing records and pharmacist workload statistics reports for management personnel to review and trace.

[0023] like Figure 4 As shown, after the doctor issues a prescription, the ward nurse confirms the prescription, and the system automatically generates a queue of prescriptions to be dispensed, and periodically generates a medication dispensing list arranged by ward. The pharmacist picks up the dispensing cart 1 and logs into the touch screen all-in-one machine 2 to view the dispensing tasks to be executed, selects a specific task, and begins dispensing.

[0024] The pharmacist locates the corresponding medication according to the prompts on the touchscreen all-in-one machine 2 and retrieves the medication while wearing a wristwatch-style RFID reader / writer 11. The touchscreen all-in-one machine 2 analyzes the RFID reading result and determines whether the location number of the retrieved medication matches the medication to be retrieved: if they do not match, the touchscreen all-in-one machine 2 displays an alarm, and the pharmacist returns the incorrect medication; if they match, the pharmacist places the retrieved medication on the dispensing cart verification station 5.

[0025] After camera 3 captures images of the medicine, the AI ​​visual recognition module identifies the quantity of the medicine. The touch screen all-in-one machine 2 determines whether the identified quantity matches the quantity of the medicine in the dispensing list. If they do not match, the touch screen all-in-one machine 2 will display an alarm prompt, and the pharmacist will manually add or remove the quantity of medicine to adjust it. If they match, it will continue to determine whether all the medicines in this dispensing task list have been dispensed.

[0026] If the medication has not yet been dispensed, the touchscreen kiosk 2 will automatically switch to the next medication, and the pharmacist will continue dispensing. If the medication has been dispensed, the touchscreen kiosk 2 will display a message indicating that the task is complete and return to the list of pending tasks. The pharmacist will then determine if they have any pending tasks; if so, they will select the next task to continue dispensing; otherwise, the current workflow will end.

[0027] The technical solution of this invention organically combines RFID technology and AI image annotation technology to cover the entire process from dispensing medicine to verification, realizing paperless and intelligent operation and effectively improving the efficiency and accuracy of pharmacy work.

[0028] The above description is merely a preferred embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural or procedural modifications made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A smart paperless dispensing vehicle integrating RFID and image recognition technologies, characterized in that, include: The medicine dispensing vehicle itself; A verification station is installed on the main body of the dispensing vehicle; The touch screen all-in-one machine installed on the main body of the medicine dispensing vehicle is used to interact with the hospital's HIS system and the back-end central control system; A portable power supply for powering the touch screen all-in-one machine; A camera is installed above the verification station and connected to the touch screen all-in-one machine for capturing images of medicines; A wristwatch-style RFID reader worn on the pharmacist's wrist is used to read the RFID tags affixed to the medicine cabinet unit when retrieving medicines, and sends the reading results to the touch screen all-in-one machine via Bluetooth to verify the medicine type.

2. The intelligent paperless dispensing vehicle integrating RFID and image recognition technologies according to claim 1, characterized in that, The touch screen all-in-one machine connects to the hospital's intranet via a wireless network and is connected to the back-end central control system to synchronously obtain medical order information and compile and generate a drug dispensing list.

3. The intelligent paperless dispensing vehicle integrating RFID and image recognition technologies according to claim 1, characterized in that, Pharmacists wear wristwatch-style RFID readers to read RFID tags affixed to medicine cabinet units when retrieving medicines, and send the reading results to a touch screen all-in-one machine via Bluetooth to verify the medicine type.

4. The intelligent paperless dispensing vehicle integrating RFID and image recognition technologies according to claim 1, characterized in that, The touch screen all-in-one machine is connected to the AI ​​visual recognition module through the hospital's intranet. The AI ​​visual recognition module calls on the AI ​​computing resources of the hospital's intranet to analyze and process the drug images captured by the camera in order to identify and count the quantity of drugs.

5. The intelligent paperless dispensing vehicle integrating RFID and image recognition technologies according to claim 4, characterized in that, The AI ​​visual recognition module supports automatic classification and statistics of packaged and loose medicines.

6. The intelligent paperless dispensing vehicle integrating RFID and image recognition technologies according to claim 1, characterized in that, The background control system is used to perform the following operations: HIS medical order synchronization, drug dispensing list arrangement, RFID reading result analysis and variety verification result generation, drug image recognition and quantity verification, dispensing process recording and workload statistics.

7. The intelligent paperless dispensing vehicle integrating RFID and image recognition technologies according to claim 1, characterized in that, The dispensing cart also includes a diffuser panel positioned above the verification station. The diffuser panel provides uniform illumination for the camera to capture images of the medicines, thereby eliminating the adverse effects of reflections above and to the sides of the verification station on the verification of the quantity of medicines.

Images