Intelligent medicine safety management system based on voice navigation and application method thereof

Abstract

The invention relates to the technical field of intelligent management, in particular to an intelligent medicine safety management system based on voice navigation and an application method of the intelligent medicine safety management system. The storage unit is arranged to be used for storing a plurality of medical articles, and the medical articles are provided with attribute information including the valid period; the triggering module is used for opening the storage unit and triggering and reminding the position of the matched medical article or triggering the medical article to be discharged to the medicine outlet; the identity recognition module is used for recognizing personnel information of personnel operating the mobile medicine vehicle; and the voice control module is configured to receive voice information of a person at first, then identify key information including the medical articles from the voice information, then find the positions of the corresponding medical articles from the storage unit, and then transmit the position information to the trigger module to obtain the corresponding medical articles. The defects of an intelligent management system in the aspects of traceability and accurate management are overcome.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent management, and in particular to an intelligent medicine safety management system based on voice navigation and an application method thereof. Background Art

[0002] Medical supplies include at least medicines, sterile items and sterile instruments, which play a vital role in the medical process:

[0003] (1) Drugs: Drugs include prescription drugs and over-the-counter drugs, which are used to prevent, diagnose, and treat diseases and to restore and adjust body functions. Drug management requires strict control to ensure the correct dosage, expiration date, and storage conditions to avoid adverse reactions caused by improper use of drugs.

[0004] (2) Sterile items: Sterile items refer to items that have been sterilized and do not contain any microorganisms, such as surgical gauze, sterile cotton balls, and surgical dressings. These items are used during surgery and other invasive procedures and must be kept sterile to avoid the risk of infection.

[0005] (3) Sterile instruments: Sterile instruments include various sterilized medical instruments, such as scalpels, surgical scissors, syringes, etc. These instruments directly contact the patient's body tissue or blood during surgery and diagnosis and treatment, and must be kept sterile to ensure patient safety.

[0006] With the continuous advancement of medical technology and the improvement of medical service levels, hospitals have put forward higher requirements for the management of medical supplies. The traditional management method of medical supplies mainly relies on manual records and paper files, which is not only inefficient, but also prone to record errors, data loss and management loopholes. These problems not only affect the smooth progress of medical work, but also may threaten the safety of patients.

[0007] Therefore, how to efficiently and accurately manage medical supplies and ensure their safety and traceability in each link such as procurement, storage, use and disposal is an important issue currently facing medical institutions.

[0008] In order to improve the accuracy and efficiency of medical supplies management, intelligent management systems are gradually being introduced into medical institutions. Intelligent management systems usually include hardware equipment, software platforms and data processing technologies, and through automation and information technology, they can achieve full-process management of medical supplies from procurement, storage, use to waste disposal. However, existing intelligent management systems still have certain deficiencies in traceability and precise management. Summary of the invention

[0009] In view of the above problems, the purpose of the present invention is to provide an intelligent medicine safety management system based on voice navigation and its application method, so as to solve the shortcomings of the existing intelligent management system in terms of traceability and precise management.

[0010] The above-mentioned object of the present invention is achieved through the following technical solutions:

[0011] An intelligent medicine safety management system based on voice navigation, including a medicine cart, further comprising:

[0012] Operation table;

[0013] A storage unit is provided in the vehicle body, and the storage unit is used to store a plurality of medical items, and the medical items are provided with attribute information including an expiration date;

[0014] Trigger module: used to open the storage unit and trigger the location of the adapted medical item to be reminded or to trigger the medical item to be taken out of the medicine outlet;

[0015] An identity recognition module is used to identify the personnel information of the personnel operating the mobile medicine vehicle;

[0016] The voice control module is configured to first receive the voice information of the personnel, then identify the key information including the medical items from the voice information, then find the location of the corresponding medical items from the storage unit, and then transmit the location information to the trigger module to obtain the corresponding medical items.

[0017] Preferably: also include:

[0018] The medicine insertion module is used when the user needs to insert medicine. When receiving the medicine insertion instruction from the user, the user is first identified by the receiving identity recognition module to confirm that the current user has the permission to insert medicine, the storage unit is opened, the replenished medical items are received, and the attribute information of the replenished medical items including the medical item ID, production date, expiration date and drug grade of the medicine are recorded in the storage space within the system, and the corresponding relationship between the medical item ID and the position of the storage space is recorded.

[0019] Preferably: the voice control module further comprises:

[0020] Voice identity recognition module: used to receive voice information, identify the identity information of the person making the voice, and then transmit the information to the trigger module;

[0021] The voice medicine name recognition module is used to receive voice information to recognize text, and parse the corresponding medicine name from it, and then send it to the trigger module so that the trigger module can open the storage unit and trigger the location of the adapted medicine or trigger the medicine to be taken out of the medicine outlet.

[0022] Preferably: the voice identity recognition module and the voice medicine name recognition module synchronously realize voice recognition identity and voice recognition text in the WeChat applet. After the medicine entry authority is successfully confirmed, the electromagnetic lock of the drawer is opened, the LED light next to the storage cavity where the medicine needs to be supplemented is on, and the production date, expiration date and drug grade information of the supplemented medicine are entered into the storage system;

[0023] The method of entering the production date, expiration date and drug grade information of the supplementary medicine into the storage system is as follows: first, after entering the production date, expiration date and drug grade information of the supplementary medicine, the electromagnetic lock of the drawer where the corresponding medicine is placed is opened, and the display screen displays the corresponding drawer position. The user opens the drawer and places the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines. Realize real-time update of data in the storage system. When replacing another medicine, enter the production date, expiration date and drug grade information of the supplementary medicine through the display screen again, and place the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines;

[0024] Each LED light and sensor is numbered, which includes the location code and the code for the presence or absence of drugs from the front to the back;

[0025] The method in which the user issues the instruction to put in the medicine includes input from a display screen or language information collected by a voice recognition device;

[0026] When the user needs to take medicine, the user issues a medicine removal instruction, and the identity recognition system identifies the user. After the identity recognition is successful, it is confirmed whether the medicine level information corresponding to the user's personnel authority level information includes the medicine level information of the medicine to be taken out. If so, the drawer where the medicine to be taken out is located is displayed on the display screen, the electromagnetic lock of the corresponding drawer is controlled to open, and the LED light next to the medicine with the longest production date is controlled to light up, prompting the personnel to quickly locate the position of the medicine; if not, the medicine cannot be taken; the way in which the user issues a medicine removal instruction includes display screen input or language information collected by the voice recognition device.

[0027] Preferably: the voice control module further includes a drug name recognition model.

[0028] Preferably: the mobile medicine cart comprises an operating table and a locker, the operating table is installed above the locker, the locker is equipped with at least three drawers arranged from top to bottom, and the drawers are locked on the mobile medicine cart by an electromagnetic lock;

[0029] A display screen is installed on the top of the mobile medicine vehicle;

[0030] The drawer is divided into a plurality of storage chambers by partitions, an infrared sensor for sensing medicine is installed at the bottom of each storage chamber, and an indicator light is installed next to each storage chamber;

[0031] A surveillance camera with a forward sensing direction is installed on the back side of the drawer, and is used to monitor the pictures of taking and putting medicines; when the drawer is opened, the surveillance camera monitors the pictures of taking and putting medicines from the gap between the drawer and the locker;

[0032] It also includes an identity recognition system, which is used to identify the personnel information of the personnel operating the mobile medicine vehicle, and the identity recognition system includes at least one of a camera, a voice recognition device, a sound recognition device, and a radio frequency card recognition device;

[0033] It also includes a monitoring system, which is used to monitor the operator's facial information, the medicine taking screen, and the medicine putting screen;

[0034] It also includes a storage system, the storage system is used to store drug information and personnel information, the drug information includes the name of the drug, location information, production date, expiration date, and drug grade information of the drug, and the personnel information includes identity feature information corresponding to the identity recognition system and personnel authority level information; each type of personnel authority level information includes corresponding matching drug grade information, and the personnel authority level information is associated with the drug grade information one by one;

[0035] When the user needs to put in medicine, the user issues a medicine-putting instruction, and the identity recognition system identifies the user to confirm whether the current user has the authority to put in medicine. After the medicine-putting authority is successfully confirmed, the electromagnetic lock of the drawer is opened, and the LED light next to the storage cavity that needs to replenish the medicine is on. The production date, expiration date and drug grade information of the replenished medicine are entered into the storage system;

[0036] The method of entering the production date, expiration date and drug grade information of the supplementary medicine into the storage system is as follows: first, after entering the production date, expiration date and drug grade information of the supplementary medicine, the electromagnetic lock of the drawer where the corresponding medicine is placed is opened, and the display screen displays the corresponding drawer position. The user opens the drawer and places the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines. Realize real-time update of data in the storage system. When replacing another medicine, enter the production date, expiration date and drug grade information of the supplementary medicine through the display screen again, and place the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines;

[0037] Each LED light and sensor is numbered, which includes the location code and the code for the presence or absence of drugs from the front to the back;

[0038] The method in which the user issues the instruction to put in the medicine includes input from a display screen or language information collected by a voice recognition device;

[0039] When the user needs to take medicine, the user issues a medicine taking instruction, and the identity recognition system identifies the user. After the identity recognition is successful, it is confirmed whether the medicine level information corresponding to the user's personnel authority level information includes the medicine level information of the medicine to be taken out. If so, the drawer where the medicine to be taken out is located is displayed on the display screen, the electromagnetic lock of the corresponding drawer is controlled to open, and the LED light next to the medicine with the longest production date is controlled to light up, prompting the personnel to quickly locate the position of the medicine; if not, the medicine cannot be taken out;

[0040] The method in which the user issues a drug removal instruction includes input from a display screen or language information collected by a voice recognition device;

[0041] At least one of the left and right ends of the locker is provided with at least two rows of vertically arranged support bars for hanging items, and the support bars are provided with at least three longitudinally arranged hanging holes;

[0042] The external hanging items include at least one of a storage box, a plastic bag fixing frame, a tray box and a hanging rod;

[0043] The plastic bag fixing frame comprises a mounting frame, on which a hook connected to a hanging hole is mounted;

[0044] The plastic bag fixing frame further comprises an upper fixing frame and a lower fixing frame for clamping the top flange of the plastic bag, and the upper fixing frame and the lower fixing frame are both rotatably connected to the mounting frame;

[0045] A tray box is installed below the plastic bag fixing frame, and the tray box is used to hold the bottom of the garbage bag;

[0046] A wire tube hanging device is installed at the upper end of the right side of the locker;

[0047] The wire tube article hanging device comprises a trough body opening upward, and a limiting plate extending upward is provided on the top of the trough body, and at least four limiting plates are arranged circumferentially.

[0048] The present invention also provides an application method of an intelligent medicine safety management system based on voice navigation, which applies any of the above-mentioned intelligent medicine safety management systems based on voice navigation to a medicine distribution center, specifically:

[0049] S1: The receiving area of ​​the distribution center receives the medical orders from doctors in various departments, reviews the medical orders, forms a drug delivery order, and sends the drug delivery order to the drug selection area of ​​the distribution center;

[0050] S2: The medicine selection area of ​​the distribution center receives the medicine dispensing order request, checks the medicine liquid and medicine order, and specially marks it, and places an order to the intelligent medicine dispensing equipment. The intelligent medicine dispensing equipment uses the storage management module to complete the delivery of the selected medicine;

[0051] S3: Before entering the warehouse for dispensing, multiple drugs that have been sorted and flushed are reviewed. If the review fails, an alarm is issued;

[0052] S4: Warehouse dispensing: bring the liquid medicine, medicine and special mark to the warehouse dispensing area for dispensing according to the dispensing information;

[0053] S5: After the dispensing is completed, an automated audit is conducted to review the release of multiple drugs for hedging drugs. If the review fails, an alarm will be issued;

[0054] S6: Carry out automated distribution to deliver the prepared medicines to the departments in need.

[0055] Preferably: also include:

[0056] In step S2, before the medicine is put into the warehouse for dispensing, the various medicines of the hedging medicine are reviewed. If the review fails, an alarm is issued. Specifically:

[0057] Establish a database containing detailed information on drugs, attach barcodes and labels to each drug, scan drug information, and compare and review the information of multiple drugs in the hedging drug with the drugs required for the order document;

[0058] When the review fails, the system automatically sends out an alarm to notify relevant personnel. The alarm methods include sound alarm, SMS notification, and system pop-up window. The results of each review are recorded, including detailed information on pass and fail, to facilitate subsequent tracing and inspection;

[0059] In step S4, after the preparation is completed, the multiple drugs of the hedging drug are reviewed for delivery. If the review fails, an alarm is issued, specifically:

[0060] After the medicine is prepared, the complete label and document information of the medicine are retained and kept in the same container as the medicine. The medicine information is scanned again and compared with the information of the medicine required by the order document for verification;

[0061] When the review fails, the system automatically sends out an alarm to notify relevant personnel. The alarm methods include sound alarm, SMS notification, and system pop-up window. The results of each review are recorded, including detailed information on pass and fail, to facilitate subsequent tracing and inspection.

[0062] Compared with the prior art, the present invention has at least one of the following beneficial effects:

[0063] (1) By providing an intelligent medical safety management system based on voice navigation and its application method, the in-and-out management module is used to identify the identity of the operator and collect and identify the medical supplies when the medical supplies are put into or taken out of the warehouse, and to navigate the medical supplies to the positioning point when they are put into the warehouse, so that the medical supplies are put into the warehouse at the correct positioning point, and at the same time, the medical supplies to be taken out of the warehouse are verified when they are taken out of the warehouse, so as to ensure the correctness of the medical supplies taken out of the warehouse. The above technical scheme can solve the shortcomings of the existing intelligent management system in terms of traceability and precise management. At the same time, the in-and-out management module identifies the identity of the operator and collects and identifies the medical supplies when the medical supplies are put into or taken out of the warehouse, and navigates through RFID, position sensor and image recognition technology when they are put into the warehouse, so that the medical supplies are accurately put into the warehouse at the correct positioning point, and at the same time, the medical supplies to be taken out of the warehouse are verified in detail when they are taken out of the warehouse, so as to ensure the correctness of the items taken out of the warehouse. The system effectively improves the accuracy of operations, ensures the authorization of operators through identity recognition, avoids manual placement errors through intelligent navigation and recognition technology, and improves the utilization rate of storage space. In the outbound link, strict verification procedures are used to ensure the accuracy and integrity of medical supplies, effectively preventing the occurrence of wrong, missed and mis-taken items. In addition, the system's comprehensive recording and traceability functions allow each operation to be tracked and reviewed in detail, further improving the transparency and security of medical supplies management, ensuring the rational use and traceability of medical resources, and providing an efficient and safe solution for hospital management.

[0064] (2) By providing an intelligent medical safety management system based on voice navigation and its application method, the medical supplies inventory module is used to automatically manage the expiration date, disinfection time, shortage of supplies, inventory of supplies, use list of supplies, and use list of users of the medical supplies. The above technical scheme effectively improves the management efficiency and accuracy of medical supplies. The module can monitor and remind the expiration date and disinfection time of the medicine in real time to ensure that the medical supplies are always used in the best condition and avoid the risk of using expired or unqualified supplies. Through automated inventory and shortage management, the system can timely discover and remind replenishment to prevent the normal progress of medical work from being affected by insufficient inventory. The use list of supplies and the use list of users are recorded and managed in detail, so that each use operation can be traced, ensuring the transparency and safety of the use of medical supplies, improving the management level and use efficiency of medical materials, and further ensuring the quality and safety of medical services.

[0065] (3) Through the intelligent medical safety management system based on voice navigation and its application method, the supplies expiration management module is used to provide timely reminders and replacements when the medical supplies expire. The above technical solution can automatically monitor and track the expiration date of each medical supply, and promptly issue reminders to notify relevant personnel to replace them before expiration, prevent the use of expired supplies, and ensure that all medical supplies are always within the validity period. Through the automated reminder and replacement process, the omissions and errors in manual management are greatly reduced, the work efficiency and management standardization are improved, and the quality of medical services and the safety of patients are guaranteed. The application of this module not only improves the hospital management level, but also saves human resources, optimizes the use and management of medical supplies, and ensures the rational use of medical resources.

[0066] (4) By providing an intelligent medical safety management system based on voice navigation and its application method, the comprehensive supplies management module is used to manage the temperature and humidity of the storage environment of the medical supplies, the disinfection process and disinfection records of the supplies, and the power supply of the storage environment. The above technical solution can monitor and adjust the temperature and humidity of the storage environment in real time to ensure that medical supplies are stored under optimal conditions and avoid quality degradation due to environmental factors. At the same time, the system strictly manages the disinfection process and disinfection records to ensure that all medical supplies undergo compliant disinfection procedures and remain sterile, and automatically records disinfection data for traceability. The power management function of the storage environment ensures the stable operation of the storage device and avoids changes in storage conditions due to power failures. Through these comprehensive management measures, the system effectively improves the management level of medical supplies, ensures their safety and effectiveness, and thus improves the quality of medical services and the safety of patients. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 This is the overall structure diagram of the intelligent management system for medical supplies with full-process traceability of the present invention;

[0068] Figure 2 This is a detailed schematic diagram of the intelligent management system for medical supplies with full-process traceability according to the present invention;

[0069] Figure 3 This is a schematic diagram of the connection and interaction of the system equipment of the present invention;

[0070] Figure 4 This is an overall flow chart of the application method of the intelligent management system for medical supplies with full-process traceability of the present invention;

[0071] Figure 5 It is the flow chart of the distribution center;

[0072] Figure 6 It is a structural diagram of a medicine cart of the present invention. DETAILED DESCRIPTION

[0073] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0074] Those skilled in the art will appreciate that, unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present invention refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0075] Example 1

[0076] An intelligent medicine safety management system based on voice navigation, including a medicine cart, further comprising:

[0077] Operation table;

[0078] A storage unit is provided in the vehicle body, and the storage unit is used to store a plurality of medical items, and the medical items are provided with attribute information including an expiration date;

[0079] Trigger module: used to open the storage unit and trigger the location of the adapted medical item to be reminded or to trigger the medical item to be taken out of the medicine outlet;

[0080] An identity recognition module is used to identify the personnel information of the personnel operating the mobile medicine vehicle;

[0081] The voice control module is configured to first receive the voice information of the personnel, then identify the key information including the medical items from the voice information, then find the location of the corresponding medical items from the storage unit, and then transmit the location information to the trigger module to obtain the corresponding medical items.

[0082] It also includes: a medicine insertion module, which is used for receiving a medicine insertion instruction from the user when the user needs to insert medicine, first identifying the user through the receiving identity recognition module to confirm that the current user has the right to insert medicine, opening the storage unit, receiving the replenished medical items, and recording the attribute information of the replenished medical items including the medical item ID, production date, expiration date and drug grade of the medicine in the storage space in the system, and at the same time recording the correspondence between the medical item ID and the position of the storage space.

[0083] The voice control module further comprises:

[0084] Voice identity recognition module: used to receive voice information, identify the identity information of the person making the voice, and then transmit the information to the trigger module;

[0085] The voice medicine name recognition module is used to receive voice information to recognize text, and parse the corresponding medicine name from it, and then send it to the trigger module so that the trigger module can open the storage unit and trigger the location of the adapted medicine or trigger the medicine to be taken out of the medicine outlet.

[0086] First of all, the technical difficulties of enabling doctors to announce drugs and recognize drug names by voice are mainly reflected in the following aspects:

[0087] 1. Medical terminology recognition: There are a large number of professional terms and words used in specific contexts in the medical field. Their complexity increases the difficulty of speech recognition and may lead to recognition errors or inaccuracies.

[0088] 2. Accent and speaking speed differences: Different doctors have different accents and speaking speeds, which will have an adverse effect on the accuracy of speech recognition. The polyphonic characters and polyphonic words unique to Chinese also increase the difficulty of recognition.

[0089] 3. Environmental noise interference: The doctor’s working environment may be noisy, such as frequent phone calls and communication among multiple people, which will greatly affect the accuracy of recognition.

[0090] 4. Recognition rate and efficiency issues: Speech recognition technology needs to achieve a high recognition rate to meet the high accuracy requirements in the medical field. At the same time, the efficiency of doctors at work is also key, so speech recognition technology needs to respond quickly and accurately.

[0091] To this end, a microphone array is pre-installed on the medicine cart. When the voice control is triggered to locate emergency medicine under special circumstances, the person making the voice is first found through the sound source localization algorithm.

[0092] The sound source localization algorithm is the core of the sound source acquisition technology. It determines the location of the sound source by analyzing the time delay, intensity, and phase characteristics of the sound signal. Common algorithms include the generalized cross-correlation (GCC) algorithm and the phase difference-based method (such as the PHAT algorithm). The voice of the doctor or nurse is collected in advance, and the basic attributes of the doctor or nurse's voice, such as pitch and rhythm, are captured by using the Mel-frequency cepstral coefficients (MFCC). The following steps can be followed:

[0093] Pre-emphasis: Pre-emphasis processing compensates for the energy loss of the high-frequency part of the speech signal by boosting the high-frequency part, which is particularly important for capturing pitch changes. The pre-emphasis coefficient is usually between 0.9 and 1.0, and the commonly used value is 0.97.

[0094] Framing and windowing: Speech signals are divided into frames and a window function (such as a Hamming window) is applied to each frame to reduce the boundary effect between frames. The frame size is usually 20-30ms, and there is a 10% overlap between frames to maintain signal continuity.

[0095] Fast Fourier Transform (FFT): Perform FFT on each frame of the windowed signal to convert the signal from the time domain to the frequency domain and obtain its power spectrum.

[0096] Mel filter bank: Mel filter bank is a set of triangular filters with center frequencies evenly distributed on the Mel frequency scale. The power spectrum obtained by FFT is passed through the Mel filter bank to obtain a series of filter output energies. The Mel frequency scale is designed based on the characteristics of human auditory perception, which is more in line with human perception of frequency.

[0097] Logarithmic Operation: In order to compress the dynamic range and enhance the robustness, the output energy of the Mel filter bank is logarithmically operated.

[0098] Discrete Cosine Transform (DCT): Perform DCT on the logarithmic energy spectrum to obtain MFCC parameters. DCT can convert the energy spectrum into cepstrum coefficients. Low-order MFCC coefficients usually represent low-frequency information of speech, such as pitch and fundamental frequency, while high-order MFCC coefficients represent high-frequency information of speech, such as formants. Usually 12-13 MFCC coefficients and their first-order and second-order differences are extracted as the final speech features.

[0099] Cepstral lifting: In order to enhance the discrimination of MFCC features, MFCC coefficients are usually subjected to cepstral lifting, which is a pre-emphasis technique that enhances the high frequency part by multiplying a lifting window (such as 1+(cep_lifter / 2)*sin(pi*n / cep_lifter)). Difference parameters: In addition to MFCC coefficients, first-order and second-order difference parameters can also be calculated. These parameters can capture the dynamic changes of speech signals, which are particularly important for identifying rhythm changes.

[0100] Through the above steps, MFCC can effectively capture the pitch and rhythm characteristics of the doctor's voice, providing important feature information for speech recognition and analysis.

[0101] By capturing the pitch and rhythm features of the doctor's voice and comparing them with the pre-stored source data, it is possible to obtain which doctor or nurse it is and realize personal identification. Each doctor or nurse plays the urgent drug names in advance and stores the corresponding sound core fragments, such as storing the sound fragments of the drug names and saving the corresponding drug names.

[0102] In an emergency, the voice of a doctor or nurse is captured. Technically, two schemes are operated simultaneously. The first is to compare the voice with the pre-stored core fragments of the voice of the corresponding doctor or nurse. An autoencoder structure can be used to extract the features of the voice, and compare them with the features of the pre-stored core fragments of the voice of the drug names. The closest one can be the drug name corresponding to the voice. For example, the time domain audio signal is converted into a frequency domain representation, such as obtaining a spectrum through a short-time Fourier transform (STFT). The sound collected in an emergency is first obtained by obtaining a spectrum through a short-time Fourier transform (STFT). After the identity of the doctor or nurse corresponding to the collected sound is identified, the spectrum values ​​of the core fragments of the voice of the emergency medicine pre-stored by the doctor or nurse are found and compared separately to find the closest value. Generally speaking, the emergency medicine corresponding to the closest value is the value shouted out by the doctor or nurse in this emergency.

[0103] The second solution is to perform voice-to-text recognition on the sound. The voice medical product name recognition module recognizes the text corresponding to the voice, and then uses voice to broadcast the text for confirmation by the corresponding doctor or nurse.

[0104] The first and second solutions can be executed simultaneously. If there is a deviation in the first solution, the second solution will immediately start the corresponding voice medical product name recognition module for voice recognition. These two methods are processed simultaneously to achieve the best balance between accuracy and speed.

[0105] The voice identity recognition module and the voice medical product name recognition module simultaneously realize voice recognition identity and voice recognition text in the WeChat applet. After the drug entry permission is successfully confirmed, the electromagnetic lock of the drawer is opened, the LED light next to the storage cavity that needs to be supplemented is on, and the production date, expiration date and drug grade information of the supplemented drug are entered into the storage system;

[0106] To realize voice recognition identity and voice recognition text simultaneously in WeChat Mini Program, you can use WeChat Mini Program plug-in to achieve this. The following are the specific steps and methods:

[0107] 1. Add a plug-in: In the WeChat applet background, go to Settings, select Third-party Settings, and Add Plug-in. Search and add a simultaneous interpretation plug-in, such as the Tencent Cloud speech recognition plug-in.

[0108] 2. Configure app.json: Add the configuration information of the plug-in in the app.json file of the mini program, as shown below:

[0109]

[0110]

[0111] After this configuration, your applet can use the speech recognition function provided by this plug-in.

[0112] 3. Introduce the plug-in: Introduce the plug-in in the program file of the page and obtain the globally unique speech recognition manager recordRecoManager:

[0113] javascript

[0114] / *index.js* /

[0115] const plugin=requirePlugin("WechatSI")

[0116] const manager=plugin.getRecordRecognitionManager()

[0117] 4. Realize synchronous voice conversion: Design a UI interface, such as long pressing the button to record, and releasing the button to convert the recording into text in real time. At the same time, you can provide an editing function on the user interface to allow users to edit the converted text, and provide an upload function to upload the original voice file and the converted text to the background server.

[0118] 5. Write recognition callback: implement the callback function of speech recognition and process the recognition results. For example, you can set the onRecognize callback to process the recognition content returned in real time, and the onStop callback to process the recognition end event:

[0119]

[0120]

[0121] 6. Identity recognition: For identity recognition, it can be achieved by analyzing voice features such as pitch, rhythm, intonation, etc. This usually requires more complex voice processing technology and may require the integration of additional services or algorithms to analyze voice features and identify the speaker.

[0122] 7. Synchronous implementation: To implement speech recognition text and identity recognition synchronously, you can process the results of both recognition in the same callback function. For example, in the onRecognize callback, in addition to updating the recognized text, you can also call the identity recognition API and process and display the results together.

[0123] Through the above steps, you can realize the functions of voice recognition identity and voice recognition text in WeChat applet at the same time. This provides users with a convenient way of interaction, which can improve the user experience and practicality of the application.

[0124] The method of entering the production date, expiration date and drug grade information of the supplementary medicine into the storage system is as follows: first, after entering the production date, expiration date and drug grade information of the supplementary medicine, the electromagnetic lock of the drawer where the corresponding medicine is placed is opened, and the display screen displays the corresponding drawer position. The user opens the drawer and places the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines. Realize real-time update of data in the storage system. When replacing another medicine, enter the production date, expiration date and drug grade information of the supplementary medicine through the display screen again, and place the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines;

[0125] Each LED light and sensor is numbered, which includes the location code and the code for the presence or absence of drugs from the front to the back;

[0126] The method in which the user issues the instruction to put in the medicine includes input from a display screen or language information collected by a voice recognition device;

[0127] When the user needs to take medicine, the user issues a medicine removal instruction, and the identity recognition system identifies the user. After the identity recognition is successful, it is confirmed whether the medicine level information corresponding to the user's personnel authority level information includes the medicine level information of the medicine to be taken out. If so, the drawer where the medicine to be taken out is located is displayed on the display screen, the electromagnetic lock of the corresponding drawer is controlled to open, and the LED light next to the medicine with the longest production date is controlled to light up, prompting the personnel to quickly locate the position of the medicine; if not, the medicine cannot be taken; the way in which the user issues a medicine removal instruction includes display screen input or language information collected by the voice recognition device.

[0128] The voice control module further includes a drug name recognition model.

[0129] The mobile medicine cart comprises an operating table and a locker, wherein the operating table is installed above the locker, and the locker is equipped with at least three drawers arranged from top to bottom, and the drawers are locked on the mobile medicine cart by an electromagnetic lock;

[0130] A display screen is installed on the top of the mobile medicine vehicle;

[0131] The drawer is divided into a plurality of storage chambers by partitions, an infrared sensor for sensing medicine is installed at the bottom of each storage chamber, and an indicator light is installed next to each storage chamber;

[0132] A surveillance camera with a forward sensing direction is installed on the back side of the drawer, and is used to monitor the pictures of taking and putting medicines; when the drawer is opened, the surveillance camera monitors the pictures of taking and putting medicines from the gap between the drawer and the locker;

[0133] It also includes an identity recognition system, which is used to identify the personnel information of the personnel operating the mobile medicine vehicle, and the identity recognition system includes at least one of a camera, a voice recognition device, a sound recognition device, and a radio frequency card recognition device;

[0134] It also includes a monitoring system, which is used to monitor the operator's facial information, the medicine taking screen, and the medicine putting screen;

[0135] It also includes a storage system, the storage system is used to store drug information and personnel information, the drug information includes the name of the drug, location information, production date, expiration date, and drug grade information of the drug, and the personnel information includes identity feature information corresponding to the identity recognition system and personnel authority level information; each type of personnel authority level information includes corresponding matching drug grade information, and the personnel authority level information is associated with the drug grade information one by one;

[0136] When the user needs to put in medicine, the user issues a medicine-putting instruction, and the identity recognition system identifies the user to confirm whether the current user has the authority to put in medicine. After the medicine-putting authority is successfully confirmed, the electromagnetic lock of the drawer is opened, and the LED light next to the storage cavity that needs to replenish the medicine is on. The production date, expiration date and drug grade information of the replenished medicine are entered into the storage system;

[0137] The method of entering the production date, expiration date and drug grade information of the supplementary medicine into the storage system is as follows: first, after entering the production date, expiration date and drug grade information of the supplementary medicine, the electromagnetic lock of the drawer where the corresponding medicine is placed is opened, and the display screen displays the corresponding drawer position. The user opens the drawer and places the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines. Realize real-time update of data in the storage system. When replacing another medicine, enter the production date, expiration date and drug grade information of the supplementary medicine through the display screen again, and place the medicines one by one according to the medicine shortage positions displayed by the LED lights. The storage system records the positions and numbers of the placed medicines;

[0138] Each LED light and sensor is numbered, which includes the location code and the code for the presence or absence of drugs from the front to the back;

[0139] The method in which the user issues the instruction to put in the medicine includes input from a display screen or language information collected by a voice recognition device;

[0140] When the user needs to take medicine, the user issues a medicine taking instruction, and the identity recognition system identifies the user. After the identity recognition is successful, it is confirmed whether the medicine level information corresponding to the user's personnel authority level information includes the medicine level information of the medicine to be taken out. If so, the drawer where the medicine to be taken out is located is displayed on the display screen, the electromagnetic lock of the corresponding drawer is controlled to open, and the LED light next to the medicine with the longest production date is controlled to light up, prompting the personnel to quickly locate the position of the medicine; if not, the medicine cannot be taken out;

[0141] The method in which the user issues a drug removal instruction includes input from a display screen or language information collected by a voice recognition device;

[0142] At least one of the left and right ends of the locker is provided with at least two rows of vertically arranged support bars for hanging items, and the support bars are provided with at least three longitudinally arranged hanging holes;

[0143] The external hanging items include at least one of a storage box, a plastic bag fixing frame, a tray box and a hanging rod;

[0144] The plastic bag fixing frame comprises a mounting frame, on which a hook connected to a hanging hole is mounted;

[0145] The plastic bag fixing frame further comprises an upper fixing frame and a lower fixing frame for clamping the top flange of the plastic bag, and the upper fixing frame and the lower fixing frame are both rotatably connected to the mounting frame;

[0146] A tray box is installed below the plastic bag fixing frame, and the tray box is used to hold the bottom of the garbage bag;

[0147] A wire tube hanging device is installed at the upper end of the right side of the locker;

[0148] The wire tube article hanging device comprises a trough body opening upward, and a limiting plate extending upward is provided on the top of the trough body, and at least four limiting plates are arranged circumferentially.

[0149] Example 2

[0150] like Figure 1 and 2 As shown, this embodiment provides an intelligent medicine safety management system based on voice navigation, which specifically includes the following four main functional modules:

[0151] The in-and-out management module 1 is used to identify the identity of the operator and the collection and identification of the medical supplies when the medical supplies are put in and taken out of the warehouse, and to navigate the medical supplies to the positioning point when they are put in the warehouse so that the medical supplies are put in the correct positioning point. At the same time, the medical supplies to be taken out of the warehouse are verified when they are taken out of the warehouse to ensure the correctness of the medical supplies taken out of the warehouse.

[0152] The medical supplies inventory module 2 is used to automatically manage the expiration date, disinfection time, shortage of supplies, inventory status, use list of supplies, and use list of persons of the medical supplies;

[0153] The supplies expiration management module 3 is used to provide timely reminders and replacements when the medical supplies expire.

[0154] The comprehensive supplies management module 4 is used to manage the temperature and humidity of the storage environment of the medical supplies, the disinfection process and disinfection records of the supplies, and the power supply of the storage environment.

[0155] The following is a detailed description of the four functional modules:

[0156] (1) Inbound and outbound management module 1

[0157] (11) An information identification unit 11 is used to identify the identity of the operator and the collection and identification of the medical supplies when the medical supplies are put into or taken out of the warehouse, specifically:

[0158] At the beginning of the establishment of the intelligent management system, an operator database and a medical supplies database are established, wherein the operator database records information including basic information, identity authentication information, authority settings and operation history records, wherein the basic information includes information including the operator's name, work number, position, and department, the identity authentication information includes information including fingerprint, password, and face recognition information, the authority settings define the operation permissions and access levels of each operator in the system, the operation history records the time, location and operation performed for each operation, which is convenient for subsequent audit and traceability, and the medical supplies database records information including supply information, storage location, supply history records and safety requirements, the supply information includes information including supply name, specification, dosage, expiration date, and supplier, the storage location records the specific location where the medical supplies are stored, the supply history records include information including warehousing, outbound, and disinfection records, and the safety requirements define the storage conditions and disinfection requirements of the medical supplies.

[0159] When the operator performs the entry and exit operation of the medical supplies, the operator's identity is first identified. The operator approaches the entry and exit equipment and selects any method including work number, fingerprint, password and face for verification. After the verification is passed, the system records the operator's identity information and verifies the operator's operation authority and access level. After the operator's identity identification, operation authority and access level verification are passed, the operator obtains the information of the medical supplies by scanning the medical supplies to be entered or selecting the medical supplies to be taken out from the system interface, so as to perform entry or exit operations on the medical supplies.

[0160] In addition, the system is designed with a management interface that displays the progress and results of operations in real time, including identity authentication, permission verification, medical supplies information collection, inbound navigation, outbound confirmation, etc. When the system detects an abnormal situation, a warning message will pop up on the interface in a timely manner to remind the operator to check and handle the situation.

[0161] (12) A navigation warehousing unit 12 is used to navigate the medical supplies to the positioning point when entering the warehouse, so that the medical supplies are entered into the correct positioning point. Specifically, the medical supplies are correctly classified using technologies including RFID tag technology, image recognition technology, shape recognition technology, and dosage recognition technology, and the warehousing operation of the medical supplies to be entered is navigated in combination with the location information of the medical supplies, so as to ensure that the medical supplies are entered into the correct positioning point.

[0162] Based on the work of the above navigation storage unit 12, a specific example is given:

[0163] Assume that a batch of newly arrived drugs needs to be put into storage, including injection drugs of different types and dosages. The following are the detailed steps of the actual operation:

[0164] 1. Preparation

[0165] The drug packages are affixed with RFID tags containing detailed information about the drugs, such as drug name, batch number, expiration date, dosage, etc. High-definition cameras, RFID readers and writers, and display screens are installed in the warehousing area.

[0166] 2. Drug identification and classification

[0167] RFID tag scanning: The operator brings the drug close to the RFID reader, and the system reads the RFID tag information of the drug. The information read includes the drug name: Ceftazidime for injection, batch number: 20230625, dosage: 1g / bottle. Image recognition: The camera captures the appearance of the drug, and the image recognition system processes the image and confirms that the appearance of the drug is consistent with the standard image in the database. The image confirms that the shape and label of the drug match the Ceftazidime for injection 1g / bottle in the database. Shape recognition: Further confirm the shape characteristics of the drug to ensure that it matches the expected specifications. The system recognizes that the bottle and label position of the drug are correct. Dose recognition: Combine RFID and image recognition information to confirm the dosage information of the drug. The system confirms that the drug dosage is 1g / bottle, which is consistent with the RFID tag information.

[0168] 3. Combination of location information

[0169] The system queries the inventory database and assigns an optimal storage location based on the drug type, batch, dosage, etc. Assigned location: Refrigerated area B-3 shelf 2nd floor.

[0170] 4. Navigation operation

[0171] The system displays the navigation path on the display screen and prompts the operator to place the medicine in the designated storage location through voice. Display screen and voice prompt: Please place ceftazidime for injection (1g / bottle) on the second floor of shelf B-3 in the cold storage area. The operator places the medicine in the designated location according to the navigation instructions. The operator places the medicine on the second floor of shelf B-3 in the cold storage area according to the prompt.

[0172] 5. Warehouse confirmation

[0173] After the drug arrives at the designated storage location, the system confirms the drug information and location again through the RFID reader. Read confirmation: Ceftazidime for injection (1g / bottle), batch number 20230625, 2nd floor of shelf B-3 in the cold storage area. The system records the drug's warehousing information, including warehousing time, storage location, operator, etc. Recorded information: June 27, 2024, operator Li, warehousing location: 2nd floor of shelf B-3 in the cold storage area.

[0174] (13) A verification unit 13 for verifying the medical supplies to be shipped out when they are shipped out, so as to ensure the correctness of the medical supplies shipped out. Specifically, the medical supplies are correctly classified using technologies including the RFID tag technology, the image recognition technology, the shape recognition technology, and the dosage recognition technology. In addition, the basic information and location information of the medical supplies to be shipped out are verified in combination with the location information of the medical supplies shipped out, so as to ensure that the medical supplies are shipped out from the correct location point.

[0175] Based on the above verification of the work of the outbound unit 13, a specific example is given:

[0176] Assume that a batch of drugs needs to be shipped out of the drug warehouse. These drugs include injection drugs of different types and dosages. The following are the detailed steps of the actual operation:

[0177] 1. Preparation

[0178] Each drug package is affixed with an RFID tag containing detailed information about the drug, such as drug name, batch number, expiration date, dosage, etc. High-definition cameras, RFID readers and writers, and display screens are installed in the warehouse area.

[0179] 2. Drug identification and verification

[0180] Operator identity verification: The operator approaches the outbound device and authenticates himself / herself using his / her work number, fingerprint, password or face recognition. After passing the authentication, the system records the operator's identity information and verifies his / her operation authority and access level.

[0181] 3. Obtaining drug information

[0182] Scan and select: The operator selects the drug to be shipped out through the system interface: Ceftazidime for injection (1g / bottle), batch number: 20230625. The system obtains the basic information of the drug and displays the specific location of the drug storage: Refrigerated area B-3 shelf 2nd floor.

[0183] 4. Drug location verification

[0184] RFID tag scanning: The operator follows the system instructions to the second floor of shelf B-3 in the cold storage area and uses the RFID reader to scan the RFID tag of the drug. The system reads the RFID tag information, including the drug name, batch number, dosage, etc., and compares it with the system records. The information read by RFID: Ceftazidime for injection, batch number: 20230625, dosage: 1g / bottle.

[0185] Image recognition: The camera captures the appearance of the drug, and the image recognition system processes the image and confirms that the appearance of the drug is consistent with the standard image in the database. The image confirms that the shape and label of the drug match the ceftazidime for injection (1g / bottle) in the database.

[0186] Shape recognition: The system uses shape recognition technology to compare and verify the shape of the drug to ensure the accuracy of recognition. Shape recognition confirms that the bottle and label of the drug are in the correct position.

[0187] Dose recognition: The system combines RFID and image recognition information to confirm the dosage information of the drug. The system confirms that the drug dosage is 1g / bottle, which is consistent with the RFID tag information.

[0188] 5. Confirmation of delivery

[0189] Information verification: The system verifies the information and location of the drugs to be shipped to ensure that they are consistent with the database records. Comparison results: The drug name, batch number, dosage, and storage location all match.

[0190] Outbound operation: The operator confirms the outbound operation, and the system records the outbound information of the drug, including the outbound time, target use location, operator, etc. Record information: June 27, 2024, operator Li, target use location: emergency department.

[0191] Outbound delivery completed: The drugs are taken out from the 2nd layer of shelf B-3 in the cold storage area, and the system updates the inventory database, reducing the corresponding number of drugs.

[0192] Among them, in the navigation entry unit 12 and the verification exit unit 13, the RFID tag technology is to install RFID readers in the entry channel, exit channel and storage area to read the label information of the medical supplies in real time; the image recognition technology is to capture the image of the medical supplies and identify the label, appearance or shape characteristics of the medical supplies through an image recognition algorithm, so as to confirm the identity and attributes of the medical supplies; the shape recognition technology is to combine sensor technology to detect the shape characteristics of the medical supplies including size and volume, and compare the shape information with the attributes of the medical supplies stored in the database to ensure the correct classification and storage location of the medical supplies; the dosage recognition technology is to identify and record the medical supplies that require precise dosage in combination with the dosage sensor, and ensure the correct use and management of the medical supplies based on the information provided by the dosage sensor.

[0193] (14) The automatic sensing unit 14 for adding or removing medical supplies is used to automatically sense the addition or removal of the medical supplies when the medical supplies are put into or taken out of the warehouse, specifically:

[0194] Installing any one of the devices including RFID readers, photoelectric sensors, and image recognition devices on the entry or exit channels of the medical supplies to automatically identify the medical supplies, and automatically updating the inventory of the medical supplies according to the results of the automatic identification;

[0195] The RFID reader is a tag with a unique identifier attached to the medical supplies. When the medical supplies pass through the RFID reader, the tag information is automatically read to trigger the corresponding outbound or inbound operation. The photoelectric sensor is installed on the outbound and inbound channels to detect the inbound and outbound medical supplies through photoelectric detection technology. The image recognition device is installed on the inbound and outbound channels to capture the image of the medical supplies, and use the image recognition algorithm to identify the label, appearance or shape of the medical supplies, confirm the identity and attributes of the medical supplies, and thus trigger the automated inbound or outbound process.

[0196] In addition, when the medical supplies are put into or taken out of the warehouse, they are put into or taken out of the warehouse according to the first-in-first-out principle according to the validity period. The first-in-first-out principle can be implemented in the following ways:

[0197] 1. Validity period management:

[0198] Database records: Establish inventory management of medical supplies, including the batch, production date, expiration date and other information of each drug.

[0199] Expiration reminder function: The system regularly checks the medical supplies in stock and notifies management personnel in advance of medicines that are about to expire or have expired.

[0200] Automatic sorting: The system automatically sorts medical supplies according to expiration date information to ensure the implementation of the first-in-first-out principle.

[0201] 2. Warehousing operation:

[0202] Scanning expiration date information: When medical supplies are put into storage, operators scan the RFID tag or barcode of each drug to read the drug's production date and expiration date.

[0203] Location allocation: The system automatically allocates the best storage location based on the drug's expiration information and inventory status, ensuring that recently effective drugs are placed in the most accessible location.

[0204] 3. Outbound operation:

[0205] Priority selection: When performing outbound operations, the system gives priority to those advanced drugs with shorter expiration dates to ensure that aged drugs are not stored for long periods of time.

[0206] Automatic reminder: Before the outbound operation, the system automatically reminds the operator to select drugs with the earliest expiration date for outbound delivery to avoid the use of expired drugs.

[0207] 4. Regular inspection and reporting:

[0208] Inventory count: Conduct inventory counts regularly, check the expiration dates of medicines, and generate summary reports.

[0209] Expired processing: For drugs that are about to expire or have expired, the system generates an alarm and guides managers to take appropriate processing measures, such as destruction or return to the factory.

[0210] 5. Human intervention:

[0211] Management decision support: The system provides data analysis and decision support functions for expiration date management, helping managers to develop more effective inventory management strategies and procurement plans.

[0212] (2) The medical supplies inventory module 2

[0213] (21) A drug expiration date management unit 21, which is used to record the production date and expiration date when the medical supplies are put into storage, to check the expiration date of the medical supplies during the automatic inventory count after the medical supplies are put into storage, and to automatically check the expiration date of the medical supplies when the medical supplies are taken out of storage.

[0214] For example, suppose a hospital adopts the drug expiration management unit 21:

[0215] 1. Warehousing stage:

[0216] Nurses or administrators use the system to enter newly arrived medicines or medical supplies into the warehouse. Each item has a unique identifier, which may be a barcode or RFID tag. The system requires the production date and expiration date of each item to be entered or scanned. For example, when an antibiotic arrives, the system will record its production date as January 2024 and its expiration date as 2 years.

[0217] 2. Automatic inventory counting stage:

[0218] The system performs inventory counts regularly or according to set conditions. During the inventory count, the system automatically reads the production date and expiration date information of each item. The system compares it with the set standards. If it finds that some items are close to expiration or have expired, the system will generate an alarm or notify the inventory manager to handle it.

[0219] 3. Outbound stage:

[0220] When a doctor or nurse needs to take out a drug, the system will automatically check the expiration date of the drug. If the expiration date of the drug meets the standard (i.e. it has not expired or has not reached the warning period), the system allows the outbound operation to continue. If the drug is about to expire or has expired, the system will issue a warning to remind the operator to confirm or select other drugs.

[0221] For example, if a drug has only one month left before its expiration date, the system will alert the operator and may suggest using these drugs first to comply with the first-in-first-out principle and ensure the effectiveness and safety of the drugs. Such a system can help hospitals effectively manage the expiration dates of drugs, reduce the risk of expired drugs, and ensure that the drugs provided to patients are of high quality and safety.

[0222] (22) A disinfection time management unit 22, which is used to formulate a plan for regular disinfection or emergency disinfection of the medical supplies or the storage environment of the medical supplies, and to standardize the disinfection operation including the selection, concentration, disinfection method and contact time of the disinfectant, and to record the disinfection records including the disinfection time, disinfectant type, disinfection method and operator.

[0223] For example, a hospital uses the disinfection time management unit 22 to manage the disinfection process of its medical supplies and storage environment.

[0224] 1. Develop a disinfection plan: The hospital develops a regular disinfection plan based on the frequency of use of medical supplies and environmental requirements. For example, surgical instruments in the operating room are disinfected regularly every day, and door handles and other frequently touched surfaces are disinfected regularly every week.

[0225] 2. Standardized disinfection operation: The hospital has formulated standardized disinfection operation procedures, including the selection of disinfectants, concentration, disinfection methods (such as spraying, wiping), contact time and other operation standards. For example, 70% ethanol is selected as the disinfectant, and the wiping method is used for disinfection each time, with a contact time of 1 minute.

[0226] 3. Record the disinfection process: Each time disinfection is performed, the operator will record the disinfection time, type of disinfectant, disinfection method, and the personnel information performing the disinfection operation. These records are archived for traceability and audit purposes.

[0227] 4. Handling of exceptions: If an emergency situation occurs and emergency disinfection is required, the system can also formulate emergency disinfection plans and operating procedures based on specific disinfection needs.

[0228] Through the disinfection time management unit 22, hospitals can ensure that medical supplies and storage environments are regularly and effectively disinfected, reduce the risk of infection transmission, and improve the safety and hygiene standards of the hospital environment.

[0229] (23) A supplies out-of-stock situation management unit 23 is used to set the minimum inventory quantity of each medical supply according to the frequency of use and importance of the medical supplies. When the inventory is lower than the minimum inventory quantity, the system automatically issues an early warning to remind relevant personnel to replenish the stock in time.

[0230] For example, suppose a hospital uses such an inventory management system to manage the inventory of different medical supplies. Here is an example to illustrate its application:

[0231] 1. Set minimum inventory: The hospital sets the minimum inventory of various medical supplies based on the frequency and importance of each medical supply. For example, the minimum inventory of frequently used disinfectants is set at 50 bottles, while the minimum inventory of less frequently used specific surgical instruments is set at 10 sets.

[0232] 2. Automatic early warning system: The system regularly monitors the inventory of each medical supply. If the actual inventory of disinfectant drops to 30 bottles, which is lower than the set minimum inventory (50 bottles), the system will automatically issue an early warning.

[0233] 3. Remind relevant personnel to restock: After the system issues an early warning, the relevant personnel responsible for inventory management receive a notification, reminding them that the inventory of disinfectant is lower than the minimum requirement. These personnel can take immediate measures, such as restocking through suppliers or rearranging the distribution of disinfectant.

[0234] Through this system, hospitals can ensure that important medical supplies will not affect daily medical services and safety due to insufficient inventory, while optimizing inventory management and avoiding excessive inventory backlogs.

[0235] (24) A supplies inventory management unit 24 is used to automatically update the inventory information, location information and calibration information of the medical supplies based on the real-time records of the entry, exit and transfer operations of the medical supplies, formulate an inventory plan, conduct inventory counts regularly, and generate inventory analysis reports regularly to provide a basis for management decisions.

[0236] For example, suppose a hospital uses such a medical supplies management system to implement inventory management and analysis. The following is an example to illustrate its application:

[0237] 1. Real-time recording of inbound and outbound operations: When medical supplies enter, leave or are transferred, the system will record these operations in real time. For example, a new batch of surgical instruments enters the warehouse, a nurse takes some infusion equipment from the inventory for use in the ward, or some medicines are transferred from one ward to another.

[0238] 2. Automatic update of inventory information: Every time an entry, exit or transfer operation occurs, the system will automatically update the inventory information of medical supplies, including quantity, location information (such as the specific storage location or ward), and calibration information (such as expiration date).

[0239] 3. Make inventory plans and regular inventory: The system makes inventory plans according to the set rules and cycles. For example, a comprehensive inventory of all medicines and medical devices is conducted at the end of each month to ensure the consistency between the actual inventory and the system records.

[0240] 4. Generate inventory analysis reports: The system regularly generates inventory analysis reports, providing data on inventory status, consumption trends, and period analysis of various medical supplies. For example, the report can show whether a certain drug is being consumed faster than expected, and how the frequency of use of certain equipment affects inventory.

[0241] Through this system, hospital management can make more effective management decisions based on inventory analysis reports, such as optimizing procurement plans and adjusting inventory strategies to ensure the timely supply and effective management of medical supplies.

[0242] (25) A supplies usage list management unit 25 is used to automatically generate a usage list after the medical supplies are used, and to centrally store the usage list, while monitoring the usage of the medical supplies in real time. When abnormal usage is found, an early warning is automatically issued, wherein the usage list includes information such as the name and specification of the medical supplies, the quantity used, the time of use, the user, the department in which the medical supplies are used, and the purpose.

[0243] For example, suppose a hospital uses a system like this to manage the use of medical supplies:

[0244] 1. Automatically generate usage lists: Whenever medical supplies are used, the system will automatically generate a usage list. For example, if a nurse uses a batch of dressings of a specific specification during surgery, the system will record the name and specification of the dressing, the quantity used, the time of use, the user, the department in which it was used, and the purpose (such as wound treatment of surgical patients).

[0245] 2. Centralized storage of usage lists: The system will centrally store the generated usage lists in a database or a specific storage location to ensure the integrity and security of usage records.

[0246] 3. Real-time monitoring of usage: The system monitors the usage of medical supplies in real time. For example, the system can track the consumption rate and frequency of use of each supply and compare it with the expected usage pattern.

[0247] 4. Warning of abnormal usage: If the system detects abnormal usage, such as the usage of a certain medical product far exceeding the average consumption, the system will automatically issue a warning. For example, if a ward uses a large amount of medicine or consumables in a short period of time, it may indicate a sudden need for treatment or potential waste.

[0248] Through this example, this system can help hospitals effectively manage the use of medical supplies, ensure the rational use and consumption control of supplies, and at the same time improve sensitivity and responsiveness to potential abnormal situations.

[0249] (26) An identity user usage list management unit 26 is used to automatically record the usage information of the medical supplies after the operator uses the medical supplies, including the operator's identity, usage time, and items used.

[0250] For example, suppose a hospital adopts the Identity User List Management Unit 26:

[0251] 1. Operators use medical supplies: When operators (such as doctors, nurses or technicians) use medical supplies, the system will automatically record the following information:

[0252] Operator Identity: Record the operator’s work number, name, or other identification.

[0253] Time of use: record the specific time when the medical supplies are used.

[0254] Items used: record the specific information of medical supplies used, including name, specifications, etc.

[0255] 2. Automatically record usage information: The system automatically captures and records the above information during use to ensure the accuracy and timeliness of the records.

[0256] 3. Storage and management of usage information: All usage information is centrally stored in the system database or a specific storage location. This information can be accessed and managed with appropriate permissions to ensure the confidentiality and integrity of usage records.

[0257] (3) The supplies expiration management module is used to provide timely reminders and replacements when the medical supplies expire, specifically:

[0258] The system records the calibration information of all the medical supplies in real time;

[0259] Setting a reminder period for expiration reminders, automatically issuing expiration notifications for the medical supplies that are about to expire according to the reminder period, and notifying relevant personnel by means of email, SMS or system pop-up windows;

[0260] The system automatically generates a list of expired medical supplies, records all the information of the medical supplies that are about to expire and have expired. For the expired medical supplies, the system prompts the relevant personnel to replace them, and records the information after replacement, including the validity period and batch of the new medical supplies;

[0261] The system regularly generates expiration management reports, including information such as quantity, type, and batch of medical supplies that are about to expire or have expired, to help management understand the expiration status of items. By analyzing the use and replacement of medical supplies, it can optimize inventory management and procurement strategies and reduce the waste of expired items.

[0262] (4) The medical supplies comprehensive management module is used to manage the temperature and humidity of the storage environment of the medical supplies, the disinfection process and disinfection records of the medical supplies, and the power supply of the storage environment, specifically:

[0263] Manage the temperature and humidity of the storage environment of the medical supplies, install temperature and humidity sensors in the storage environment, record the temperature and humidity of the monitoring environment in real time, use a data acquisition system to record temperature and humidity data, and automatically adjust environmental parameters according to the set temperature and humidity range through equipment including air conditioners, humidifiers and dehumidifiers. When the temperature and humidity exceed the set range, the system automatically issues an alarm to notify relevant personnel to make adjustments;

[0264] Use professional disinfection equipment to ensure that the disinfection process of the medical supplies meets the standards, and record detailed information of each disinfection, including disinfection time, disinfection personnel, disinfection methods, etc. The system automatically records the disinfection process and generates disinfection records to ensure that the disinfection process is traceable;

[0265] Install power monitoring equipment in the storage environment of the medical supplies to monitor the power supply in real time, install backup power supplies such as UPS or generators to ensure the normal operation of the equipment during power outages, and configure an automatic switching system to automatically switch to the backup power supply when there is a problem with the main power supply, and issue an alarm to notify relevant personnel;

[0266] Temperature and humidity management, disinfection management, and power management are integrated into the system, providing a unified monitoring and management interface. The system synchronizes data from each management module in real time, analyzes it, generates comprehensive management reports, provides a user operation interface, and sets different authority levels to ensure that managers at all levels can access and operate the corresponding functions.

[0267] Example 3

[0268] like Figure 3 As shown, the devices involved in the warehouse entry and exit management, the medical supplies inventory module, the supplies expiration management module and the supplies comprehensive management module in this embodiment all interact with the centralized control center through wireless transmission, and transmit the data to the mobile phone for real-time monitoring.

[0269] For example, a hospital deploys an integrated medical supplies management system, in which all devices are connected to a centralized control center via a wireless network. The centralized control center aggregates and processes all data and transmits real-time information to managers' mobile phones, enabling them to monitor and manage the hospital's medical supplies at any time.

[0270] Application examples of each module:

[0271] (1) Inbound and outbound management module:

[0272] Wireless data transmission: When medical supplies are entering or leaving the warehouse, equipment (such as barcode scanners, RFID readers, etc.) send data such as operator identity, supply information and time to the centralized control center in real time through the wireless network.

[0273] Real-time update and navigation: The centralized control center generates warehousing navigation information based on the warehousing operation to guide operators to place items in the correct storage location. This information will also be updated on the mobile phone in real time for management personnel to view.

[0274] Outbound verification: When outbound, the system verifies the item information through the wireless network to ensure that the item matches the order, and displays the verification results on the mobile phone.

[0275] (2) Medical supplies inventory module:

[0276] Automatic inventory and wireless update: Regularly and automatically count the quantity, storage location, expiration date and other data of medical supplies. The inventory results are transmitted to the centralized control center via the wireless network and the system database is updated.

[0277] Real-time inventory report: The centralized control center will generate a detailed inventory report and send it to the manager's mobile phone via wireless transmission for easy viewing at any time.

[0278] (3) Supplies expiration management module:

[0279] Expiration date monitoring and reminders: The system continuously monitors the expiration date of medical supplies in stock. Once they are close to expiration, the device will automatically send a reminder message to the centralized control center.

[0280] Wireless notification to managers: After receiving the reminder, the centralized control center sends the expiration reminder and recommended actions to the manager’s mobile phone via the wireless network to ensure timely processing.

[0281] (4)Supplies comprehensive management module:

[0282] Storage environment monitoring: The system monitors the temperature and humidity, disinfection process, disinfection records and other data of the medical supplies storage environment in real time to ensure that the storage conditions meet the standards.

[0283] Wireless data transmission: All monitoring data is transmitted to the centralized control center via wireless network, and when abnormal situations occur, alarms are immediately sent to the mobile phones of managers.

[0284] Real-time monitoring on mobile phone:

[0285] Managers can access the latest data from all modules in real time through the mobile app. For example, they can view the current inventory status, monitor the consumption rate of medical supplies, receive reminders of expiring medicines, or view the temperature and humidity conditions of the storage environment. Once an abnormal situation occurs (such as the temperature exceeds the safe range or the supplies are about to expire), the system will immediately issue an alarm through the mobile phone to ensure that managers can respond quickly and take necessary measures.

[0286] Example summary:

[0287] Through wireless transmission technology, data from all management modules are centrally processed in the control center and transmitted to the mobile phone for real-time monitoring. This design improves the efficiency and accuracy of hospital medical supplies management, ensures the rational use and safe storage of medical supplies, and helps optimize the overall operation and decision-making process of the hospital.

[0288] Example 4

[0289] like Figure 4 and 5 As shown, this embodiment provides an application method of a traceable full-process medical supplies intelligent management system, and applies the traceable full-process medical supplies intelligent management system as described in any one of the first embodiments to a drug distribution center, specifically:

[0290] S1: The receiving area of ​​the distribution center receives the medical orders from doctors in various departments, reviews the medical orders, forms a drug delivery order, and sends the drug delivery order to the drug selection area of ​​the distribution center;

[0291] S2: The medicine selection area of ​​the distribution center receives the medicine dispensing order request, checks the medicine liquid and medicine order, and specially marks it, and places an order to the intelligent medicine dispensing equipment. The intelligent medicine dispensing equipment uses the storage management module to complete the delivery of the selected medicine;

[0292] S3: Before entering the warehouse for dispensing, multiple drugs that have been sorted and flushed are reviewed. If the review fails, an alarm is issued;

[0293] S4: Warehouse dispensing: bring the liquid medicine, medicine and special mark to the warehouse dispensing area for dispensing according to the dispensing information;

[0294] S5: After the dispensing is completed, an automated review is conducted to review the release of multiple drugs for hedging drugs. If the review fails, an alarm is triggered;

[0295] S6: Carry out automated distribution to deliver the prepared medicines to the departments in need.

[0296] Furthermore, in step S2, before the medicines are put into the warehouse for dispensing, the various medicines of the hedging medicine are reviewed. If the review fails, an alarm is issued, specifically:

[0297] Establish a database containing detailed information on drugs, attach barcodes and labels to each drug, scan drug information, and compare and review the information of multiple drugs in the hedging drug with the drugs required for the order document;

[0298] When the review fails, the system automatically sends out an alarm to notify relevant personnel. The alarm methods include sound alarm, SMS notification, and system pop-up window. The results of each review are recorded, including detailed information on pass and fail, to facilitate subsequent tracing and inspection.

[0299] Further, in step S4, after the preparation is completed, the multiple drugs of the hedging drug are reviewed for delivery. If the review fails, an alarm is issued, specifically:

[0300] After the medicine is prepared, the complete label and document information of the medicine are retained and kept in the same container as the medicine. The medicine information is scanned again and compared with the information of the medicine required by the order document for verification;

[0301] When the review fails, the system automatically sends out an alarm to notify relevant personnel. The alarm methods include sound alarm, SMS notification, and system pop-up window. The results of each review are recorded, including detailed information on pass and fail, to facilitate subsequent tracing and inspection.

[0302] In addition, the drug distribution center will also use the medical supplies inventory module 2, supplies expiration management module 3 and supplies comprehensive management module 4 of our system. The specific process refers to Example 1 and Example 2, and will not be repeated in this embodiment.

[0303] A computer-readable storage medium stores a computer code. When the computer code is executed, the above method is executed. A person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium. The storage medium can include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0304] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

[0305] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0306] It should be noted that the above embodiments can be freely combined as needed. The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered as the protection scope of the present invention.

Claims

1. An intelligent medicine safety management system based on voice navigation, characterized in that: A medicine cart comprising: Operation table; A storage unit is provided in the vehicle body, and is used to store a plurality of medical items, and the medical items are provided with attribute information including an expiration date; Trigger module: used to open the storage unit and trigger the location of the adapted medical item to be reminded or to trigger the medical item to be taken out of the medicine outlet; An identity recognition module is used to identify the personnel information of the personnel operating the mobile medicine vehicle; The voice control module is configured to first receive the voice information of the personnel, then identify the key information including the medical items from the voice information and then play the corresponding medicine name by voice, when receiving the confirmation information of the personnel, then find the location of the corresponding medical items from the storage unit, and then transmit the location information to the trigger module, and then prompt the location information of the medicine or obtain the corresponding medical items from the corresponding location.

2. The intelligent medicine safety management system based on voice navigation as claimed in claim 1, characterized in that: Also includes: The medicine insertion module is used when the user needs to insert medicine. When receiving the medicine insertion instruction from the user, the user is first identified by the receiving identity recognition module to confirm that the current user has the permission to insert medicine, the storage unit is opened, the replenished medical items are received, and the attribute information of the replenished medical items including the medical item ID, production date, expiration date and drug grade of the medicine are recorded in the storage space within the system, and the corresponding relationship between the medical item ID and the position of the storage space is recorded.

3. The intelligent medicine safety management system based on voice navigation as claimed in claim 1, characterized in that: The voice control module further comprises: Voice identity recognition module: used to receive voice information, identify the identity information of the person making the voice, and then transmit the information to the trigger module; The voice medicine name recognition module is used to receive voice information to recognize text, and parse the corresponding medicine name from it, and then send it to the trigger module so that the trigger module can open the storage unit and trigger the location of the adapted medicine or trigger the medicine to be taken out of the medicine outlet.

4. The intelligent medical safety management system based on voice navigation as claimed in claim 3, characterized in that: The voice identification module further comprises: The voices of doctors or nurses are collected in advance, and the basic attributes of human voices, including pitch and rhythm, are captured using Mel-frequency cepstral coefficients. Pre-emphasis: Pre-emphasis processing compensates for the energy loss of the high-frequency part of the speech signal by boosting the high-frequency part. The pre-emphasis coefficient is usually between 0.9 and 1.

0. Framing and windowing: Segment the speech signal into frames and apply a window function to each frame to reduce the boundary effect between frames to maintain the continuity of the signal. Fast Fourier Transform (FFT): Perform FFT on each frame of the windowed signal to convert the signal from the time domain to the frequency domain to obtain its power spectrum; Mel filter bank: The Mel filter bank is a set of triangular filters whose center frequencies are evenly distributed on the Mel frequency scale. The power spectrum obtained by FFT is passed through the Mel filter bank to obtain a series of filter output energies. Logarithmic operation: In order to compress the dynamic range and enhance robustness, the output energy of the Mel filter bank is logarithmically operated. Discrete cosine transform: DCT is performed on the logarithmic energy spectrum to obtain MFCC parameters. DCT can convert the energy spectrum into cepstrum coefficients. Low-order MFCC coefficients usually represent the low-frequency information, pitch and fundamental frequency of the speech, while high-order MFCC coefficients represent the high-frequency information of the speech. Cepstral lifting: In order to enhance the distinguishability of MFCC features, the MFCC coefficients are usually cepstral lifted, multiplied by a lifting window (such as 1+(cep_lifter / 2)*sin(pi*n / cep_l ifter)) to enhance the high-frequency part; By capturing the pitch and rhythm features of the doctor's voice and comparing them with the pre-stored source data, we can determine which doctor or nurse it is and realize personal identity recognition.

5. The intelligent medicine safety management system based on voice navigation as claimed in claim 3, characterized in that: Each doctor or nurse plays the urgent drug names in advance and stores the corresponding sound core segments, stores the drug name sound segments and saves the corresponding drug names. In an emergency, the voice of a doctor or nurse is captured. Technically, two schemes are operated simultaneously. The first scheme is to compare the voice with the pre-stored core voice fragments of the corresponding doctor or nurse. The autoencoder structure can be used to extract the features of the voice and compare them with the pre-stored core voice fragments of the drug names. The closest one is found to be the drug name corresponding to the voice. The time domain audio signal is converted into a frequency domain representation, and the spectrum is obtained through the short-time Fourier transform (STFT). The sound collected in an emergency is first obtained by short-time Fourier transform (STFT) to obtain a spectrum. After the doctor or nurse corresponding to the collected sound is identified, the spectrum values ​​of the core sound fragments of the emergency medicines pre-stored by the doctor or nurse are found and compared respectively to find the closest value. Generally speaking, the emergency medicine corresponding to the closest value is the value shouted by the doctor or nurse in this emergency situation; The second solution is to perform voice-to-text recognition on the sound. The voice-to-text medical product name recognition module recognizes the text corresponding to the voice, and then uses voice to broadcast the text for the corresponding doctor or nurse to confirm; The first solution and the second solution can be executed synchronously. If there is a deviation in the first solution, the second solution will immediately start the corresponding voice medical product name recognition module for voice recognition.

6. An application method of an intelligent medicine safety management system based on voice navigation, characterized in that: The intelligent medicine safety management system based on voice navigation as claimed in any one of claims 1 to 5 is applied to a medicine distribution center, specifically: S1: The receiving area of ​​the distribution center receives the medical orders from doctors in various departments, reviews the medical orders, forms a drug delivery order, and sends the drug delivery order to the drug selection area of ​​the distribution center; S2: The medicine selection area of ​​the distribution center receives the medicine dispensing order request, checks the medicine liquid and medicine order, and specially marks it, and places an order to the intelligent medicine dispensing equipment. The intelligent medicine dispensing equipment uses the storage management module to complete the delivery of the selected medicine; S3: Before entering the warehouse for dispensing, multiple drugs that have been sorted and flushed are reviewed. If the review fails, an alarm is issued; S4: Warehouse dispensing: bring the liquid medicine, medicine and special mark to the warehouse dispensing area for dispensing according to the dispensing information; S5: After the dispensing is completed, an automated audit is conducted to review the release of multiple drugs for hedging drugs. If the review fails, an alarm will be issued; S6: Carry out automated distribution to deliver the prepared medicines to the departments in need.

7. The application method of the intelligent medicine safety management system based on voice navigation according to claim 6 is characterized in that: Also includes: In step S2, before the medicine is put into the warehouse for dispensing, the various medicines of the hedging medicine are reviewed. If the review fails, an alarm is issued. Specifically: Establish a database containing detailed information on drugs, attach barcodes and labels to each drug, scan drug information, and compare and review the information of multiple drugs in the hedging drug with the drugs required for the order document; When the review fails, the system automatically sends out an alarm to notify relevant personnel. The alarm methods include sound alarm, SMS notification, and system pop-up window. The results of each review are recorded, including detailed information on pass and fail, to facilitate subsequent tracing and inspection; In step S4, after the preparation is completed, the multiple drugs of the hedging drug are reviewed for delivery. If the review fails, an alarm is issued, specifically: After the medicine is prepared, the complete label and document information of the medicine are retained and kept in the same container as the medicine. The medicine information is scanned again and compared with the information of the medicine required by the order document for verification; When the review fails, the system automatically sends out an alarm to notify relevant personnel. The alarm methods include sound alarm, SMS notification, and system pop-up window. The results of each review are recorded, including detailed information on pass and fail, to facilitate subsequent tracing and inspection.

Images