A method and system for monitoring intravenous infusion based on visual measurement
Through visual measurement technology, video images are collected and processed, and the liquid level position and drip speed are identified, which solves the problems of frequent installation and disassembly of intravenous infusion monitoring equipment and the prediction deviation is achieved, and high accuracy and portability infusion monitoring is achieved, suitable for multiple groups of simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous simultaneous sim Monitor and emergencies.
Patent Information
- Application Number
- CN202210125726.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-10
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2042-02-10
AI Technical Summary
The existing intravenous infusion monitoring equipment needs to be installed and disassembled repeatedly and there is a deviation in the estimate of infusion termination time, which cannot meet the real-time monitoring needs in the wild or public emergencies.
Using intravenous infusion monitoring method based on visual measurement, video images are collected through the camera module, and the patient's bed number and infusion bottle are identified by digital recognition algorithm. The liquid level position and drip speed are calculated by combining the image processing algorithm, and drip is performed by standard deviation-spectral method. Speed calculation to realize non-contact, long-distance infusion process monitoring.
It reduces the cost and working intensity of equipment installation and disassembly, improves the prediction accuracy of infusion termination time, and realizes simultaneous monitoring of multiple infusion processes, which is suitable for use in the field or in emergencies.
Smart Images

Figure CN114596521B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of medical devices, and in particular to a method and system for monitoring intravenous infusion based on visual measurement. Background Art
[0002] Intravenous infusion refers to the slow injection of drugs directly into the patient's veins over a period of time to achieve the treatment of various diseases. In order to ensure the safety and effectiveness of the infusion process, medical staff need to determine the infusion drip rate based on the patient's condition, age and the properties of the drugs used, and monitor the position of the liquid level in a timely manner, and replace or stop the infusion of the drug solution.
[0003] The continuous development of wireless network technology and computer technology has promoted the proposal of wireless monitoring methods for the infusion process. At present, the infusion monitoring devices reported at home and abroad are mainly divided into three categories: one is a single infusion monitoring alarm device, which is a single monitoring alarm device, and it is impossible for nursing staff to monitor and manage multiple infusion patients at the same time; the second is an infusion monitoring network platform, which is mostly installed on the computer of the nurse station, and the nurse cannot carry it with them, and it cannot meet the needs of infusion management in the field, public emergencies, emergency rescue, etc.; the third is an infusion monitoring system with a remotely portable handheld terminal. This type of infusion monitoring device is convenient for medical staff to monitor the patient's infusion status during the mobile process, ensuring the safety and effectiveness of the patient's infusion process.
[0004] Most of the above three types of intravenous infusion monitoring devices are based on the infrared sensing principle to calculate the dripping rate and estimate the infusion time according to the dripping rate. The increase or decrease of the liquid medicine during the preparation of the medicine may cause the deviation of the estimation of the end time of the infusion. In addition, the existing monitoring systems basically include a box body that can be embedded with infrared sensing elements, various Murphy tubes and other structures. Each infusion monitoring requires a process of installing and disassembling the box body. Summary of the invention
[0005] In order to solve the problem that the existing infusion monitoring equipment needs to be repeatedly installed and disassembled and there is a deviation in the estimation of the time of infusion termination, the present invention provides an intravenous infusion monitoring method and system based on visual measurement, and the specific scheme is as follows:
[0006] A method for monitoring intravenous infusion based on visual measurement comprises the following steps:
[0007] S1: Collect video images;
[0008] S2: Perform recognition and matching processing on the video image collected in step S1 and calculate the liquid level position and dripping speed of the infusion bottle;
[0009] S3: Alarm the abnormal situation of the liquid level position and dripping speed in step S2.
[0010] Preferably, the video images collected in step S1 include video images of the patient's bed number, infusion bottle and drip chamber.
[0011] Preferably, in step S2, the patient's bed number is identified by using a digital recognition algorithm, and matched with the patient's identity information and medication status entered into the hospital information management system, wherein the specific steps of identifying the patient's bed number by using a digital recognition algorithm are:
[0012] a1, grayscale and binarize the first frame of the video image containing the patient's bed number;
[0013] a2, denoising and character segmentation;
[0014] a3, extract the features of each character and generate a feature matrix;
[0015] a4, matching the feature matrix with the digital images in the sample library to identify the bed number.
[0016] Preferably, in step S2, a feature extraction algorithm is used to identify the infusion bottle and the drip chamber, and the specific steps are:
[0017] b1, take images of the infusion bottle and the drip chamber with high signal-to-noise ratio as query objects; the video image of the intravenous infusion process is used as the query image;
[0018] b2, extracting feature points of the query object and the image to be queried, and performing feature point detection;
[0019] b3, calculate the descriptor of the query object and the query image;
[0020] b4, traverse the descriptors and calculate the matching quality;
[0021] b5, through the ratio test matching items, finally identify the infusion bottle and drip chamber in the query image.
[0022] Preferably, in step S2, the liquid level position is calculated using an image processing algorithm, and the specific steps are:
[0023] c1, grayscale the recognized infusion bottle image;
[0024] c2, filter and denoise the grayscale image in c1;
[0025] c3, edge detection is performed on the image after filtering and denoising in c2 to obtain the liquid surface position.
[0026] Preferably, in step S2, the dripping rate is calculated using the standard deviation-spectrum method, and the specific steps are:
[0027] d1, grayscale the identified drip chamber image;
[0028] d2, calculate the standard deviation distribution of the grayscale image;
[0029] d3, calculate the spectrum distribution of the standard deviation distribution;
[0030] d4, obtain the dripping rate value from the spectrum distribution.
[0031] Preferably, the abnormal conditions in step S3 include the abnormality when the calculated liquid level position is when the liquid medicine reaches a preset bottle mouth position and the abnormality when the calculated dripping speed is not within a preset dripping speed threshold.
[0032] The present invention also discloses a computer-readable storage medium, on which a computer program is stored. After the computer program is run, the above-mentioned intravenous infusion monitoring method based on visual measurement is executed.
[0033] The present invention also discloses a computer system, including a processor and a storage medium, wherein a computer program is stored on the storage medium, and the processor reads and runs the computer program from the storage medium to execute the above-mentioned intravenous infusion monitoring method based on visual measurement.
[0034] Preferably, a system for monitoring an intravenous infusion method based on visual measurement comprises a camera module, a data transmission module, a data storage module, a data processing module and a handheld terminal which are electrically connected in sequence; the camera module is installed in a position in the infusion room for conveniently collecting video images, and the data transmission module, the data storage module and the data processing module are compatible with the existing information management system of the hospital;
[0035] The camera module is used to capture video images containing the patient's bed number, infusion bottle and drip chamber;
[0036] The data transmission module is used to transmit the video image data collected by the camera module to the data storage module;
[0037] The data storage module is used to store the video image data collected by the camera module and the patient identity information and medication status of the hospital information management system;
[0038] The data processing module is used to identify the patient's bed number and match it with the patient's identity information and medication status entered into the hospital information management system, and calculate the liquid level position and drip rate of the infusion bottle;
[0039] The handheld terminal receives the patient identity information and the result processed by the data processing module through the data transmission module, and is used to present the patient identity information, medication status, liquid level position, real-time dripping speed and abnormal conditions to medical staff.
[0040] The beneficial effects of the present invention are:
[0041] (1) The present invention adopts a camera module to photograph the intravenous infusion system. The data transmission module, data processing module and data storage module are compatible with the hospital's existing information management system. Except for installing the camera equipment at a reasonable location, no additional equipment is required, and there is no need to disassemble and assemble the box body for each infusion monitoring, which reduces costs, is simple to operate, and is easy to implement.
[0042] (2) The present invention monitors the intravenous infusion process based on visual measurement technology, which effectively improves the accuracy of predicting the end time of infusion. At the same time, it has the advantages of non-contact, long-distance measurement, and large measurement range that are unique to visual measurement technology.
[0043] (3) Handheld terminal, convenient for medical staff to carry.
[0044] (4) The camera module can capture multiple infusion processes at one time, enabling simultaneous monitoring of multiple infusion processes, greatly reducing the workload of medical staff. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0046] Figure 1 is a flow chart of the method of the present invention;
[0047] Figure 2 This is a flow chart of the present invention using a digital recognition algorithm to identify a patient's bed number;
[0048] Figure 3 This is a flow chart of the present invention using a feature extraction algorithm to identify an infusion bottle and a drip chamber;
[0049] Figure 4 This is a flow chart of the present invention using an image processing algorithm to calculate the liquid level position;
[0050] Figure 5 The flow chart of the present invention using the standard deviation-spectrum method to calculate the dripping rate;
[0051] Figure 6 It is a system structure block diagram of the present invention. DETAILED DESCRIPTION
[0052] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0053] like Figure 1 , a method for monitoring intravenous infusion based on visual measurement, comprising the following steps:
[0054] S1: Collect video images;
[0055] S2: Perform recognition and matching processing on the video image collected in step S1 and calculate the liquid level position and dripping speed of the infusion bottle;
[0056] S3: Alarm for abnormal situations.
[0057] The video images collected in step S1 include video images of the patient's bed number, the infusion bottle, and the drip chamber.
[0058] In step S2, a digital recognition algorithm is used to identify the patient's bed number and match it with the patient's identity information and medication status entered into the hospital information management system; a feature extraction algorithm with strong resistance to light interference is used to identify the infusion bottle and the drip chamber; an image processing algorithm is used to calculate the liquid level position; and a standard deviation-spectrum method is used to calculate the drip rate.
[0059] like Figure 2 ,The specific steps of using the digital recognition algorithm to identify the patient's bed number are:
[0060] a1, grayscale and binarize the first frame of the video image containing the patient's bed number;
[0061] a2, denoising and character segmentation;
[0062] a3, extract the features of each character and generate a feature matrix;
[0063] a4, matching the feature matrix with the digital images in the sample library to identify the bed number.
[0064] like Figure 3 , use the feature extraction algorithm to identify the infusion bottle and the drip chamber. The specific steps are:
[0065] b1, take images of the infusion bottle and the drip chamber with high signal-to-noise ratio as query objects; the video image of the intravenous infusion process is used as the query image;
[0066] b2, extracting feature points of the query object and the image to be queried, and performing feature point detection;
[0067] b3, calculate the descriptor of the query object and the query image;
[0068] b4, traverse the descriptors and calculate the matching quality;
[0069] b5, through the ratio test matching items, finally identify the infusion bottle and drip chamber in the query image.
[0070] like Figure 4 , use image processing algorithm to calculate the liquid level position, the specific steps are:
[0071] c1, grayscale the recognized infusion bottle image;
[0072] c2, filter and denoise the grayscale image in c1;
[0073] c3, edge detection is performed on the image after filtering and denoising in c2 to obtain the liquid surface position.
[0074] like Figure 5 , use the standard deviation-spectrum method to calculate the drip rate. The specific steps are:
[0075] d1, grayscale the identified drip chamber image;
[0076] d2, calculate the standard deviation distribution of the grayscale image;
[0077] d3, calculate the spectrum distribution of the standard deviation distribution;
[0078] d4, obtain the dripping rate value from the spectrum distribution.
[0079] The abnormal conditions in step S3 include: when the calculated liquid level position is that the liquid medicine reaches the preset bottle mouth position, the liquid level position is abnormal; when the calculated dripping speed is not within the preset dripping speed threshold, the dripping speed is abnormal.
[0080] like Figure 6 A system for intravenous infusion monitoring method based on visual measurement includes a camera module, a data transmission module, a data storage module, a data processing module and a handheld terminal which are electrically connected in sequence; the camera module is installed in a position in the infusion room for convenient video image collection, and the data transmission module, the data storage module and the data processing module are compatible with the hospital's existing information management system.
[0081] The camera module is used to collect video images including the patient's bed number, infusion bottle and drip room. The frame rate of the camera module is greater than 4Hz. According to the current material level of the hospital, a common and affordable digital camera, webcam, smart phone, etc. can be selected as the camera module.
[0082] The data transmission module is used to transmit the video image data collected by the camera module to the data storage module. The data storage module is used to store the video image data collected by the camera module and the patient identity information and medication status of the hospital information management system. The data transmission module and the data storage module are compatible with the hospital's existing information management system, and can use any appropriate medium to transmit video images and computer-readable program codes, such as wireless, wired, optical cable, radio frequency, etc., or any suitable combination thereof, according to the hospital's current material conditions, and can automatically store video images and subsequent data processing results in the internal memory of the computer device or a network-based storage server according to the hospital's current material conditions.
[0083] The data processing module identifies the bed number of the patient in the monitoring video based on the digital recognition algorithm, and matches the patient's identity information and medication status entered into the hospital information management system based on this bed number; at the same time, it uses a feature extraction algorithm with strong resistance to light interference to identify the infusion bottle and drip chamber, and uses an image processing algorithm to calculate the liquid level position, and uses the standard deviation-spectrum method to calculate the drip rate.
[0084] The handheld terminal receives the patient's identity information and the results processed by the data processing module through the data transmission module, and is used to present the patient's identity information, medication status, liquid level position, real-time drip rate and abnormal conditions to medical staff.
[0085] The present invention adopts a camera module to shoot the intravenous infusion system, and adopts a data transmission module, a data processing module and a data storage module that are compatible with the existing information management system of the hospital. In addition to installing the camera equipment at a reasonable position, no additional equipment is required, and there is no need to disassemble and assemble the box body during each infusion monitoring, which reduces costs, is simple to operate, and is easy to implement. In addition, the present invention monitors the intravenous infusion process based on visual measurement technology, which effectively improves the accuracy of the prediction of the infusion termination time, and has the advantages of non-contact, long-distance measurement, and a large measurement range that are unique to visual measurement technology. The handheld terminal is convenient for medical staff to carry. The camera module can shoot multiple groups of infusion processes at one time, realize simultaneous monitoring of multiple groups of infusion processes, and greatly reduce the workload of medical staff.
[0086] The present invention also discloses a computer-readable storage medium, on which a computer program is stored. After the computer program is run, the above-mentioned intravenous infusion monitoring method based on visual measurement is executed.
[0087] The present invention also discloses a computer system, including a processor and a storage medium, wherein a computer program is stored on the storage medium, and the processor reads and runs the computer program from the storage medium to execute the above-mentioned intravenous infusion monitoring method based on visual measurement.
[0088] Those skilled in the art will further appreciate that the various illustrative logic blocks, modules, circuits, and algorithm steps described in conjunction with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of the two. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps are generally described above in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system. The technician may implement the described functionality in different ways for each specific application, but such implementation decisions should not be interpreted as resulting in a departure from the scope of the present invention.
[0089] The various illustrative logic blocks, modules, and circuits described in conjunction with the embodiments disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in cooperation with a DSP core, or any other such configuration.
[0090] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read and write information from / to the storage medium. In an alternative, a storage medium may be integrated into a processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In an alternative, the processor and the storage medium may reside in a user terminal as discrete components.
[0091] In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented as a computer program product in software, each function may be stored on or transmitted by a computer-readable medium as one or more instructions or codes. Computer-readable media include both computer storage media and communication media, including any medium that facilitates the transfer of a computer program from one place to another. Storage media may be any available medium that can be accessed by a computer. As an example and not limitation, such a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, disk storage or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of an instruction or data structure and can be accessed by a computer. Any connection is also properly referred to as a computer-readable medium. For example, if the software is transmitted from a website, a server, or other remote source using a coaxial cable, a fiber optic cable, a twisted pair, a digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwaves, the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwaves are included in the definition of the medium. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, wherein disk often reproduces data magnetically, while disc reproduces data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
[0092] The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein, but should be granted the widest scope consistent with the principles and novel features disclosed herein.
[0093] Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent substitutions for some of the technical features therein; and these modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for monitoring intravenous infusion based on visual measurement, characterized in that: The following steps are involved: S1: Collect video images; S2: Perform recognition and matching processing on the video image collected in step S1 and calculate the liquid level position and dripping speed of the infusion bottle; S3: Alarming the abnormal situation of the liquid level position and dripping speed in step S2; The video images collected in step S1 include video images of the patient's bed number, the infusion bottle, and the drip chamber; In step S2, the patient's bed number is identified by using a digital recognition algorithm, and matched with the patient's identity information and medication status entered into the hospital information management system. The specific steps of identifying the patient's bed number by using a digital recognition algorithm are as follows: a1, grayscale and binarize the first frame of the video image containing the patient's bed number; a2, denoising and character segmentation; a3, extract the features of each character and generate a feature matrix; a4, matching the feature matrix with the digital images in the sample library to identify the bed number; In step S2, a feature extraction algorithm is used to identify the infusion bottle and the drip chamber. The specific steps are as follows: b1, take images of the infusion bottle and the drip chamber with high signal-to-noise ratio as query objects; the video image of the intravenous infusion process is used as the query image; b2, extracting feature points of the query object and the image to be queried, and performing feature point detection; b3, calculate the descriptor of the query object and the query image; b4, traverse the descriptors and calculate the matching quality; b5, finally identifying the infusion bottle and the drip chamber in the query image by checking the matching items by ratio; In step S2, the liquid level position is calculated using an image processing algorithm, and the specific steps are as follows: c1, grayscale the recognized infusion bottle image; c2, filter and denoise the grayscale image in c1; c3, edge detection is performed on the image after filtering and noise reduction in c2 to obtain the liquid surface position; In step S2, the dripping rate is calculated using the standard deviation-spectrum method, and the specific steps are as follows: d1, grayscale the identified drip chamber image; d2, calculate the standard deviation distribution of the grayscale image; d3, calculate the spectrum distribution of the standard deviation distribution; d4, obtain the dripping rate value from the spectrum distribution.
2. The method according to claim 1, characterized in that: The abnormal conditions in step S3 include the abnormality when the calculated liquid level position is when the liquid medicine reaches the preset bottle mouth position and the abnormality when the calculated dripping speed is not within the preset dripping speed threshold.
3. A computer-readable storage medium, characterized in that: A computer program is stored on the medium, and after the computer program is run, the intravenous infusion monitoring method based on visual measurement as described in any one of claims 1 to 2 is executed.
4. A computer system, characterized in that: It comprises a processor and a storage medium, wherein a computer program is stored on the storage medium, and the processor reads and runs the computer program from the storage medium to execute the intravenous infusion monitoring method based on visual measurement as described in any one of claims 1 to 2.
5. A system for the intravenous infusion monitoring method based on visual measurement according to any one of claims 1-2, characterized in that: It includes a camera module, a data transmission module, a data storage module, a data processing module and a handheld terminal which are electrically connected in sequence; the camera module is installed in a position in the infusion room to facilitate the collection of video images, and the data transmission module, the data storage module and the data processing module are compatible with the existing information management system of the hospital; The camera module is used to capture video images containing the patient's bed number, infusion bottle and drip chamber; The data transmission module is used to transmit the video image data collected by the camera module to the data storage module; The data storage module is used to store the video image data collected by the camera module and the patient identity information and medication status of the hospital information management system; The data processing module is used to identify the patient's bed number and match it with the patient's identity information and medication status entered into the hospital information management system, and calculate the liquid level position and drip rate of the infusion bottle; The handheld terminal receives the patient identity information and the result processed by the data processing module through the data transmission module, and is used to present the patient identity information, medication status, liquid level position, real-time dripping speed and abnormal conditions to medical staff.
Citation Information
Patent Citations
Iv monitoring by video and image processing
CN103179995A
Injection speed management method based on image processing
CN113274584A
