Program, blood sampling work support system and blood sampling work support method
The system uses continuous arm photography and pixel-based frame selection to accurately identify past puncture sites, improving blood collection efficiency and reliability by simplifying the process.
Patent Information
- Application Number
- JP2023084635
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-23
- Publication Date
- 2024-12-05
AI Technical Summary
Existing blood collection systems struggle to accurately identify the past puncture site for needle insertion due to textual representation, leading to imprecise location identification by operators.
A system that uses a fixed imaging device to continuously photograph a patient's arm during blood sampling, extracts frames with a predetermined color gamut increase, and displays these frames to the operator for precise puncture site confirmation, eliminating redundant frames through pixel measurement and selection.
Enables accurate and efficient identification of the past puncture site, enhancing the reliability and speed of blood collection operations by using image recognition without the need for complex AI training.
Smart Images

Figure 2024168181000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a blood collection operation support system for improving the efficiency of blood collection operations in blood collection rooms in hospitals. Regarding. [Background technology]
[0002] In order to streamline blood collection operations in blood collection rooms and the like in hospitals, blood collection operation support systems have been introduced in many hospitals (for example, Patent Documents 1 and 2). In the blood collection operation support systems described in Patent Documents 1 and 2, when blood is collected from a patient, the blood collection instruction sheet and a terminal attached to the blood collection stand display the patient's past blood collection records. The blood collection records include information such as the puncture site (the site where the blood collection needle was inserted), the type of needle used, and the condition of the patient's blood vessels, and blood collection workers can perform blood collection operations more reliably by referring to the blood collection records. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2008-97179 A [Patent Document 2] JP 2017-59076 A Summary of the Invention [Problem to be solved by the invention]
[0004] In blood collection work, it is sometimes desired to insert the blood collection needle into the same position as the previous puncture site, or into a position slightly shifted from the previous puncture site. However, in the systems of Patent Documents 1 and 2, the blood collection worker can know the previous puncture site from the blood collection record, but the puncture site is displayed as text information, so there is a problem that the blood collection worker cannot accurately know the previous puncture site. For example, in the system of Patent Document 2, after blood collection, the blood collection worker selects and registers the puncture site from options such as "midline of left elbow" and "ulnar side of right elbow", but the range indicated by each option is wide, and the puncture site cannot be sufficiently identified.
[0005] The present invention has been made in consideration of the current situation, and aims to provide a blood collection operation support system, a blood collection operation support method, and a program for use in the system that enable blood collection workers to accurately grasp a patient's past puncture sites, compared to conventional configurations. [Means for solving the problem]
[0006] The present invention is a blood collection operation support method including a first step of continuously photographing the arm of a patient in color during blood collection operation with a fixed photographing means, a second step of extracting a blood collection reference image in which the puncture site can be confirmed from the continuous images obtained in the first step, a third step of a blood collection record storage means storing the blood collection reference image in association with identification information of the patient, and a fourth step of displaying, when collecting blood from a patient, the past blood collection reference images of the patient stored in the blood collection record storage means to a blood collection worker who collects blood from the patient, wherein the second step is performed by a computer controlling the associated identification information. The blood collection operation support method includes the steps of: extracting a frame of a patient's arm before puncturing placed on a blood collection stand as a comparison source frame from a plurality of frames constituting the consecutive images; measuring the number of pixels in a predetermined color gamut for the comparison source frame by a computer; and measuring the number of pixels in the predetermined color gamut for some or all of the frames constituting the consecutive images other than the comparison source frame by a computer, and selecting a frame in which the number of pixels is increased by a predetermined degree compared to the number of pixels in the comparison source frame. Here, the "consecutive images" may be a video continuously shot at an extremely short interval, or may be a collection of still images (frames) continuously shot at a relatively long interval (e.g., an interval of several seconds).
[0007] In this method, the blood collection worker can more accurately identify the patient's previous puncture site by the blood collection reference image when collecting blood from the patient, and therefore can perform the blood collection work more reliably than before. In addition, since the continuous images taken during the blood collection work are redundant, it takes time to check the puncture site by looking at the continuous images, but if the blood collection reference image cut out from the continuous images is displayed to the blood collection worker as in the present invention, the blood collection worker can quickly identify the patient's previous puncture site when collecting blood. In particular, in the second step of this method, the predetermined color gamut for measuring the number of pixels is set to the color gamut of blood (dark red), so that frames showing drawn blood can be easily and accurately selected from the continuous images. Since most of the frames in which the puncture site can be confirmed are frames showing drawn blood, by selecting frames showing drawn blood using this method, it is possible to easily eliminate many of the frames in which the puncture site is difficult to confirm from the frames constituting the continuous images, and efficiently extract a reference blood-collection image. When extracting a reference blood-collection image from a continuous image using image recognition AI, many training images are required to prepare a practical one, which takes time and effort, but this method allows the reference blood-collection image to be extracted with less time and effort.
[0008] As another aspect of the present invention, a program is proposed for causing a computer to function as a means for extracting a blood sampling reference image capable of confirming the puncture site from a series of images obtained by color-photographing the arm of a patient during blood sampling with a fixed photographing means, the program causing the computer to function as a means for extracting a frame of the patient's arm before puncturing placed on a blood sampling stand from a plurality of frames constituting the series of images as a comparison source frame, a means for measuring the number of pixels in a predetermined color gamut for the comparison source frame, and a means for measuring the number of pixels in the predetermined color gamut for some or all of the frames constituting the series of images other than the comparison source frame, and selecting a frame in which the number of pixels is increased by a predetermined degree compared to the number of pixels in the comparison source frame. Since this program selects based on the degree of increase in the number of pixels in the predetermined color gamut relative to the comparison source frame, if the color gamut is set to the color gamut indicated by blood (dark red), the frame in which the collected blood is shown can be selected with high accuracy even when another object of the same color as blood is photographed in the background or when the position in which the blood is photographed changes. In addition, because such a program does not require the effort of reinforcement learning using teacher images, it can be implemented in a system at lower cost than image recognition AI.
[0009] In another aspect of the present invention, a blood collection operation support system is provided with a blood collection record storage means for storing blood collection records related to blood collection performed in association with the patient's identification information, and a blood collection information display means that is installed on a blood collection stand and configured to display past blood collection records of the patient from which blood is collected to a blood collection worker working on the blood collection stand, and a fixed photographing means configured to be able to photograph the patient's arm during blood collection, and a computer that is installed with the above program and is capable of executing a process for extracting a blood collection reference image that allows the puncture site to be confirmed from a series of images of the patient's arm during blood collection, which are photographed in color by the fixed photographing means, and the blood collection operation support system is characterized in that the blood collection record may include the blood collection reference image. According to this system, the blood collection worker can accurately grasp the past puncture site of the patient from the blood collection reference image when collecting blood from the patient, so that the blood collection operation can be performed more reliably. In addition, since the blood collection reference image is an image extracted from a series of images, there is an advantage that the blood collection worker can grasp the past puncture site of the patient in a short time when collecting blood. Effect of the Invention
[0010] As described above, according to the present invention, when collecting blood, the blood collection worker can determine the previous puncture site of the patient more accurately than before, so that the blood collection work can be performed more reliably than before. [Brief description of the drawings]
[0011] [Figure 1] 1 is a system configuration diagram of a blood collection operation support system according to an embodiment. [Diagram 2] 1 is an explanatory diagram showing a display example of a display screen 10 of a blood sampling stand terminal 7. FIG. [Diagram 3] 13 is an explanatory diagram showing another display example of the display screen 10 of the blood sampling station terminal 7. FIG. [Figure 4] 13 is an explanatory diagram showing another display example of the display screen 10 of the blood sampling station terminal 7. FIG. [Diagram 5] 13 is a flowchart showing a processing procedure of a blood sampling frame selection process. [Figure 6] FIG. 2 is an explanatory diagram showing frames included in a sequence of images. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Embodiments of the present invention will now be described with reference to the following examples. In the following embodiments, the blood sampling record storage means according to the present invention corresponds to the database 2. The blood sampling information display means according to the present invention corresponds to the blood sampling stand terminal 7. The computer according to the present invention corresponds to the blood sampling stand terminal 7. The fixed photographing means according to the present invention corresponds to the fixed camera.
[0013] The blood collection operation support system of this embodiment is for supporting blood collection operations for patients in a hospital. As shown in Fig. 1, the blood collection operation support system comprises an operation management server 1, a database 2, a reception terminal 3, a reception slip printer 4, a blood collection tube preparation device 5, a guide display device 6, and a plurality of blood collection stand terminals 7. These devices are installed in a blood collection room of a hospital. The blood collection room comprises a reception area where patients who visit the room complete the reception procedure, a waiting area where patients who have completed the reception procedure wait until their blood is collected, a blood collection area where a plurality of blood collection stands are installed, and a server installation area where the operation management server 1 and the database 2 are installed.
[0014] The service management server 1 is the backbone of the blood collection service support system. The service management server 1 is connected to a higher-level system S (electronic medical record system) via an in-hospital LAN, and is also connected to a database 2, a reception terminal 3, a reception slip printer 4, a blood collection tube preparation device 5, a guidance display device 6, and a blood collection stand terminal 7 via communication cables so as to be able to communicate with each other.
[0015] The database 2 stores various data related to blood collection operations. The data stored in the database 2 is referenced, registered, and updated by the operation management server 1 and the like.
[0016] The reception terminal 3 and reception ticket printer 4 are installed at the reception area of the blood collection room and are used for patient reception procedures. The reception terminal 3 is mainly used to verify patients who come to the blood collection room, and the reception ticket printer 4 is used to issue reception tickets for patients who have completed the reception procedures. The reception number, patient ID number (patient ID), and a barcode that stores this information are printed on the reception ticket.
[0017] The blood collection tube preparation device 5 is for preparing blood collection tubes to be used for blood collection from patients. Specifically, the blood collection tube preparation device 5 stores multiple types of blood collection tubes to be used for blood collection, and based on information received from the business management server 1, attaches a blood collection label with the patient's name and other information printed on it to the type of blood collection tube to be used for blood collection from the patient, and stores all blood collection tubes to be used for blood collection from the patient in one tray. Furthermore, the blood collection tube preparation device stores blood collection information display pieces, which are pieces of paper on which information related to blood collection from each patient is printed, in the tray together with the blood collection tube for that patient, and carries them out. Note that the basic structure of such a blood collection tube preparation device is publicly known, so detailed description will be omitted.
[0018] The guidance display device 6 is installed in the waiting area of the blood collection room and displays information to patients waiting in the waiting area. Specifically, the guidance display device 6 displays the number of people currently waiting and the reception number of the patient with the highest priority in the waiting list.
[0019] The blood collection stand terminal 7 is a terminal used by a blood collection worker who collects blood on the blood collection stand, and is installed at each blood collection stand installed at the blood collection site. Each blood collection stand terminal 7 is composed of a tablet terminal or the like, and each blood collection stand terminal 7 is connected by wire or wireless to a scanner for reading a barcode, a calling device for calling a patient, a pressure sensor arranged on the blood collection stand, and a fixed camera for color-photographing the blood collection work. The pressure sensor detects the state in which the patient's arm is placed on the blood collection cushion installed on the blood collection stand. The fixed camera is installed beside the blood collection stand so as to be able to photograph the patient's arm during the blood collection work. Specifically, the fixed camera is installed at a position where the patient's arm placed on the blood collection cushion is photographed from diagonally above so as to be able to photograph a color image in which the puncture site can be confirmed. It is not necessary to photograph the entire patient's arm, and it is sufficient to photograph the area including the puncture site.
[0020] The basic flow of blood collection operations using the blood collection operation support system of this embodiment will be described below. <Before the reception procedure> In this embodiment, basically, before a patient arrives at the blood collection room, blood collection information including the patient's identification information (patient's name, patient ID, etc.) and blood collection details is registered in the blood collection reservation list in the database 2. In other words, blood collection information ordered by a doctor or nurse involved in the patient's examination via the upper system S is transmitted to the business management server 1 before the patient arrives and is registered in the blood collection reservation list in the database 2.
[0021] <Reception procedure> A patient who comes to the blood collection room completes the reception procedure at the reception area. During the reception procedure, a staff member at the front desk reads the patient ID of the patient stored on the patient's medical card with the scanner of the reception terminal 3. The patient ID read by the reception terminal 3 is sent to the service management server 1, which compares the received patient ID with the blood collection information stored in the blood collection reservation list in the database 2. When the service management server 1 successfully completes the comparison, it registers the blood collection information of the patient in the blood collection work list in the database 2 and has the reception ticket printer 4 issue a reception ticket for the patient. The patient receives the issued reception ticket and waits in the waiting area until the reception number printed on the reception ticket is called.
[0022] <Preparation of blood collection tube> When the service management server 1 registers the blood collection information of a patient in the blood collection work list, it transmits the blood collection tube preparation information to the blood collection tube preparation device 5, causing the blood collection tube preparation device 5 to prepare the blood collection tube for that patient. The blood collection tube preparation instruction information includes the type of blood collection tube to be used, information to be printed on the blood collection label and the blood collection information display piece, etc. The blood collection tube preparation device 5 prepares the blood collection tubes and blood collection information display pieces to be used for blood collection for each patient in the order in which it receives the blood collection tube preparation instruction information from the service management server 1, and stores and transports them together on one tray.
[0023] <Blood collection work> (1) When starting work at the blood collection stand, a blood collection worker first performs the worker authentication procedure. Specifically, at the start of work, a blood collection worker authentication screen is displayed on the display screen 10 of the blood collection stand terminal 7 as shown in FIG. 2(a). When the blood collection worker correctly enters his / her own identification information (in this case, the worker ID) and completes the worker authentication procedure, a patient list screen as shown in FIG. 2(b) is displayed on the display screen 10 of the blood collection stand terminal 7. The patient list screen is a screen that is displayed in the initial state before the start of blood collection work, and from this state, the blood collection worker performs the following steps (2) to (6) to collect blood from the patient. (2) The blood collection operator carries one of the trays sent out by the blood collection tube preparing device 5 to the blood collection stand. (3) The blood collection operator reads the barcode printed on the blood collection label of the blood collection tube in the tray with the scanner of the blood collection stand terminal 7. As a result, the blood collection stand terminal 7 reads out the blood collection information of the patient indicated by the patient ID from the blood collection work list in the database 2 based on the patient ID stored in the barcode. Then, the blood collection stand terminal 7 makes a voice call to the patient using the calling device. Also, as shown in FIG. 2(c), the blood collection stand terminal 7 displays a blood collection screen on the display screen 10. The blood collection screen displays blood collection information such as attribute information of the patient performing blood collection and blood collection details. Also, as described later, when the "Blood Collection Button" displayed in the lower right of the blood collection screen is operated, a blood collection record display screen is displayed on which the past blood collection performance information of the patient and blood collection reference images can be confirmed (see FIG. 4). In other words, this step of the blood collection work corresponds to the fourth step according to the present invention. (4) The blood collection operator reads the barcode printed on the reception slip of the called patient with the scanner of the blood collection stand terminal 7. The blood collection stand terminal 7 then compares the information on the reception slip with the information on the blood collection tube to authenticate the called patient. If the authentication is successful, the blood collection stand terminal 7 displays a message instructing the patient to collect blood in the upper left corner of the display screen 10, as shown in FIG. 3(a). (5) The blood collection operator collects blood from the patient following the instructions on the blood collection stand terminal 7. As described below, the fixed camera continuously captures color images of the patient's arm while blood is being collected, and transmits the data of the captured continuous images to the blood collection stand terminal 7. In other words, this step of the blood collection operation corresponds to the first step of the present invention. (6) When the blood collection worker completes the blood collection of the patient, he / she operates the "Complete" button displayed in the lower right corner of the display screen 10 of FIG. 3(a). As a result, the blood collection record input screen shown in FIG. 3(b) is displayed on the display screen 10 of the blood collection stand terminal 7. The blood collection worker inputs record information related to the blood collection of the patient via the blood collection record input screen. The record information input here is "Needle Used", "Blood Collection Site", "Blood Vessel Condition", "Adverse Event", "Number of Reinsertions", "Reason for Reinsertion", and "Patient Supplementary Information". Note that the record information other than "Patient Supplementary Information" is configured to be selected and input from among items prepared in advance. When the blood collection worker inputs record information related to the blood collection of the patient via the blood collection record input screen, he / she operates the "Input Complete" button displayed in the lower right corner of the display screen 10 of FIG. 3(b). (7) When the "input complete" button is operated, the reference image selection screen shown in FIG. 3(c) is displayed on the display screen 10 of the blood collection stand terminal 7. The reference image selection screen displays candidates for images to be saved as blood collection reference images. These candidate images are frames selected by the blood collection stand terminal 7 from frames constituting continuous images captured in color by a fixed camera during blood collection. On the reference image selection screen of FIG. 3(c), two frames are displayed as candidate images. The blood collection worker selects a candidate image suitable for checking the puncture site (here, the left candidate image) from the displayed images and operates the "selection complete" button displayed on the right side of the display screen 10, and the candidate image is selected and saved as the blood collection reference image. That is, this step of the blood collection work constitutes the second step of the present invention. Furthermore, if no candidate image suitable for checking the puncture site is displayed, the blood collection worker operates the "do not save" button. In this case, the blood collection reference image related to the blood collection work is not saved. Then, when the “Selection Complete” button or the “Do Not Save” button is operated, the series of tasks related to blood collection for that patient is completed, and the patient list screen (Figure 2(b)) is displayed on the display screen 10 of the blood collection station terminal 7. (8) When a series of operations related to blood collection for the patient is completed, the blood collection station terminal 7 notifies the service management server 1 of the completion of blood collection for the patient, and transmits the performance information input on the blood collection performance input screen and the blood collection reference image selected on the reference image registration screen. When the service management server 1 receives such a notification, it deletes the blood collection information for the patient from the blood collection work list in the database 2, and registers the blood collection information, performance information related to the blood collection information, and the blood collection reference image in the blood collection result data in the database 2. The performance information and the blood collection reference image are linked to the identification information of the patient and stored, and are referred to for the purpose of smoothly carrying out the next and subsequent blood collection operations for the patient, as described below. In other words, this step of the blood collection operation corresponds to the third step according to the present invention.
[0024] The main parts of the present invention will be described below. The database 2 of the blood collection operation support system of this embodiment stores the following information: (1) Blood collection appointment list Blood collection information received from the host system before the reception procedure (2) Blood collection work list Blood collection information after the reception procedure has been completed and blood collection has not yet been completed (3) Blood sampling result data Blood collection information after blood collection, performance information related to each blood collection information, and blood collection reference images (4) Patient information Attribute information of each patient (name, patient ID, sex, date of birth, etc.) and blood collection record (blood collection information and performance information, blood collection reference image) (5) Worker information Attribute information of each blood collection worker (name, worker ID, affiliation, etc.) and blood collection record (number of blood collections, etc.) (6) Blood sampling station information Operation status of each blood collection station (blood collection in progress / stopped) and information on the blood collection worker currently working
[0025] The above-mentioned patient information and worker information are updated once a day. Specifically, after the blood collection work for the day is completed, the work management server 1 executes a batch process to add the blood collection result data updated on that day to the blood collection record in the patient information of each patient and the blood collection performance in the worker information of each blood collection worker.
[0026] On the other hand, in this embodiment, when the service management server 1 receives blood collection information from the upper system, it extracts the blood collection record of the patient from the patient information in the database 2 and adds it to the blood collection information. In this embodiment, the blood collection worker can check the blood collection record added to the blood collection information in this way on the blood collection stand terminal 7. Specifically, in the blood collection screen (FIGS. 2(c), 3(a)), a "Blood Collection Record" button is displayed on the right side of the display screen 10 of the blood collection stand terminal 7. When the blood collection worker operates the "Blood Collection Record" button, the blood collection record display screen shown in FIG. 4(a) is displayed on the display screen 10, and the blood collection worker can check the past blood collection performance information of the patient. In addition, in the blood collection record display screen shown in FIG. 4(a), a "Display" button is displayed on the right side of the display screen 10 for each past blood collection date, and when the blood collection worker operates the "Display" button, a blood collection reference image taken on the blood collection date is displayed on the display screen 10 as shown in FIG. 4(b).
[0027] In this way, in the blood collection operation support system of this embodiment, the blood collection worker can accurately grasp the past puncture site of the patient by the blood collection reference image when collecting blood from the patient. Also, the blood collection reference image is not a series of images taken during blood collection work, but a single frame cut out from the series of images in which the puncture site can be confirmed, so the blood collection worker can quickly grasp the past puncture site of the patient by the blood collection reference image.
[0028] A method for acquiring the blood sampling reference image will be described in detail below. As described above, in the blood collection operation support system of this embodiment, a blood collection reference image that allows the puncture site of the patient from whom blood has been collected to be confirmed is stored in database 2 when the blood collection operation is completed, and can be referred to as reference information the next time blood is collected from that patient onwards.
[0029] The blood sampling reference image is a still image showing the puncture site from a previous blood sampling from the patient. The blood sampling reference image is selected from a series of images taken by a fixed camera during the previous blood sampling from the patient. The fixed camera is attached to each blood sampling stand so that the patient's puncture site can be captured. The series of images consists of a plurality of color still images captured by the fixed camera at regular intervals at the same position. The interval between shots of the fixed camera is not particularly limited, but even if the puncture time is short, it is required that the interval includes at least one frame captured during the puncture.
[0030] The fixed camera is connected to the blood sampling stand terminal 7 by wire or wirelessly, and starts taking continuous images before puncturing according to instructions from the blood sampling stand terminal 7, and stops taking continuous images after the needle is removed. Specifically, after authenticating the called patient, when the patient's arm is placed on the blood sampling cushion and the pressure sensor is turned ON for a certain period of time, the blood sampling stand terminal 7 instructs the fixed camera to start taking continuous images. Then, when the patient's arm is removed from the blood sampling cushion after the needle is removed and the pressure sensor is turned OFF for a certain period of time, the blood sampling stand terminal 7 instructs the fixed camera to stop taking continuous images. The continuous images taken by the fixed camera are transmitted to the blood sampling stand terminal 7 after taking the images is finished.
[0031] The continuous images captured by the fixed camera include frames showing the arm before puncturing, frames showing the arm during puncturing, and frames showing the arm after the needle is removed. The frames in which the puncture site can be confirmed are the frames showing the arm during puncturing. Most of the frames showing the arm during puncturing show the collected blood. For this reason, in order to facilitate the selection of the blood collection reference image, the blood collection stand terminal 7 executes a blood collection frame selection process to select frames showing the collected blood (blood collection frames) from each frame constituting the continuous images.
[0032] The blood collection frame selection process is executed by the blood collection stand terminal 7 immediately after the completion of capturing the continuous images. Then, the blood collection stand terminal 7 displays the blood collection frames selected in the blood collection frame selection process as candidate images on the reference image selection screen described above (see FIG. 3(c)). Then, on the reference image selection screen, the blood collection operator is prompted to select a blood collection reference image from the candidate images. In other words, the blood collection frame selection process and the process related to the reference image selection screen correspond to the second step according to the present invention.
[0033] The blood sampling frame selection process in which the blood sampling stand terminal 7 selects blood sampling frames from consecutive images will be described below. In the blood sampling frame selection process, the blood sampling stand terminal 7 selects each frame constituting the consecutive images into a blood sampling frame and a frame not showing collected blood (a non-blood sampling frame) based on the number of pixels in the blood color gamut contained in the frame constituting the consecutive images. Specifically, one non-blood sampling frame is extracted as a comparison source frame from the consecutive images, and a frame in which the number of pixels in the blood color gamut is increased by a predetermined number compared to the comparison source frame is selected as a blood sampling frame. Note that the program installed in the blood sampling stand terminal 7 for executing the blood sampling frame selection process corresponds to the program of the present invention.
[0034] 5 is a flow chart showing the procedure of the blood collection frame selection process. Details of each process in FIG. 5 are as follows. In step S1, the blood sampling stand terminal 7 extracts one comparison source frame from the continuous images for which shooting has been completed. Specifically, the first frame immediately after the start of shooting the continuous images is extracted as the comparison source frame. Because shooting of the continuous images starts before puncturing, the first frame of the continuous images is a non-blood sampling frame showing the patient's arm placed on the blood sampling stand before puncturing.
[0035] In step S2, the blood sampling terminal 7 counts the number of pixels in the blood gamut in the comparison source frame and stores the counting result as the reference pixel number. Specifically, it is determined whether or not all pixels in the comparison source frame are in the blood gamut, and the total number of pixels determined to be in the blood gamut is set as the reference pixel number. The blood gamut is defined as a range of pixel value parameters. In this embodiment, pixels whose RGB values are within the range of R=150±10, G=5±5, B=80±10 are determined to be pixels in the blood gamut. The pixel value parameters of the blood gamut are adjusted according to the lighting, fixed camera, etc. so that they include the pixel color of the collected blood (dark red) and can exclude pixel colors other than blood as much as possible.
[0036] In step 3, the blood sampling stand terminal 7 reads in a selection frame to be sorted into a blood sampling frame and a non-blood sampling frame from the frames constituting the continuous image. Specifically, if it is immediately after step S2, the second frame from the start of shooting is read in as the selection frame, and if other selection frames have already been selected, the frame following the frame previously selected is read in as the selection frame.
[0037] In step S4, the blood sampling terminal 7 counts the number of pixels in the blood color gamut in the selection target frame, and sets the counting result as the number of comparison target pixels. This process is performed in the same manner as the process of counting the reference number of pixels in the comparison source frame in step S2.
[0038] In step S5, it is determined whether the number of pixels to be compared has increased by a predetermined number from the reference pixel number. Specifically, it is determined whether "number of pixels to be compared - reference pixel number = 400 to 2500". If it is determined that the number of pixels to be compared has increased by the predetermined number, the selection target frame is selected as a blood sampling frame (S6), and if it is determined that the number has not increased by the predetermined number, the selection target frame is selected as a non-blood sampling frame (S7). In this way, in steps S5 to S7, a selection target frame in which the number of pixels in the blood color gamut has increased by a predetermined number from the reference pixel number of the comparison source frame is selected as a blood sampling frame. In other words, the determination criterion of "number of pixels to be compared - reference pixel number = 400 to 2500" is set as a value that allows the selection target frame to be classified into a blood sampling frame and a non-blood sampling frame with high accuracy.
[0039] In step S8, it is determined whether all frames to be selected have been processed. If it is determined that selection of all frames has been completed, the blood collection frame selection process is terminated. If it is determined that selection of all frames has not been completed, steps S3 to S7 are repeated to select unprocessed frames.
[0040] In the above blood sampling frame selection process, the criterion for selecting a blood sampling frame is "number of pixels to be compared - reference number of pixels = 400 to 2500", but this criterion can be changed as appropriate depending on the shooting range and resolution of the continuous images. Also, the criterion may not have an upper limit and may be "number of pixels to be compared - reference number of pixels ≧ 400". Also, the degree of increase in the number of pixels in the blood color gamut may be determined not by the absolute number of pixels but based on the ratio of the pixels in the blood color gamut to all pixels in the frame. In addition, in the above blood sampling frame selection process, one comparison source frame is extracted, but multiple comparison source frames may be extracted and the average number of pixels in the blood color gamut contained in those comparison source frames may be used as the reference pixel number.
[0041] A specific example of the blood collection frame selection process will be described with reference to FIG. 6. FIG. 6 shows six consecutive images taken at regular intervals during blood collection in the order of FIG. 6(a) to 6(f). In these consecutive images, the blood collection needle is shown in the second to fifth frames (FIG. 6(b) to 6(e)). The third and fourth frames (FIG. 6(c) and 6(d)) are images taken during puncturing, and the puncturing site can be confirmed in these frames. The fourth and fifth frames (FIG. 6(d) and 6(e)) show the collected blood filling the rubber tube.
[0042] When performing blood sampling frame selection processing on the sequential images in Fig. 6, the first frame of the sequential images (Fig. 6(a)) is extracted as the comparison source frame, and the second to sixth frames (Figs. 6(b) to 6(f)) are processed as the selection target frames. The comparison source frame in Fig. 6(a) does not show blood, nor anything of the same color as blood, so the reference pixel count is zero.
[0043] In the continuous images of Figure 6, the second, third, and sixth frames (Figures 6(b), 6(c), and 6(f)) do not show blood, and the number of pixels in the blood color gamut has not increased compared to the comparison source frames, so they are selected as non-blood collection frames. On the other hand, the fourth and fifth frames (Figures 6(d) and 6(e)) show a certain amount of collected blood, so they are selected as blood collection frames due to the degree of increase in the number of pixels in the blood color gamut. For this reason, for the blood collection that captured the continuous images of Figure 6, the fourth and fifth frames selected by the blood collection frame selection process are displayed as candidate images on the reference image selection screen (Figure 3(c)) at the end of the blood collection operation. In this example, the third frame (Figure 6(c)), in which the puncture site can be confirmed, is selected as a non-blood collection frame because it is taken immediately after puncture and no blood is visible; however, if the blood collection frames selected in the blood collection frame selection process include one or more frames (Figure 6(d)) in which the puncture site can be confirmed, there is no problem in selecting the image in which the puncture site can be confirmed as a non-blood collection frame.
[0044] As in this embodiment, by selecting blood collection frames with blood as candidate images from frames constituting consecutive images, blood collection reference images can be efficiently cut out from consecutive images. Most of the frames in which the puncture site can be confirmed are blood collection frames, and most of the non-blood collection frames are frames before puncture or after needle removal in which the puncture site is difficult to confirm. Therefore, by selecting blood collection frames and excluding non-blood collection frames, it becomes easier to select subsequent blood collection reference images. In addition, when selecting each frame constituting consecutive images into frames in which the puncture site can be confirmed and frames in which the puncture site is difficult to confirm, complex processing using image recognition AI is required, but when selecting frames with blood and frames without blood, it can be achieved with a relatively simple process such as the blood collection frame selection process described above.
[0045] In addition, since the blood sampling frame selection process selects blood sampling frames based on the degree of increase in pixels in the blood color gamut, frames containing blood can be reliably selected regardless of where blood is in the frame. Furthermore, since the degree of increase in pixels in the blood color gamut is determined based on the comparison source frame, frames containing blood can be reliably selected even if clothing of the same color as blood is included in the comparison source frame. Therefore, the blood sampling frame selection process has the advantage of being able to select blood sampling frames with high accuracy from frames constituting a continuous image.
[0046] In addition, the blood collection frame selection process can be implemented in a blood collection work support system at a relatively low cost. When selecting blood collection frames with the same accuracy using image recognition AI, it is necessary to prepare many training images and perform reinforcement learning, but this blood collection frame selection process only requires setting the pixel value parameters that indicate the color gamut of blood and the threshold value of the blood collection frame selection criteria.
[0047] Although the embodiment of the present invention has been described above by way of examples, the present invention is not limited to the above-mentioned examples and various modifications can be made without departing from the gist of the present invention.
[0048] For example, in the above embodiment, the blood collection operator is configured to select a blood collection reference image from candidate images on the reference image selection screen at the end of the blood collection operation (see FIG. 3(c)), but the blood collection stand terminal 7 may be configured to automatically select a blood collection reference image from candidate images (blood collection frames). Specifically, as shown in FIG. 3(c), among the blood collection frames selected in the blood collection frame selection process, those captured relatively late may be frames after the needle is removed, making it difficult to confirm the puncture site. Therefore, among the blood collection frames selected in the blood collection frame selection process, it is proposed to select those captured early as blood collection reference images. With this configuration, the blood collection operation can be made more efficient by eliminating the need for the blood collection operator to select a blood collection reference image.
[0049] Furthermore, as described above, when a series of processes from cutting out a blood sampling reference image from consecutive images is automated, the process may not be executed immediately after blood sampling for each patient, but may be executed collectively after the blood sampling work for the day is completed. The process may also be configured to be executed by the service management server 1 instead of the blood sampling stand terminal 7. Although the consecutive images according to the above embodiment are used only for cutting out a blood sampling reference image, the same consecutive images may be used for purposes other than cutting out a blood sampling reference image. Furthermore, the consecutive images may not be deleted after cutting out a blood sampling reference image, but may be stored in the database 2 separately from the blood sampling reference image.
[0050] In addition, the continuous images in the above embodiment are images taken by a fixed camera at intervals of several seconds during blood collection, but the continuous images taken by a fixed camera may be videos taken at shorter intervals. If the continuous images are videos, it takes a long time to select all the frames that make up the continuous images in the blood collection frame selection process, so it is desirable to thin out the frames that make up the continuous images and use only some of the frames as frames to be compared in the blood collection frame selection process.
[0051] In the above embodiment, a fixed camera (fixed photographing means) is connected to each blood sampling stand terminal 7, but a fixed camera may be connected to only some of the blood sampling stand terminals 7. Also, in the above embodiment, blood sampling reference images for all blood sampling operations are stored, but blood sampling reference images may be stored only for some patients (such as patients from whom blood sampling is difficult).
[0052] In the above embodiment, one frame is cut out from the continuous images as a blood sampling reference image and stored, but the blood sampling reference image may be a plurality of frames. In addition, if the continuous images are a video, the blood sampling reference image may be cut out as a video with a short playback time.
[0053] In addition, in the above embodiment, continuous image capture is started when the sensor detects that the patient's arm has been placed on the blood collection stand, and continuous image capture is stopped when the sensor detects that the patient's arm has been removed from the blood collection stand, but the start and end of continuous image capture may also be triggered by the blood collection worker's instructions (switch operation or voice instruction).
[0054] Furthermore, the blood collection operation support system of the present invention is not limited to the system configuration of the above embodiment, and can be modified as appropriate. For example, the blood collection operation support system of the present invention may be a system that supports at least blood collection operations, and may also serve as a system that supports testing operations (urinalysis, electrocardiogram, and X-ray operations) other than blood collection operations. [Explanation of symbols]
[0055] 1. Business management server 2 Database (blood sampling record storage means) 3 Reception terminal 4 Reception ticket printer 5 Blood collection tube preparation device 6 Guidance display device 7 Blood collection station terminal (blood collection information display means) 10 Display screen
Claims
1. A program for causing a computer to function as a means for extracting a blood sampling reference image that allows confirmation of a puncture site from a series of images obtained by photographing a patient's arm in color by a fixed photographing means during a blood sampling operation, comprising: The computer, a means for extracting, from the plurality of frames constituting the continuous image, a frame capturing an image of the patient's arm placed on a blood sampling stand before puncturing, as a comparison source frame; A means for measuring the number of pixels in a predetermined color gamut for the comparison source frame; a means for measuring the number of pixels in the predetermined color gamut for some or all of the frames other than the comparison source frame that constitute the continuous image, and selecting a frame in which the number of pixels is increased by a predetermined degree compared to the number of pixels in the comparison source frame; A program to make it function as such.
2. a blood sampling record storage means for storing a blood sampling record relating to the blood sampling performed in association with identification information of a patient; a blood collection information display means that is installed on the blood collection stand and is configured to be able to display past blood collection records of a patient from whom blood is collected to a blood collection worker working at the blood collection stand; A blood collection operation support system comprising: a fixed photographing means configured to be able to photograph the arm of a patient during a blood sampling operation; a computer having the program according to claim 1 installed therein and capable of executing a process for extracting a blood sampling reference image capable of confirming the puncture site from the continuous images of the patient's arm during blood sampling taken by the fixed photographing means; Equipped with The blood collection operation support system is characterized in that the blood collection record may include the blood collection reference image.
3. A first step of continuously photographing the patient's arm during blood collection using a fixed photographing means; a second step of extracting a blood collection reference image capable of confirming the puncture site from the continuous images obtained in the first step; a third step in which the blood sampling record storage means stores the blood sampling reference image in association with identification information of the patient; a fourth step of displaying a reference image of blood drawn from a patient in the past stored in the blood drawing record storage means to a blood drawing operator who draws blood from the patient; A blood collection operation support method comprising: The second step comprises: A step of extracting, by a computer, a frame capturing an image of the patient's arm placed on a blood sampling stand before puncturing from the plurality of frames constituting the continuous image as a comparison source frame; A step in which a computer measures the number of pixels in a predetermined color gamut for the comparison source frame; a computer measures the number of pixels in the predetermined color gamut for some or all of the frames other than the comparison source frame that constitute the continuous image, and selects frames in which the number of pixels is increased by a predetermined degree compared to the number of pixels in the comparison source frame; A blood collection operation support method comprising:
Citation Information
Patent Citations
High energy CT for radiation treatment
JP1984000076A
Blood sampling work support system
JP2008097179A
