Caudal vein injection system, caudal vein injection method, and program
By designing the tail vein injection system, the coordination of the calculation unit and the adjustment unit is used to solve the puncture problem caused by the small tail vein of rats, precise puncture of the small tail vein is achieved, and the ease of use and efficiency of the injection system is improved.
Patent Information
- Application Number
- CN202380024015.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-02
- Filing Date
- 2023-02-27
- Publication Date
- 2024-11-08
AI Technical Summary
The existing tail vein injection technology is difficult to apply to the tail vein of rats because the tail vein of rats is thinner in diameter, and traditional human arm vascular puncture technology is difficult to effectively puncture.
A tail vein injection system was designed, and the calculation unit and the adjustment unit were used to calculate the tail vein position by taking the tail image, and the position and posture of the injection needle were adjusted through the position adjustment mechanism above 5 axis to ensure that the injection needle could accurately pierce the fine tail. vein.
It is easy to puncture the rat tail vein with thinner blood vessels than the human body, which improves the accuracy and effectiveness of the injection system.
Smart Images

Figure CN118922149A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to a tail vein injection system, a tail vein injection method, and a procedure. Background Technology
[0002] Animal experiments play a vital role in many fields, including biochemistry and drug discovery. In particular, laboratory mice are widely used as experimental animals. When performing punctures on mice, tail vein injections are sometimes administered.
[0003] As a related technology for puncturing blood vessels in the human arm, an automated injection device is known, wherein the characteristic shape of the blood vessel portion in the first and second images captured by the first and second cameras is represented by a first-order linear equation, and an actuator is controlled to make the syringe puncture the blood vessel (see, for example, Patent Document 1).
[0004] [Cited Documents]
[0005] [Patent Documents]
[0006] [Patent Document 1] Japanese Patent Application Publication No. 2019-030570 Summary of the Invention
[0007] [Technical problem to be solved]
[0008] However, for example, the diameter of a rat's tail vein is about 300 μm, which is about 1 / 10 the diameter of a blood vessel in a human arm. Therefore, the human arm blood vessel puncture technique described in Patent Document 1 is sometimes difficult to apply to tail vein injection.
[0009] One embodiment of this disclosure provides a tail vein injection system that facilitates tail vein puncture.
[0010] [Technical Solution]
[0011] One embodiment of the tail vein injection system disclosed herein includes: a calculation unit that calculates the position of the tail vein based on an image obtained by photographing the tail; and an adjustment unit that adjusts the position and posture of the injection needle using a position adjustment mechanism.
[0012] [Beneficial Effects]
[0013] According to one embodiment of this disclosure, a tail vein injection system that facilitates tail vein puncture can be provided. Attached Figure Description
[0014] [ Figure 1 A schematic diagram of a tail vein injection system according to one embodiment.
[0015] [ Figure 2A A schematic diagram of a tail vein injection method according to one embodiment (1).
[0016] [ Figure 2B ] Schematic diagram of a tail vein injection method according to one embodiment (2).
[0017] [ Figure 3 [A schematic diagram of an embodiment of a bending clamp and a retaining fixing part.]
[0018] [ Figure 4 [A schematic diagram of an example of the configuration of the clamping part in one embodiment.]
[0019] [ Figure 5 [A schematic diagram illustrating the functional configuration of an information processing apparatus according to one embodiment.]
[0020] [ Figure 6A [Illustrative diagram (1) of one embodiment of tail vein detection processing]
[0021] [ Figure 6B [Illustrative diagram (2) of one embodiment of tail vein detection processing.]
[0022] [ Figure 7A [Illustrative diagram (1) of the detection process of the needle of a syringe according to one embodiment.]
[0023] [ Figure 7B [Illustrative diagram (2) of the detection process of the needle of a syringe according to one embodiment.]
[0024] [ Figure 8 A flowchart of the processing flow of a tail vein injection system according to one embodiment.
[0025] [ Figure 9 A flowchart illustrating the computational processing of one implementation method.
[0026] [ Figure 10 [Illustrative diagram (1) of the calculation process of one embodiment.]
[0027] [ Figure 11 [Illustrative diagram (2) of the calculation process of one embodiment.]
[0028] [ Figure 12 [Illustrative diagram (3) of the calculation process of one embodiment.]
[0029] [ Figure 13 [Illustrative diagram (4) of the calculation process of one embodiment.]
[0030] [ Figure 14 [Illustrative diagram (5) of the calculation process of one embodiment.]
[0031] [ Figure 15 [Illustrative diagram of the hardware configuration of an information processing apparatus according to one embodiment.] Detailed Implementation
[0032] The embodiments of the present invention will now be described in detail with reference to the accompanying drawings. In the following description, common parts in the figures are given the same symbols and their descriptions are omitted. Furthermore, for ease of understanding, the proportions of the components in the figures may differ from the actual proportions. The X-axis, Y-axis, and Z-axis directions respectively include directions parallel to the X-axis, parallel to the Y-axis, and parallel to the Z-axis. The X-axis, Y-axis, and Z-axis directions are orthogonal to each other. It should be noted that in the following description, for example, errors that do not affect the effectiveness of the present invention are permitted in the use of terms such as parallel, orthogonal, up and down, left and right, and direction.
[0033] <System Composition>
[0034] Figure 1 This is a schematic diagram of a tail vein injection system according to one embodiment. The tail vein injection system 1 includes, for example, a position adjustment mechanism 10 with 5 or more axes, a first camera 20a, a second camera 20b, a holding and fixing device 30 for holding and fixing a mouse, a fixing device (fixer) 40 for holding the tail 41 of a mouse, a syringe 50, an information processing device 100, etc.
[0035] The position adjustment mechanism 10 is, for example, a robot with six degrees of freedom (6 axes): a first degree of freedom 11 in the X-axis direction, a second degree of freedom 12 in the Y-axis direction, a third degree of freedom 13 in the Z-axis direction, a fourth degree of freedom 14 around the X-axis, a fifth degree of freedom 15 around the Y-axis, and a sixth degree of freedom 16 around the Z-axis. Using these six degrees of freedom, the position adjustment mechanism 10 can, for example, move the syringe 50 or the needle of the syringe 50 (hereinafter referred to as the injection needle) to any position and direction according to control from the information processing device 100.
[0036] It should be noted that, regarding the fourth degree of freedom (DOF) 14 around the X-axis out of the six degrees of freedom, for example, position alignment can be achieved when the syringe 50 is mounted on the position adjustment mechanism 10 (or when the injection needle is mounted on the syringe 50). In this case, as long as the position adjustment mechanism 10 has five or more degrees of freedom, it can move the syringe 50 or the injection needle to any position and direction. Accordingly, even blood vessels in the tail of a mouse, which are thinner than those in the human body, can be punctured more appropriately. Furthermore, in addition to the direction of tail extension, puncture can also be performed in a direction perpendicular to the cross-section (section / cross-section) of the tail. Accordingly, puncture can be performed appropriately.
[0037] The first camera 20a and the second camera 20b are cameras that take pictures (photographs) of the tail 41 from different directions. The first camera 20a and the second camera 20b are preferably visible light cameras. As for the tail 41 of a mouse or the like, the skin is thinner than the skin of a human arm or the like, so it has the characteristic that the tail vein can be easily detected even in the visible light range.
[0038] The restraint device (restraint part) 30 is used to restrain (restrain) a mouse or similar animal that is the recipient of tail vein injection during the administration of tail vein injection, so as to keep it immobile. It should be noted that the animal receiving tail vein injection is not limited to mice; for example, it can be other animals such as rats, guinea pigs, gerbils, hamsters, and ferrets. Here, as an example, the following explanation will be given using a mouse as the recipient of tail vein injection.
[0039] The fixation device 40, for example having a straight portion and a curved portion, is a fixation device (clamp) for holding the tail 41. The syringe 50 is a syringe used for puncturing (inserting) the tail vein. Here, puncture refers to inserting an injection needle from outside the body into a blood vessel or the like to collect bodily fluids or tissues or inject drugs, etc.
[0040] The information processing device 100, for example, has a computer configuration and controls the position adjustment mechanism 10 with 5 or more axes, the first camera 20a, the second camera 20b, etc., by executing a predetermined program.
[0041] It should be noted that, Figure 1 The tail vein injection system 1 shown is an example. For example, the tail vein injection system 1 may also be a tail vein injection device built into (embedded / implanted) a single device. In addition, the tail vein injection system 1 may also have three or more cameras capable of capturing images of the tail 41.
[0042] <Overview of Tail Vein Injection Method>
[0043] Figure 2A and Figure 2B This is a schematic diagram of a tail vein injection method according to one implementation. Figure 2A As shown, the fixing device 40 has a straight portion 201 and a curved portion 202. The straight portion 201 holds a portion of the tail 41 in a straight line, while the curved portion 202 holds the other portion of the tail 41 with a curvature higher than that of the straight portion.
[0044] The information processing device 100 uses cameras (first camera 20a, second camera 20b, etc.) to capture images of the tail 41 held by the fixation device 40, and calculates the 3D position of two points on the tail vein 203 based on the captured images. For example, the information processing device 100 calculates the 3D position of point 204, which serves as the puncture point, and point 205, which serves as the puncture termination point, within the straight section of the tail 41 held by the straight section 201. Furthermore, the information processing device 100 uses a position adjustment mechanism 10 with 5 or more axes to align the position of the injection needle 207 on the line (straight line) 206 passing through points 204 and 205.
[0045] Accordingly, in the tail vein injection system 1 of this embodiment, such as Figure 2B As shown, the injection needle 207 is inserted along line 206 passing through points 204 and 205. For example, in the tail vein injection system 1, point 204 is used as the puncture point and point 205 is used as the puncture end point, and puncture is performed therefrom.
[0046] In the prior art, vascular puncture is performed at an angle. Therefore, after the injection needle 207 reaches the blood vessel, if the needle 207 is further advanced, there is a risk of puncturing the blood vessel. However, in the tail vein injection system 1 of this embodiment, as... Figure 2B As shown, after the injection needle 207 reaches the tail vein 203, it can be further advanced, thus making it easy to puncture the tail vein of animals such as mice, which are thinner than human blood vessels.
[0047] It should be noted that the puncture action of inserting the injection needle 207 into the tail vein 203 can be performed by the tail vein injection system 1 using an actuator or by the user.
[0048] <Composition of Fixtures and Retaining Fixtures>
[0049] Figure 3 This is a schematic diagram illustrating an example of the configuration of a fixing device and a retaining device in one embodiment. Figure 3 In the example, the fixing device 40, the retaining fixing device 30, the clamping part 320, etc. are mounted on the base 300, which serves as a base.
[0050] The retainer (retaining part) 30 has a cylindrical shape with an opening in front of the mouse, so that the mouse can be inserted into the retainer 30 through the opening 301 by facing the front of the mouse's head. The upper wall (upper wall) 302 of the retainer 30 is provided with a slit 303 through which the mouse's tail 41 can pass, thereby making it easy to set the mouse's tail 41 onto the retainer 40.
[0051] Furthermore, the upper wall 302 of the retainer 30 is inclined, so that the height of the retainer 30 gradually decreases from front to back. Accordingly, the retainer 30 can not only inhibit the mouse's hind legs from kicking the wall, but also hold the mouse's buttocks. In addition, by providing an opening 301 at the front of the retainer 30, the mouse's tail 41 can be extended more fully as the mouse attempts to escape through the opening 301.
[0052] The fixation device 40 has a blood-dripping band 311, which can fix the tail 41 and dilate the tail vein.
[0053] Furthermore, the restraint device 40 has a groove 312 for the tail to crawl through, and the groove 312 of the straight section 201 has a hole 313 for attracting the tail 41 and illuminating it with light. For example, by connecting a suction pump to the suction port 314 and operating it, a portion of the tail 41 can be attracted into the hole 313 provided on the straight section 201 of the restraint device 40, thereby holding the tail 41 in a straight position. In addition, by illuminating a light source provided inside the restraint device 40, light can be illuminating it through the hole 313, thereby making it easy to detect the tail vein from the images captured by the first camera 201a or the second camera 201b.
[0054] <Composition of the clamping part>
[0055] The clamping part 320 has, for example, as shown in the figure. Figure 4 The structure shown. Figure 4 This is a schematic diagram illustrating an example of the configuration of the clamping part in one embodiment. Figure 4 In the example, the clamping part 320 has two rollers 401 and 411 that hold the tail tip 400 of the tail part 41. The roller 401 is mounted on a shaft 402 fixed to the base 300 and has a one-way clutch 403 that transmits rotational force in only one direction.
[0056] Roller 411 is mounted on movable arm 413 via shaft 412, and movable arm 413 is mounted on base 300 via shaft 414. Roller 411, similar to roller 401, has a one-way clutch 416. Furthermore, roller 411 utilizes the elastic force of spring 415 mounted on movable arm 413 to move movable arm 413, thereby enabling the holding and release of tail tip 400. Additionally, the clamping part 320 is configured such that when the mouse pulls its tail 41 in the direction of the arrow, the above configuration increases the holding force for holding tail tip 400.
[0057] Functional Composition of Information Processing Devices
[0058] The information processing device 100 has a computer-like structure, and by executing a predetermined program on the computer, it can realize the image acquisition unit 501, detection unit 502, calibration unit 503, storage unit 504, calculation unit 505, adjustment unit 506, puncture unit 507, etc. It should be noted that at least some of the above-mentioned functional components can also be implemented by hardware.
[0059] The image acquisition unit 501 controls, for example, the first camera 20a and the second camera 20b to photograph the object and acquire the captured images. For example, the image acquisition unit 501 acquires a first image obtained by photographing the straight portion of the tail 41 by the first camera 20a and a second image obtained by photographing the straight portion of the tail 41 by the second camera 20b. It should be noted that in the following description, when referring to either the first camera 20a or the second camera 20b, it is referred to as "camera 20" (note: " " is equivalent to ""). Camera 20 is preferably a visible light camera.
[0060] The detection unit 502 detects the tail vein 203, injection needle 207, etc., based on the image acquired by the image acquisition unit 501. Preferably, the detection unit 502 detects the tail vein 203, injection needle 207, etc., within the visible light range.
[0061] Figure 6A An example of an image captured by camera 20 of the tail 41 held by the fixing device 40 is shown. The fixing device 40 of this embodiment has a hole 313 for attracting the tail 41 and illuminating it with light; therefore, as... Figure 6A As shown, the tail 41 can be kept in a straight position by suction. In addition, the tail 41 of a mouse is thin enough compared to a human arm, for example, so the tail vein 203 can be detected from an image captured by a visible light camera by visible light emanating from the hole 313 of the fixation device 40.
[0062] For example, the detection unit 502 uses the darkest point in the image captured by the visible light camera as a candidate for the tail vein 203, and performs linear fitting on the candidate to detect the tail vein 203. When the tail vein 203 in the image is represented by ax+b, this process can be represented by the following formula (1).
[0063] [Formula 1]
[0064]
[0065] In formula (1), I(x, y) represents the brightness (luminance) of the pixel at pixel (x, y). It should be noted that when the image is represented by RGB colors, the tail vein 203 is represented as a darker region in both the R (Red) and G (Green) channels. Therefore, the detection unit 502 can perform linear fitting on the R and G channels respectively, and use the detection result from the channel with fewer outliers (abnormal values).
[0066] Figure 6B An example is shown of an image obtained by camera 20 of the tail 41 without it being attracted by the restraint device 40. This demonstrates that, without attraction, the mouse's tail 41 remains as... Figure 6B The tail 41 has become bent. Therefore, it is difficult to keep the tail 41 straight without suction. In addition, light will leak from the hole 313 in this case, making the tail vein 203 unclear and difficult to detect.
[0067] However, the fixation device 40 of this embodiment has a hole 313 for attracting the tail 41 and irradiating light, which makes it easy to keep the tail 41 in a straight line and easy to detect the tail vein with a visible light camera.
[0068] Figure 7A An example of an image obtained by taking a picture of the injection needle 207 using camera 20 is shown. Figure 7A As shown, regarding the injection needle 207, the needle tip is difficult to detect from the image due to the specular reflection of the metal surface. In this case, as... Figure 7B As shown, it is effective to backlight the injection needle 207 and detect it as a dark silhouette. However, from a space and cost perspective, it is sometimes not advisable to set up backlights with sufficient brightness for both the first camera 20a and the second camera 20b to backlight the injection needle 207.
[0069] Therefore, in this embodiment, the backpanel serving as the background for the injection needle 207 is covered with a phosphor (fluorescent material), and ultraviolet light is irradiated from the camera 20 side, thereby achieving a thin backpanel with uniform brightness. The ultraviolet light irradiated from the camera 20 side causes the phosphor-covered backpanel to emit light within the visible light range without affecting the image captured by the camera 20. Accordingly, the detection unit 502 can easily detect, for example, from... Figure 7B The image shown detects the tip 701 of the injection needle 207.
[0070] It should be noted that, in the case of an infrared camera as in the prior art, since phosphors that emit light in the infrared range are not common, it is difficult to achieve a similar configuration at the same cost.
[0071] Here, return Figure 5 The functional configuration of the information processing device 100 will continue to be explained. The calibration unit 503 performs a first calibration process (overall calibration) to calibrate (correct) any two or more of the following: camera parameters of the camera 20, fixture 40, position adjustment mechanism 10, and position of needle tip 701 of injection needle 207. In addition, when the syringe 50 or injection needle 207 is replaced, the calibration unit 503 also performs calibration on fewer components than the first calibration process, including the position of needle tip 701 of injection needle 207, thereby performing a second calibration process (needle tip calibration) that allows for recalibration.
[0072] Here, an example of how the calibration unit 503 calibrates the camera parameters of the camera 20, the position of the position adjustment mechanism 10, and the position of the needle tip 701 of the injection needle 207 will be described.
[0073] In order for the injection needle 207 to correctly puncture the tail vein 203 of a mouse with a diameter of approximately 0.3 mm, it is necessary to correctly calibrate the system parameters such as the position of the needle tip 701 of the injection needle 207 relative to the position adjustment mechanism 10 and the camera parameters. In this embodiment, this calibration process is referred to as the first calibration process. However, since the syringe 50 or the injection needle 207 needs to be replaced after each puncture, it is not ideal to perform the first calibration process every time a puncture is performed, from a time perspective.
[0074] Therefore, the calibration unit 503 in this embodiment is configured to recalibrate when the syringe 50 or injection needle 207 is replaced, by calibrating the position of the needle tip 701 of the injection needle 207 relative to the position adjustment mechanism 10. In this embodiment, this calibration process is referred to as the second calibration process.
[0075] In the first calibration process, the calibration unit 503 controls the position adjustment mechanism 10 to move the position of the needle tip 701 of the injection needle 207 little by little, and uses the camera 20 to take pictures of the needle tip 701. Then, the entire system is calibrated by solving the optimization problem of formula (2).
[0076] [Formula 2]
[0077]
[0078] In formula (2), c represents the camera parameters of camera 20, for example, the position and viewing angle (lens parameters, etc.) of the first camera 20a or the second camera 20b. H represents the position of the position adjustment mechanism 10 (e.g., the position of the origin). q represents the location of the needle tip 701 of the injection needle 207 when observed from the position of the position adjustment mechanism 10. The function f is a function that uses the camera parameters c to transform points in 3D space into pixels in the image of camera 20. p represents the position of the needle tip 701 in the image of camera 20.
[0079] The calibration unit 503 solves the optimization problem of formula (2) to minimize the difference between the position of the needle tip 701 on the image of the camera 20 represented by p and the position of the needle tip 701 transformed by the function f(), thereby performing the calibration process of the entire system (first calibration process).
[0080] In the second calibration process, the calibration unit 503 calibrates only q, which represents the position of the needle tip 701 relative to the position adjustment mechanism 10. This second calibration process can be performed, for example, by setting the position adjustment mechanism 10 to the home position and taking one set of images using the first camera 20a and the second camera 20b. Therefore, the processing time can be significantly reduced compared to the first calibration process.
[0081] The storage unit 504 stores, for example, the camera parameters c of the first camera 20a and the second camera 20b obtained by the calibration unit 503, the position H of the position adjustment mechanism 10, and the position q of the needle tip 701 relative to the position adjustment mechanism 10.
[0082] The calculation unit 505 performs a calculation process to determine the 3D position of two points on the tail vein 203 based on an image obtained by the camera 20 from the tail 41. The calculation unit 505 calculates the 3D position of the two points on the tail vein based on images obtained by capturing the tail under at least one different condition in position and orientation. For example, the calculation unit 505 uses a first image captured by the first camera 20a and a second image captured by the second camera 20b to... Figure 2A The 3D positions of points 204 and 205 as described are calculated. It should be noted that the specific processing details of the calculations performed by the calculation unit 505 will be described in detail later with reference to the flowchart and accompanying drawings.
[0083] The adjustment unit 506 uses a position adjustment mechanism with five or more axes to perform adjustment processing to adjust the position and posture of the injection needle. For example, the adjustment unit 506 is as follows: Figure 2AAs described, the position adjustment mechanism 10 with 5 or more axes is used to align the position of the injection needle 207 with the line 206 passing through points 204 and 205, which is calculated by the calculation unit 505. The adjustment unit 506 can accurately grasp the position of the needle tip 701 of the injection needle 207 by using the calibration results of the calibration unit 503 and using the first image captured by the first camera 20a and the second image captured by the second camera 20b. Therefore, the adjustment unit 506 acquires the first and second images, and while confirming the position of the needle tip 701, controls the position adjustment mechanism 10 to gradually change the posture of the syringe 50, thereby aligning the position of the injection needle 207 with the line 206 passing through points 204 and 205.
[0084] Puncture site 507 Figure 2B The injection needle 207 is inserted along line 206 passing through points 204 and 205. For example, the puncture section 507 uses point 204 as the puncture point and point 205 as the puncture end point to perform the puncture.
[0085] It should be noted that in the tail vein injection system 1 of this embodiment, the puncture section 507 can have various configurations. For example, the tail vein injection system 1 can perform the process up to aligning the injection needle 207 on the line 206 passing through points 204 and 205, and the puncture process can be performed by a person (user)'s hand, for example. In this case, the information processing device 100 may not have the puncture section 507.
[0086] Furthermore, the puncture site 507 can also detect the pressure of the injected medication after puncture and control the injection of medication based on the detected pressure. For example, if the injection needle 207 does not correctly pierce the tail vein 203, the pressure will be too high. The puncture site 507 can utilize this feature to stop the puncture when the pressure exceeds a threshold. Alternatively, if the injection needle 207 has pierced the tail vein 203, pulling the plunger of the syringe 50 will draw blood into the syringe 50. The puncture site 507 can also utilize this feature to determine whether the injection needle 207 has pierced the tail vein 203 based on the image.
[0087] As described above, in the tail vein injection system 1 of this embodiment, as long as the process of aligning the position of the injection needle 207 on the line 206 passing through points 204 and 205 is performed, the puncture part 507 can be configured arbitrarily.
[0088] <Processing Flow>
[0089] Next, the processing flow of the tail vein injection method of this embodiment will be described.
[0090] (Management of the tail vein injection system)
[0091] Figure 8 This is an illustrative flowchart of a tail vein injection system according to one embodiment. The process is illustrated, for example, in... Figure 1 An example of the processing performed by the information processing device 100 in the tail vein injection system 1 shown.
[0092] In step S801, the calibration unit 503 of the information processing device 100 performs a first calibration process, for example, to calibrate the camera parameters of the first camera 20a and the second camera 20b, the position of the position adjustment mechanism 10, and the position of the needle tip 701 of the injection needle 207. For example, as described above, the calibration unit 503 controls the position adjustment mechanism 10 to move the position of the needle tip 701 of the injection needle 207 little by little, and uses the camera 20 to take a picture of the needle tip 701, and then solves the optimization problem of formula (2), thereby calibrating the entire system.
[0093] In step S802, the calculation unit 505 of the information processing device 100 performs calculation processing to calculate the 3D positions of points 204 and 205 using the first image captured by the first camera 20a and the second image captured by the second camera 20b. It should be noted that the specific processing details will be explained later in conjunction with... Figures 9-14 To elaborate further.
[0094] In step S803, the adjustment unit 506 of the information processing device 100, as follows: Figure 2A As described in the text, the position adjustment mechanism 10 with 5 or more axes is used to align the position of the injection needle 207 on the line 206 passing through the points 204 and 205 calculated by the calculation unit 505.
[0095] In step S804, the puncture section 507 of the information processing device 100 is as follows: Figure 2B The injection needle 207 is inserted into the tail vein 203 along the line 206 passing through points 204 and 205. For example, the puncture section 507 uses point 204 as the puncture point and point 205 as the puncture end point to perform the puncture.
[0096] In step S805, the information processing device 100 determines whether to perform another puncture. If the next puncture is to be performed, the information processing device 100 proceeds to step S806. Conversely, if the next puncture is not performed, the information processing device 100 terminates the process. Figure 8 The processing.
[0097] After proceeding to step S806, the information processing device 100 determines whether the injection needle 207 (or syringe 50) has been replaced. If the injection needle 207 has been replaced, the information processing device 100 proceeds to step S807. On the other hand, if the injection needle 207 has not been replaced, the information processing device 100 returns the process to step S802.
[0098] As another example, if the injection needle 207 is not replaced, the information processing device 100 displays a message prompting for the replacement of the injection needle 207 and pauses processing until the injection needle 207 is replaced. It should be noted that the information processing device 100 can determine whether the injection needle 207 has been replaced by user input operations or by images captured by the camera 20.
[0099] After entering step S807, the calibration unit 503 of the information processing device 100 performs a second calibration process to calibrate the position of the needle tip 701 of the injection needle 207 relative to the position adjustment mechanism 10. After the calibration is completed, the process returns to step S802.
[0100] Through the above treatment, the tail vein injection system 1 is as follows: Figure 2A and Figure 2B As described, tail vein puncture can be performed easily. Furthermore, even with the need to change the injection needle 207 or syringe 50 for each puncture and to perform multiple punctures, the tail vein injection system 1 significantly reduces the time required for calibration.
[0101] (Calculation Processing)
[0102] Figure 9 This is an example flowchart illustrating the computational process of one implementation method. The process is shown in... Figure 8 This is an example of the computational processing performed by the computing unit 505 of the information processing device 100 in step S802.
[0103] It should be noted that, in the first or second calibration process, the camera parameters of the first camera 20a and the second camera 20b are known. Furthermore, it should be noted that these camera parameters include, for example, the position and orientation of the first camera 20a and the second camera 20b, focal distance (focal length), optical center, distortion correction parameters, etc. Additionally, the positional relationship between the fixing device 40 and the first camera 20a and the second camera 20b is fixed.
[0104] In step S901, the calculation unit 505 uses the first image captured by the first camera 20a to determine the puncture position and the puncture end position.
[0105] As a preferred example, such as Figure 10As shown, the fixing device 40 is marked with a first mark 1001a and a second mark 1001b for positioning. The fixing device 40 is photographed using the first camera 20a, as shown... Figure 10 As shown, an image 1002 can be obtained by taking pictures of the first mark 1001a and the second mark 1001b on the fixing device 40.
[0106] For example, the calculation unit 505 determines the position of the first mark 1001a in the X-axis direction in image 1002 as the puncture position c1x1. Furthermore, the calculation unit 505 determines the puncture end position c1x2 in the X-axis direction based on the distance to the puncture end point. For example, if the distance between the first mark 100a and the second mark 1001b is D, and the distance to the puncture end point is set to d, the calculation unit 505 determines the puncture end position c1x2 as the position d / D along the X-axis direction from the puncture position c1x1.
[0107] In step S902, the calculation unit 505 uses the first image captured by the first camera 20a to determine the first and second points on the tail vein. For example, as Figure 11 As shown, the computing unit 505 acquires a first image 1102 by capturing the tail 41 of the mouse 1101 with the image acquisition unit 501 while the tail 41 of the mouse 1101 is fixed to the restraint device 40. Furthermore, the computing unit 505 uses the detection unit 502 to detect the tail vein 203 from the first image 1102. Additionally, the computing unit 505 designates the intersection point (intersection point) of the puncture position c1x1 in the X-axis direction and the tail vein 203 in the first image 1102 as the first point c1p1, and the intersection point (intersection point) of the puncture termination position c1x2 in the X-axis direction and the tail vein 203 as the second point c1p2.
[0108] In step S903, the calculation unit 505 calculates the first epipolar line c2l1 and the second epipolar line c2l2 in the second image obtained by the second camera 20b capturing the tail 41. For example, as Figure 12 As shown, with the tail 41 of the mouse 1101 fixed to the fixing device 40, the calculation unit 505 uses the image acquisition unit 501 to acquire a second image 1201 obtained by the second camera 20b capturing the tail 41. Furthermore, the calculation unit 505 calculates the first polar line c2l1 connecting the first camera 20a and the first point c1p1 in the second image 1201.
[0109] The straight line connecting the first camera 20a and the first point c1p1 is projected onto the second camera 20b as a straight line. This straight line is called the epipolar line. Since the coordinates of the first point c1p1 are unknown, it can be known that the first point c1p1 captured by the first camera 20a lies on the first epipolar line c2l1.
[0110] Similarly, the calculation unit 505 calculates the second polar line c2l2 connecting the first camera 20a and the second point c1p2 in the second image 1201.
[0111] In step S904, as Figure 13 As shown, the calculation unit 505 calculates the third point c2p1 where the tail vein 203 intersects with the first polar line c2l1 and the fourth point c2p2 where the tail vein 203 intersects with the second polar line c2l2 in the second image 1201.
[0112] In step S905, the calculation unit 505 calculates the 3D positions of the third point c2p2 and the fourth point. The first point c1p1 in the first image 1102 and the third point c2p1 in the second image 1201 represent the same point (e.g., Figure 14 Point p1). Therefore, the calculation unit 505 can calculate the three-dimensional coordinates (x1, y1, z1) of point p1 by using the camera parameters of the first camera 20a and the second camera 20b, as well as the first image 1102 and the second image 1201, and by employing, for example, a known triangulation method. It should be noted that this point p1 is related to... Figure 2A Point 204 corresponds to.
[0113] Similarly, point c1p2 in the first image 1102 and point c2p2 in the second image 1201 represent the same point (e.g., Figure 14 Point p2). Therefore, the calculation unit 505 calculates the three-dimensional coordinates (x2, y2, z2) of point p2 using camera parameters from the first camera 20a and the second camera 20b, as well as from the first image 1102 and the second image 1201, and employing methods such as known triangulation. It should be noted that this point p2 is related to... Figure 2A Point 205 corresponds to.
[0114] Through the above processing, the information processing device 100 is able to calculate two points on the tail vein 203 (e.g., Figure 2A The 3D positions of points 204 and 205.
[0115] <Composition of Information Processing Devices>
[0116] The information processing apparatus 100 described in the above embodiments may be partially or entirely constructed in hardware, or it may be constructed by information processing of software (programs) executed by a CPU (Central Processing Unit), GPU (Graphics Processing Unit), or the like. In the case of software-based information processing, the software used to implement at least a portion of the functions of the information processing apparatus 100 described in the above embodiments may be stored in a non-transitory storage medium (non-transitory computer-readable medium) such as a CD-ROM (Compact Disc-Read Only Memory) or USB (Universal Serial Bus) memory, and can be executed by reading it into a computer. Furthermore, the software may also be downloaded via a communication network. Additionally, by implementing all or part of the software processing into a circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array), the information processing of the software can also be executed in hardware.
[0117] The storage medium used to store the software can be a removable storage medium such as an optical disc, or a fixed storage medium such as a hard disk or a memory device. Furthermore, the storage medium can be located inside the computer (main storage device, auxiliary storage device, etc.) or outside the computer.
[0118] Figure 15 This is a functional block diagram illustrating an example of the hardware configuration of the information processing device 100 described above. As an example, the information processing device 100 includes a processor 71, a main storage device 72 (memory), an auxiliary storage device 73 (memory), a network interface 74, and a device interface 75. These components can be implemented as a computer 7 connected via a bus 76.
[0119] Figure 15 In a computer 7, although each component may have only one instance, it can also have multiple identical components. Furthermore, Figure 15Although only one computer 7 is shown in the diagram, it is also possible to install the software on multiple computers and have each computer execute the same or different parts of the software. In this case, the computers can be distributed computing systems that communicate and process separately via a network interface 74 or the like. That is, the information processing apparatus 100 in the above embodiment can be configured as a system that performs functions by executing commands stored in one or more storage devices using one or more computers. Furthermore, it can also be configured to process information sent from a terminal using one or more computers located in the cloud and send the processing results back to the terminal.
[0120] The various operations of the information processing apparatus 100 in the above embodiments can be executed using one or more processors or in parallel using multiple computers connected via a network. Furthermore, various operations can also be distributed to multiple processing cores within the processor and executed in parallel. Additionally, some or all of the processing units, etc., of this disclosure can also be implemented using at least one of a processor and a storage device located in the cloud that can communicate with the computer 7 via a network. Thus, the apparatuses in the above embodiments can be in a form based on parallel computing using one or more computers.
[0121] The processor 71 can be an electronic circuit (processing circuit, processing circuitry, CPU, GPU, FPGA, ASIC, etc.) capable of at least one of the following: computer control and computation. Furthermore, the processor 71 can also be a general-purpose processor, a dedicated processing circuit designed to perform specific operations, or a semiconductor device that includes both general-purpose processors and dedicated processing circuits. Additionally, the processor 71 can be a processor including optical circuitry, or a processor including quantum computing-based computational functions.
[0122] The processor 71 can perform calculations based on data and software input from various devices internally configured in the computer 7, and can also output the calculation results and control signals to the various devices. By executing the operating system (OS) and applications of the computer 7, the processor 71 can control the various components constituting the computer 7.
[0123] The information processing device 100 in the above embodiments can be implemented by one or more processors 71. Here, processor 71 can refer to one or more electronic circuits configured on a single chip, or it can refer to one or more electronic circuits configured on two or more chips or two or more devices. When using multiple electronic circuits, each electronic circuit can communicate via wired or wireless means.
[0124] The main storage device 72 can store commands executed by the processor 71, various data, etc., and the information stored in the main storage device 72 can also be read by the processor 71. The auxiliary storage device 73 is a storage device other than the main storage device 72. It should be noted that these storage devices can be any electronic component capable of storing electronic information, or they can be semiconductor memories. Semiconductor memories can be either volatile memories or non-volatile memories. The storage devices for storing various data in the information processing apparatus 100 in the above embodiment can be implemented by the main storage device 72 or the auxiliary storage device 73, or they can be implemented by the built-in memory built into the processor 71. For example, the storage unit 504 in the above embodiment can be implemented by the main storage device 72 or the auxiliary storage device 73.
[0125] In the above-described embodiment, when the information processing apparatus 100 comprises at least one storage device (memory) and at least one processor connected (coupled) to the at least one storage device, the storage device may be connected to the at least one processor. Furthermore, the processor may also be connected to the at least one storage device. Additionally, at least one of a plurality of processors may include a configuration connected to at least one of a plurality of storage devices. Furthermore, this configuration may also be implemented using storage devices and processors included in a plurality of computers. Additionally, the storage device may include a configuration integrated with the processor (e.g., a cache including L1 cache and L2 cache).
[0126] Network interface 74 is an interface used to connect to communication network 8 wirelessly or via wired connection. Network interface 74 can use an appropriate interface conforming to existing communication standards. Information can be exchanged between network interface 74 and external device 9A connected via communication network 8. It should be noted that communication network 8 can be any one of WAN (Wide Area Network), LAN (Local Area Network), PAN (Personal Area Network), or a combination thereof, as long as it is a communication network capable of exchanging information between computer 7 and external device 9A. Examples of WAN include the Internet; examples of LAN include IEEE 802.11, Ethernet (registered trademark); and examples of PAN include Bluetooth (registered trademark), NFC (Near Field Communication), etc.
[0127] Device interface 75 is an interface such as USB that can be directly connected to an external device 9B.
[0128] External device 9A is a device connected to computer 7 via a network. External device 9B is a device directly connected to computer 7.
[0129] As an example, external device 9A or external device 9B can be an input device. The input device can be, for example, a camera, microphone, motion capture device, various sensors, keyboard, mouse, touchscreen, etc., which can provide the acquired information to computer 7. Alternatively, it can be a device such as a personal computer, tablet terminal, or smartphone that has an input unit, memory, and processor.
[0130] Furthermore, as an example, external device 9A or external device 9B can be an output device. The output device can be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) panel, or a speaker for outputting sound. Additionally, it can be a device with an output unit, memory, and processor, such as a personal computer, tablet computer, or smartphone.
[0131] Alternatively, external device 9A or external device 9B may also be a storage device (memory). For example, external device 9A may be a network memory, and external device 9B may be a storage unit such as an HDD.
[0132] Furthermore, external device 9A or external device 9B may also be a device having some of the functions of the constituent elements of the information processing apparatus 100 described above. That is, computer 7 may send part or all of the processing results to external device 9A or external device 9B, and may also receive part or all of the processing results from external device 9A or external device 9B.
[0133] As described above, according to this embodiment, a tail vein injection system 1 that is easy to perform tail vein puncture can be provided.
[0134] (Supplement)
[0135] In this specification (including the claims), the use of expressions such as "at least one of a, b, and c" or "at least one of a, b, or c" (including similar expressions) includes any one of a, b, c, ab, ac, bc, or abc. Furthermore, as shown in aa, abb, aabbcc, etc., any element may include multiple instances. Additionally, as shown in abcd, other elements besides the listed elements (a, b, and c) may be added, such as having d, etc.
[0136] In this specification (including the claims), when expressions such as "using data as input / using data / based on data / according to data / in response to data" (including similar expressions) are used, unless otherwise stated, this includes cases where the data itself is used and cases where the result of some processing of the data is used (e.g., the result after adding noise, the result after normalization, features extracted from the data, intermediate representations of the data, etc.). Furthermore, when expressions such as "obtaining a result by using data as input / using data / based on data / according to data / in response to data" (including similar expressions) are used, unless otherwise stated, this includes cases where the result is obtained solely from that data and cases where the result is obtained while also being influenced by other data, factors, conditions, and / or states besides that data. Additionally, when expressions such as "output data" are used, unless otherwise stated, this includes cases where the data itself is used as output and cases where the result of some processing of the data (e.g., the result after adding noise, the result after normalization, features extracted from the data, intermediate representations of the data, etc.) is used as output.
[0137] In this specification (including the claims), the use of terms such as "connected" and "coupled" is intended to include non-limiting terms such as direct connection / coupling, indirect connection / coupling, electrically connected / coupling, communicatively connected / coupling, operatively connected / coupling, and physically connected / coupling. These terms should be interpreted appropriately according to the context in which they are used; however, any form of connection / coupling that is not intentionally or naturally excluded should be non-limitingly interpreted as being included in the terminology.
[0138] In this specification (including the claims), when expressions such as "A is configured to execute B" are used, it may include situations where the physical structure of element A has a configuration that enables action B, and the permanent or temporary setting / configuration of element A is configured / set to actually execute action B. For example, when element A is a general-purpose processor, the processor may be configured to have a hardware configuration that enables action B, and action B may actually be executed by setting a permanent or temporary program (command). Furthermore, when element A is a dedicated processor, dedicated arithmetic circuit, etc., regardless of whether control commands and data are actually attached, the circuit structure of the processor, etc., only needs to be implemented to actually execute action B.
[0139] In this specification (including the claims), the use of terms indicating inclusion or possession (e.g., "comprising / including," "having," etc.) is intended to be open-ended, encompassing the inclusion or possession of things other than the object referred to by the term's object. Where the number of objects indicating inclusion or possession is not specified or is an expression implying singularity (expressions with the articles a or an (one / 1)), the expression should be interpreted as not limited to a specific number.
[0140] In this specification (including the claims), even if expressions such as "one or more" or "at least one" are used in one position, while expressions that do not specify a quantity or imply a singularity (expressions with the articles "a" or "an") are used in other positions, the latter expression does not necessarily mean "one". Generally speaking, expressions that do not specify a quantity or imply a singularity (expressions with the articles "a" or "an") should be interpreted as not necessarily limited to a specific number.
[0141] In this specification, where a specific configuration for a particular embodiment is described as providing a specific advantage / result, it should be understood, unless otherwise specified, that the same effect can also be obtained for one or more other embodiments having that configuration. However, it should be understood that the presence or absence of this effect generally depends on a variety of factors, conditions, and / or states, and the configuration does not necessarily guarantee that the effect will be obtained. The effect can only be obtained by the configuration described in the embodiment when various factors, conditions, and / or states are satisfied; furthermore, the effect is not necessarily obtained in the inventions for which the claims define that configuration or similar configurations.
[0142] In this specification (including the claims), the use of terms such as "maximize" should be interpreted appropriately according to the context in which the term is used, and may include solving for the global maximum, solving for an approximation of the global maximum, solving for a local maximum, and solving for an approximation of a local maximum. Furthermore, it may also include probabilistically or heuristically solving for approximations of these maximums. Similarly, the use of terms such as "minimize" should be interpreted appropriately according to the context in which the term is used, and may include solving for the global minimum, solving for an approximation of the global minimum, solving for a local minimum, and solving for an approximation of a local minimum. Furthermore, it may also include probabilistically or heuristically solving for approximations of these minimums. Similarly, the use of terms such as "optimize" should be interpreted appropriately according to the context in which the term is used, and may include solving for the global optimum, solving for an approximation of the global optimum, solving for a local optimum, and solving for an approximation of a local optimum. In addition, approximations of these optimal values may be obtained probabilistically or heuristically.
[0143] In this specification (including the claims), when a predetermined process is performed by multiple pieces of hardware, the hardware may work together to perform the predetermined process, or a portion of the hardware may perform all the predetermined processes. Alternatively, a portion of the hardware may perform a part of the predetermined process, while other hardware performs the remainder. In this specification (including the claims), when expressions such as "one or more pieces of hardware perform a first process, and the one or more pieces of hardware perform a second process" (including similar expressions) are used, the hardware performing the first process and the hardware performing the second process may be the same or different. That is, the hardware performing the first process and the hardware performing the second process need only be included in the one or more pieces of hardware. It should be noted that the hardware may include electronic circuits, devices containing electronic circuits, etc.
[0144] In this specification (including the claims), when data is stored by multiple storage devices (memories), each of the multiple storage devices may store only a portion of the data or store all of the data. Furthermore, some of the multiple storage devices may also include components for storing data.
[0145] The embodiments of this disclosure have been described in detail above; however, this disclosure is not limited to the various embodiments described above. Various additions, modifications, substitutions, partial deletions, etc., can be made without departing from the scope of the claims and the conceptual idea and spirit of the invention derived from their equivalents. For example, in the above embodiments, when numerical values or formulas are used for description, these are provided merely for illustrative purposes and do not limit the scope of this disclosure. Furthermore, the order of operations described in the embodiments is also merely illustrative and does not limit the scope of this disclosure.
[0146] This international application claims priority to Japanese Patent Application No. 2022-032006, filed with the Japan Patent Office on March 2, 2022, the contents of which are incorporated herein by reference in their entirety.
[0147] [Explanation of reference numerals in the attached figures]
[0148] 1. Tail vein injection system
[0149] 7 Computers
[0150] 10-position adjustment mechanism
[0151] 20a First Camera
[0152] 20b Second Camera
[0153] 30 Retaining and fixing device (retaining and fixing part)
[0154] 40 Fixtures
[0155] 41 tail
[0156] 50 syringes
[0157] 201 Straight Section
[0158] 202 Bend
[0159] Points 204 and 205 (2 points)
[0160] Line 206 (a straight line passing through two points)
[0161] 207 injection needle
[0162] 505 Computing Department
[0163] 506 Adjustment Department
[0164] 507 Puncture Site
[0165] 701 needle tip
[0166] 1101 Mouse
[0167] Image 1102
[0168] Image 2 of 1201
[0169] c1p1, point 1
[0170] c1p2, point 2
[0171] c2l1 first polar line
[0172] c2l2 second polar line
[0173] c2p1, point 3
[0174] c2p2, point 4.
Claims
1. A tail vein injection system, comprising: a calculation unit that calculates the position of the tail vein based on an image obtained by photographing the tail; and The adjustment unit adjusts the position and posture of the injection needle using a position adjustment mechanism.
2. The tail vein injection system as claimed in claim 1, in, The position adjustment mechanism is a position adjustment mechanism with more than five axes.
3. The tail vein injection system according to claim 1 or claim 2, in, The calculation unit calculates the three-dimensional positions of two points on the caudal vein based on the two or more images obtained by imaging the caudal part under conditions in which at least one of a position and a direction is different.
4. The tail vein injection system as claimed in claim 3, in, The adjustment unit performs the adjustment using the position adjustment mechanism so that the injection needle is inserted along a straight line passing through the two points.
5. The tail vein injection system according to claim 3 or claim 4, in, The calculation unit determining a first point and a second point on the tail vein using a first image obtained by photographing the tail with a first camera, In a second image obtained by photographing the tail with a second camera, a first epipolar line connecting the first camera and the first point and a second epipolar line connecting the first camera and the second point are calculated. In the second image, the three-dimensional positions of a third point where the caudal vein intersects the first polar line and a fourth point where the caudal vein intersects the second polar line are calculated.
6. The tail vein injection system according to any one of claims 1 to 5, comprising: an image acquisition unit, which acquires the image obtained by photographing the tail using two or more cameras, in, The camera is a visible light camera.
7. The tail vein injection system according to any one of claims 1 to 6, comprising: The calibration unit calibrates the position of the needle of the syringe relative to the position adjustment mechanism when the injection needle or the syringe is replaced.
8. The tail vein injection system as claimed in claim 7, in, The calibration unit is capable of performing at least a first calibration process and a second calibration process. When the injection needle or the syringe is replaced, the second calibration process is performed. The number of objects calibrated by the second calibration process is smaller than the number of objects calibrated by the first calibration process.
9. The tail vein injection system as claimed in claim 8, in, The first calibration process is a calibration of the entire own system.
10. The tail vein injection system according to any one of claims 7 to 9, in, The calibration unit can calibrate at least camera parameters, the position adjustment mechanism, and the position of the injection needle.
11. The tail vein injection system according to any one of claims 7 to 10, in, The calibration unit calibrates the position of the injection needle using an image obtained by capturing the needle tip of the injection needle.
12. The tail vein injection system according to any one of claims 1 to 11, comprising: The puncture part detects the pressure of the injected liquid after puncture. in, The injection of the liquid medicine is controlled according to the detected pressure.
13. The tail vein injection system according to claim 12, in, When the detected pressure exceeds a threshold value, the injection of the medical solution is stopped.
14. The tail vein injection system according to any one of claims 1 to 13, in, Whether the injection needle has pierced the tail vein is determined based on the recognition result of the blood in the syringe using the image.
15. The tail vein injection system according to any one of claims 1 to 14, comprising: A holding and fixing part is used to hold and fix the body of the animal having the tail, in, The holding and fixing portion is in a cylindrical shape having an opening in front of the animal.
16. The tail vein injection system according to any one of claims 1 to 15, in, The tail is fixed on a fixing device, The fixing device has a straight portion and a curved portion. The straight portion holds a portion of the tail in a straight shape by suction, and the curved portion holds the other portion of the tail so that the curvature of the other portion of the tail is higher than the straight portion.
17. The tail vein injection system according to claim 16, in, The fixture has a hole for attracting the tail and capable of irradiating light, The image obtained by photographing the tail portion is an image photographed when the light is irradiated from the hole.
18. A tail vein injection method, comprising inserting an injection needle into the tail using the tail vein injection system according to any one of claims 1 to 17.
19. A program that causes at least one computer to: Calculation processing, calculating the position of the tail vein based on the image obtained by photographing the tail; and Adjustment process: Use the position adjustment mechanism to adjust the position and posture of the injection needle.
20. A program for causing a tail vein injection system having at least one computer to execute the tail vein injection method according to claim 18.
