Puncture system, information processing method, computer program, and information processing device

Abstract

The invention provides a puncture system and the like capable of easily switching display modes of a blood vessel visualized image. A puncture system is provided with: a blood vessel visualization device capable of displaying a blood vessel visualization image in which a blood vessel of a living body is visualized; provided is a blood vessel visualization device which is provided with a blood vessel, and a puncture instrument which is provided with a marker, acquires the state of the marker in the puncture instrument, and specifies the display mode of a blood vessel visualization image on the basis of the acquired state of the marker.

Description

Technical Field

[0001] The present invention relates to a puncture system, an information processing method, a computer program, and an information processing device. Background Art

[0002] In medical settings, puncture procedures are performed on patients for purposes such as blood sampling, injections, continuous infusions, and the placement of intravascular catheters. Medical professionals insert puncture instruments such as needles and catheters from the patient's body surface into the target location within the blood vessels. To support these puncture procedures, technologies for visualizing the patient's blood vessels have been developed.

[0003] For example, Patent Document 1 discloses a blood vessel position display device capable of displaying an image showing the position of a blood vessel suitable for puncture with a needle.

[0004] Patent Document 1: Japanese Patent Application Laid-Open No. 2020-185198

[0005] When displaying a blood vessel visualization image that visualizes blood vessels, there is a need to switch the display mode of the blood vessel visualization image. For example, when displaying a blood vessel visualization image on the surface of a subject's arm, the blood vessel visualization image can be displayed before puncture and hidden during puncture to facilitate observation of skin deformation. While it is conceivable that the operator can switch between displaying and hiding the blood vessel visualization image by operating a switch on a blood vessel visualization device that displays the blood vessel visualization image, performing such a switch operation while holding a puncture instrument is not easy. Summary of the Invention

[0006] An object of the present disclosure is to provide a puncture system or the like that can easily switch the display mode of a blood vessel visualization image.

[0007] (1) A puncture system according to one embodiment of the present disclosure includes: a blood vessel visualization device capable of displaying a blood vessel visualization image that visualizes blood vessels of a living body; and a puncture instrument including a marker, wherein the blood vessel visualization device obtains a state of the marker in the puncture instrument and determines a display method of the blood vessel visualization image based on the obtained state of the marker.

[0008] (2) In the puncture system described in (1) above, the state of the mark may include the size of the range of the mark.

[0009] (3) In the puncture system described in (1) or (2) above, an image of the mark may be acquired, and the display mode may be determined based on the size of the range of the mark in the acquired image.

[0010] (4) In the puncture system described in any one of (1) to (3) above, the display mode may include displaying or not displaying the blood vessel visualization image.

[0011] (5) In the puncture system described in any one of (1) to (4) above, the display mode may include at least one of the color, brightness, and contrast of the blood vessel visualization image.

[0012] (6) In the puncture system described in any one of (1) to (5) above, the status of the mark can be classified into three or more types, and a different display mode is set for each mark status.

[0013] (7) In the puncture system described in any one of (1) to (6) above, the mark may be provided near a portion of the puncture instrument that is held by the user.

[0014] (8) In the puncture system described in any one of (1) to (7) above, the marker can emit, fluoresce, or reflect near-infrared light.

[0015] (9) In the puncture system described in any one of (1) to (8) above, the blood vessel visualization device may include: a light source that irradiates light of a specific wavelength, a photographing device that photographs the blood vessels of the biological body and the marker, and a display device that displays the blood vessel visualization image.

[0016] (10) In an information processing method according to one embodiment of the present disclosure, a computer executes the following processing: obtaining a state of a marker in a puncture instrument having a marker, and determining a display method of a blood vessel visualization image that visualizes a blood vessel of a living body based on the obtained state of the marker.

[0017] (11) A computer program according to one embodiment of the present disclosure causes a computer to execute the following processing: obtaining a state of a marker in a puncture instrument having a marker, and determining a display method of a blood vessel visualization image that visualizes a blood vessel of a living body based on the obtained state of the marker.

[0018] (12) An information processing device according to one embodiment of the present disclosure includes a control unit that performs the following processing: obtaining the status of a mark in a puncture instrument having a mark, and determining a display method of a blood vessel visualization image that visualizes a blood vessel of a living body based on the obtained status of the mark.

[0019] According to the present disclosure, the display mode of the blood vessel visualization image can be easily switched. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a schematic diagram of the puncture system in the first embodiment.

[0021] Figure 2 This is an explanatory diagram illustrating a configuration example of the indwelling needle according to the first embodiment.

[0022] Figure 3 This is a block diagram showing a configuration example of an information processing device.

[0023] Figure 4 This is a flowchart showing an example of a processing procedure executed in the information processing device.

[0024] Figure 5 This is an explanatory diagram illustrating a configuration example of an indwelling needle according to a second embodiment.

[0025] Figure 6 This is a block diagram showing a configuration example of an information processing device according to the second embodiment.

[0026] Figure 7 It is a diagram showing an example of the content of information stored in the display mode DB.

[0027] Figure 8 This is a flowchart showing an example of a processing procedure executed in the information processing apparatus according to the second embodiment. DETAILED DESCRIPTION

[0028] The present disclosure will be described in detail with reference to the accompanying drawings showing embodiments of the present disclosure.

[0029] (First embodiment)

[0030] Figure 1 FIG1 is a schematic diagram of a puncture system 100 in the first embodiment. The puncture system 100 includes an indwelling needle 1 and an information processing device 2. The indwelling needle 1 is an example of a puncture instrument. Figure 1 As shown, the case where the puncture target site is a part of the forearm of the living body (subject) 3 will be described as an example.

[0031] The indwelling needle 1 is, for example, a peripheral arteriovenous indwelling needle. A surgeon uses the indwelling needle 1 to puncture a blood vessel in a living body 3. The surgeon is an example of a user of this system. A marker 10 is provided on the indwelling needle 1. The marker 10 functions as a switch for indicating the display mode of a vascular visualization image (described later) and is comprised of, for example, a fluorescent substance.

[0032] Information processing device 2 is installed in a facility such as a medical institution or examination facility where puncture procedures are performed. Information processing device 2 functions as a marker recognition device that detects the status of marker 10 provided on indwelling needle 1, and as a blood vessel visualization device that detects and visualizes blood vessels in living body 3. Information processing device 2 displays a blood vessel visualization image that visualizes the blood vessels using a display format corresponding to the detection results of the marker 10 status.

[0033] The information processing device 2 includes a light source 21, a camera 22, a display device 23, and the like. Figure 1 In the example shown, the information processing device 2 includes: a bottom portion 24, a top portion 25, and a support 26 connecting the bottom portion 24 and the top portion 25. The bottom portion 24 and the top portion 25 are both rectangular and extend in the horizontal direction, and are arranged perpendicular to the support 26. The bottom portion 24 and the top portion 25 overlap when viewed in the vertical direction. When used, the information processing device 2 is placed on a horizontal table such as a treatment table. Figure 1 , a fixed information processing device 2 is shown, but the information processing device 2 may be portable or may be configured to be grasped by a surgeon.

[0034] A recess 27 is formed on the upper surface of the bottom portion 24. The recess 27 is shaped so that the subject's arm, which is the living body 3, can be placed thereon. During puncture, the subject places their arm in the recess 27, thereby securing the arm's posture and position. The bottom portion 24 may also include a securing member such as a securing strap to more reliably secure the position of the living body 3. Alternatively, the bottom portion 24 may not include the recess 27.

[0035] On the lower surface of the top portion 25, above the recess 27, are provided a light source 21, a camera 22, and a display device 23. The light source 21, camera 22, and display device 23 are arranged, for example, in parallel in the longitudinal direction. The camera 22 is positioned directly above, that is, directly opposite, the puncture target site. The camera 22 is fixed to the top portion 25 so that its imaging area includes the periphery of the blood vessel serving as the puncture target site and the indwelling needle 1 used to puncture the vessel. The camera 22 is preferably fixed to the top portion 25 in a positionally and angularly adjustable manner, so that the camera 22 is positioned directly above the puncture target site in accordance with the course of the blood vessel and the movement of the indwelling needle 1.

[0036] The light source 21 irradiates the organism 3 and the marker 10 with light of a specific wavelength. The light source 21 may also irradiate near-infrared light, for example. Taking into account the absorption of hemoglobin in the blood, the emission wavelength of the light source 21 may be set to, for example, 600 nm to 2500 nm, preferably 700 nm to 1400 nm, and more preferably 780 nm to 940 nm. The light source 21 may also include a first light source 21 that irradiates the marker 10 with light of a first wavelength, and a second light source 21 that irradiates the organism 3 with light of a second wavelength different from the first wavelength. In addition, natural light or a fluorescent lamp (not shown) may be used as the light source 21 to irradiate at least one of the marker 10 and the organism 3 with visible light.

[0037] The camera 22 is an imaging device having a lens and an imaging element. The camera 22 receives the transmitted (or reflected) light of the light irradiated from the light source 21, obtains a near-infrared imaging signal, and generates a captured image as near-infrared image data based on the obtained near-infrared imaging signal. The camera 22 can also obtain a visible imaging signal and generate a captured image as visible image data based on the obtained visible imaging signal. The captured image obtained by the camera 22 is an image of the puncture target site and the indwelling needle 1 taken from above. When the blood vessels of the puncture target site and the marker 10 are present within the imaging area of ​​the camera 22, the captured image includes a blood vessel visualization image showing the blood vessels of the puncture target site and a marker image showing the marker 10.

[0038] The spectral sensitivity wavelength range of camera 22 is not particularly limited, as long as it corresponds to the wavelength of light emitted by light source 21. It can be appropriately set in consideration of the response wavelengths of marker 10 and blood vessels. As an example, assume that the response wavelength of marker 10, i.e., the wavelength of light emitted by marker 10, is 400 to 600 nm. The response wavelength of blood vessels in organism 3, i.e., the wavelength of light absorbed by blood vessels, is approximately 800 to 900 nm. Therefore, the spectral sensitivity wavelength range of camera 22 can be set to 400 to 2500 nm, preferably 400 to 1000 nm, which includes both response wavelengths. In this case, a captured image can be obtained in which the marker 10, blood vessels, and other parts are represented with different brightness levels. Camera 22 can also have spectral sensitivity for RGB, and can detect each RGB color signal separately.

[0039] The camera 22 may include a camera 22 for detecting the marker 10 having a spectral sensitivity wavelength corresponding to the reaction wavelength of the marker 10, and a camera 22 for detecting blood vessels having a spectral sensitivity wavelength corresponding to the reaction wavelength of the blood vessels. In this case, the camera 22 for detecting the marker 10 generates a captured marker image including a marker image, and the camera 22 for detecting the blood vessels generates a captured blood vessel image including a visualized blood vessel image. The spectral sensitivity wavelength regions of the camera 22 for detecting the marker 10 and the camera 22 for detecting the blood vessels may be the same, partially overlap, or different.

[0040] Furthermore, the light source 21 and camera 22 can be positioned in any position as long as they can detect blood vessels and markers 10. The light source 21 and camera 22 are not limited to being positioned on the same side of the detection object. For example, the light source 21 and camera 22 may be positioned on opposite sides of the detection object, or a combination of a light source 21 and camera 22 positioned on the same side of the detection object and a light source 21 and camera 22 positioned opposite each other across the detection object may be used.

[0041] The display device 23 is an output device for presenting a vascular visualization image of the living body 3 to the operator. In this embodiment, the display device 23 includes a projector that projects the image onto the surface of the living body 3. Alternatively, the display device 23 may include, for example, goggles, glasses, a head-mounted display, or other display device that the operator can wear. The display device 23 is preferably fixed to the top surface 25 in a positionally and angularly adjustable manner, so that the display device 23 is positioned above the puncture site in accordance with the course of the blood vessels and the movement of the indwelling needle 1.

[0042] The structure of the information processing device 2 is not limited to Figure 1 The example shown can be any suitable configuration as long as it can function as both a marker recognition device and a blood vessel visualization device. Furthermore, while this embodiment describes an example in which the information processing device 2 functions as both a marker recognition device and a blood vessel visualization device, the marker recognition device and the blood vessel visualization device are not limited to being a single information processing device 2 and may be separate devices.

[0043] Figure 2 This is an explanatory diagram for explaining a structural example of the indwelling needle 1 according to the first embodiment. Figure 2 The left side in the figure is referred to as the “front end side” and the right side is referred to as the “base end side”, and various structures and the like are explained.

[0044] The indwelling needle 1 includes a marker 10, a catheter 11, a catheter hub 12 coupled to the proximal end of the catheter 11, an inner needle (roller needle) 13 inserted into the interior of the catheter 11, an inner needle hub 14 coupled to the proximal end of the inner needle 13, and a filter 15 coupled to the proximal end of the inner needle hub 14. A syringe (not shown) can be connected to the proximal end of the inner needle hub 14. A hemostatic valve (not shown) may also be included in the catheter hub 12. The indwelling needle 1 may not include the filter 15.

[0045] The catheter 11 forms an outer needle and reaches near the tip of the inner needle 13. The blade 131 formed at the tip of the inner needle 13 is exposed (protrudes) from the tip of the catheter 11. When the tip of the inner needle 13 is inserted into a blood vessel, the catheter 11 is also inserted into the same blood vessel.

[0046] The mark 10 is provided near the portion of the indwelling needle 1 that is held by the operator. The portion held by the operator is, for example, the range that the fingers of the operator's hand can reach when the operator holds the indwelling needle 1 with one hand for puncture. That is, the mark 10 is provided at a position where the operator can operate the mark 10 with the single hand while holding the indwelling needle 1 with the single hand. The mark 10 is preferably provided on the base end side of the indwelling needle 1. Figure 2 In the example shown, the area held by the operator is the inner needle hub 14, and the marking 10 is provided on the outer circumference of the inner needle hub 14. When the blade surface 131 is facing upward, the marking 10 is also formed in an upward-facing position. With this configuration, when the indwelling needle 1 is photographed from above while being used with the blade surface 131 facing upward during puncture, the image in which the marking 10 is more clearly visible can be obtained.

[0047] The shape of the mark 10 is not particularly limited, and may be, for example, a circle, a triangle, a square, a star, a cross, or any other suitable shape. The mark 10 preferably has a complex shape so as to reduce the possibility of misdetection. Figure 2 In the figure, a star-shaped mark 10 is shown. Mark 10 can be formed along the circumference of the indwelling needle 1 to a predetermined length or along the entire circumference. When forming the mark 10 along the circumference, the shape of the mark 10 can be, for example, a single line, two lines, or a wavy line. The shape of the mark 10 can also be determined according to the type of indwelling needle 1.

[0048] The marker 10 includes, for example, a near-infrared fluorescent dye that emits near-infrared fluorescence of a specific wavelength when irradiated with excitation light. The camera 22 receives the fluorescence of the marker 10 to detect the shape, range (area), etc. of the marker 10.

[0049] Marker 10 may include, for example, a near-infrared fluorescent dye that emits near-infrared fluorescence with a wavelength of 600 nm to 2500 nm, or a fluorescent dye that emits fluorescence in a wavelength region corresponding to green or blue, for example, which does not exist in the subject's body (e.g., wavelengths of 400 to 600 nm). By making the reaction wavelength of marker 10 different from the reaction wavelength of blood vessels in subject 3, marker 10 and blood vessels can be clearly distinguished and detected.

[0050] The marker 10 can also be formed by, for example, mixing or coating a base material with a fluorescent dye, and then attaching the resulting marker 10 to a predetermined portion of the indwelling needle 1. Alternatively, the marker 10 can be directly formed by mixing or coating a base material with a fluorescent dye, and then attaching the resulting marker 10 to a predetermined portion of the indwelling needle 1. The marker 10 can be attached to the indwelling needle 1 during the manufacturing phase, or by a surgeon prior to use of the indwelling needle 1. The marker 10 can also be made of a removable material, such as a sealing member.

[0051] Furthermore, as long as the camera 22 can detect the mark 10, the structure of the mark 10 and the detection method are not limited. For example, the mark 10 may include a light emitting body that emits light of a specific wavelength, an upconversion (UC) phosphor that emits light of a specific wavelength, or a reflector that reflects the irradiated light of a specific wavelength. For example, the mark 10 may include a reflective structure that reflects light by applying surface treatment such as corrugation or embossing. For example, the mark 10 may include a material that absorbs visible light, such as colored ink, and may be detectable by a visible light camera.

[0052] The indwelling needle 1 is not limited to the above-mentioned examples, and any suitable structure may be used as long as it is a puncture device inserted into a blood vessel of a living body 3. The indwelling needle 1 may also be a dialysis indwelling needle, a peripherally inserted central venous catheter (PICC), a midline catheter, a central venous catheter (CVC), or the like. The puncture device may also be an instrument that does not have a catheter but has a puncture needle (inner needle) and a syringe, such as a blood collection device. According to the above-mentioned medical device, a marker 10 is provided near the site to be grasped by the operator.

[0053] The following describes a puncture method using an indwelling needle 1. The operator grasps the indwelling needle 1, which includes an inner needle 13, and punctures a blood vessel from the surface of a living body 3 (the subject's skin surface), slowly inserting the inner needle 13 toward the desired location. As a result, the tip of the inner needle 13 enters the body tissue while cutting. After the inner needle 13 punctures the target blood vessel, the catheter 11 and the catheter adapter 12 are moved forward and inserted into the blood vessel. After insertion, the catheter 11 and the catheter adapter 12 are left in place, and the inner needle 13, the inner needle adapter 14, and the filter 15 are removed, leaving the catheter 11 and the catheter adapter 12 indwelled in the blood vessel.

[0054] Figure 3 This is a block diagram showing an example configuration of an information processing device 2. Information processing device 2 is a computer and includes, in addition to the aforementioned light source 21, camera 22, and display device 23, a control unit 201 and a storage unit 202. These components are connected via a bus. Information processing device 2 may be a multicomputer comprised of multiple computers or a virtual machine created using software.

[0055] The control unit 201 includes one or more processing devices, such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), or a GPU (Graphics Processing Unit). The control unit 201 uses internal memory, such as ROM (Read Only Memory) or RAM (Random Access Memory), a clock, and counters, to control each component and execute processing.

[0056] The storage unit 202 includes, for example, a nonvolatile memory such as a hard disk, flash memory, or SSD (Solid State Drive). The storage unit 202 may also be an external storage device connected to the information processing device 2. The storage unit 202 stores various computer programs and data referenced by the control unit 201. The storage unit 202 stores a program 2P for causing a computer to execute processing related to outputting a visualized blood vessel image. The storage unit 202 may also store data necessary for executing the program 2P, such as the reaction wavelength of the marker 10, the reaction wavelength of the blood vessels, and threshold values ​​used in various determinations described below.

[0057] A computer program (computer program product) including program 2P can also be provided by a non-transitory recording medium 2A on which the computer program is readable. Storage unit 202 stores the computer program read from recording medium 2A by a reader (not shown). Recording medium 2A is, for example, a magnetic disk, an optical disk, a semiconductor memory, or the like. Alternatively, the computer program can be downloaded from an external server connected to a communication network and stored in storage unit 202. Program 2P can be a single computer program or a program consisting of multiple computer programs, and can be executed on a single computer or on multiple computers interconnected via a communication network.

[0058] The configuration of information processing device 2 is not limited to the example described above; for example, it may include an operation unit for accepting user operations, a communication unit for communicating with external devices via a network such as the Internet, and an input / output unit for connecting to external devices. Furthermore, a portion of information processing device 2, such as control unit 201 and storage unit 202, may be configured as a server computer located remotely from a medical facility or other facility where puncture procedures are performed. In this case, control unit 201 may receive images captured by camera 22 via communication, and transmit information corresponding to the received images to display device 23 via communication for display.

[0059] The information processing device 2 generates a display image including a visualized blood vessel image and a marker image based on the captured image captured by the camera 22 during puncture. Specifically, the blood vessels and markers 10 are extracted from the captured image, thereby generating a display image including a visualized blood vessel image showing the area corresponding to the blood vessel and a marker image showing the area corresponding to the marker 10. The method for extracting the blood vessels and markers 10 from the captured image is not limited; the detection object and its position (range) can be determined based on the brightness value of the image, or methods such as pattern matching can be used. The information processing device 2 can also identify the blood vessels and markers 10 in the image data based on the known reaction wavelengths of the blood vessels and markers 10.

[0060] When camera 22 generates a captured marker image and a captured blood vessel image separately, the display image may include a display image that includes a visualized blood vessel image and a display image that includes a marker image, respectively. Alternatively, a single display image may be generated by synthesizing the visualized blood vessel image and the marker image obtained from each captured image. The display image may include at least a visualized blood vessel image, or may not include a marker image. Furthermore, the display image is not limited to an image obtained by performing predetermined image processing on the captured image; it may also be the captured image itself. If no blood vessels or markers 10 are present within the captured area of ​​camera 22, the captured image and the displayed image also do not include a visualized blood vessel image or a marker image.

[0061] The information processing device 2 displays the generated display image on the display device 23. At this time, the information processing device 2 determines whether the display image is displayed based on the state of the marker 10 operated by the operator, and switches the display / non-display of the display image based on the determination result.

[0062] The information processing device 2 of this embodiment determines whether to display the display image based on the presence or absence of the mark 10 in the captured image. In the case where the captured image includes the mark 10, that is, when the size of the range of the mark 10 in the captured image is not zero, it is determined that the display of the image is necessary. In the case where the captured image does not include the mark 10, that is, when the size of the range of the mark 10 in the captured image is zero, it is determined that the display of the image is not necessary. In the case where the size of the range of the mark 10 in the captured image is greater than a predetermined threshold value, the captured image includes the mark 10, and it can also be determined that the display of the image is necessary. In the case where it is determined that the display of the image is necessary, the information processing device 2 displays the display image via the display device 23. In the case where it is determined that the display of the image is not necessary, the information processing device 2 does not display the display image.

[0063] The operator performs a predetermined operation on the marker 10 to change the state of the marker 10 detected by the camera 22, thereby instructing the information processing device 2 to switch the display mode. Specifically, the operation is performed to change the size of the range of the marker 10. The operator begins the puncture operation while holding the indwelling needle 1 equipped with the marker 10. Before the inner needle 13 is punctured into the surface of the living body 3, a visual image of the blood vessels is projected onto the surface of the living body 3, thereby enabling a more accurate understanding of the direction of the blood vessels. In this way, if it is desired to display the visual image of the blood vessels, the operator does not operate the marker 10. When no operation is performed on the marker 10, the roughly entire shape of the marker 10 is recognizable in the captured image. Therefore, it is determined that the display image is necessary, and the display image is displayed.

[0064] On the other hand, at the stage where the puncture position is determined based on the direction of the blood vessel and the inner needle 13 is inserted into the surface of the living body 3, the blood vessel visualization image is not projected, thereby making it easier to observe the surface of the living body 3. In this way, when the blood vessel visualization image is not desired to be displayed, the operator performs a predetermined operation on the marker 10. For example, the operator covers the marker 10 from above with a finger so that the marker 10 is not captured by the camera 22, thereby making the marker 10 on the indwelling needle 1 disappear. As a result, the range of the marker 10 captured by the camera 22 changes. While the operation on the marker 10 is in progress, a captured image that does not include the marker 10 is obtained. Therefore, it is determined that the display image is not necessary, and the display image is not displayed. When it is desired to display the display image again, the finger covering the marker 10 is moved from the marker 10, and the operation on the marker 10 is ended, so that the display image state can be switched to the display state.

[0065] The method for switching between display and non-display of a display image using marker 10 is not limited to the example described above. For example, the information processing device 2 may switch the display image state from its current state to another state based on detection of manipulation of marker 10. The information processing device 2 obtains a captured image that does not include marker 10 in response to the operator's manipulation of marker 10, thereby receiving an instruction to switch the display mode. Based on the current state of the display image, the information processing device 2 determines whether the display image is to be displayed or not. If the current state of the display image is a display state, the information processing device 2 determines that the display image is not necessary and switches the display state to a non-display state.

[0066] After switching the display mode of the displayed image and releasing the manipulation of the marker 10, the operator can manipulate the marker 10 again. The information processing device 2 acquires a captured image excluding the marker 10 based on the manipulation of the marker 10, thereby receiving the instruction to switch the display mode. If the current state of the displayed image is non-display, it is determined that the display of the displayed image is necessary, and the display state is switched to display. In this way, the display mode of the displayed image can also be determined based on the state of the marker 10 over time.

[0067] The information processing device 2 may also determine the state of the marker 10 and the duration of the display of a predetermined state of the marker 10 based on captured images acquired in a time series. The duration may also be determined by determining the time over which captured images that do not include the marker 10 are continuously acquired. For example, if the duration is greater than a threshold, the information processing device 2 may determine that an instruction to switch the display mode has been received.

[0068] Figure 4 Flowcharts showing an example of a processing sequence executed by the information processing device 2. The processing in each of the following flow charts can be executed by the control unit 201 according to the program 2P stored in the storage unit 202 of the information processing device 2, can be implemented by a dedicated hardware circuit (such as an FPGA or ASIC) included in the control unit 201, or can be implemented by a combination of these.

[0069] The control unit 201 of the information processing device 2 acquires an image captured by the camera 22 (step S11). The control unit 201 performs image analysis on the acquired image to identify blood vessels and markers 10 in the image, and generates a display image including a visualized blood vessel image and a marker image (step S12). The display image generation process may also be performed after a determination is made that display is necessary through the display determination process described later.

[0070] The control unit 201 obtains the state of the marker 10 based on the acquired captured image (step S13). Specifically, the control unit 201 obtains the presence or absence of the marker 10 in the captured image as the state of the marker 10. The control unit 201 may also determine the duration of the state of the marker 10 based on the captured images acquired in time series.

[0071] Based on the acquired state of the marker 10, the control unit 201 determines whether a display image is necessary (step S14). The determination process in step S14 corresponds to a specific process for determining the display method of the display image. If the captured image includes the marker 10 and it is determined that the display image is necessary (step S14: Yes), the control unit 201 outputs the display image to the display device 23 and displays the display image (step S15).

[0072] When the captured image does not include the mark 10 and it is determined that the display image is unnecessary (step S14 : No), the control unit 201 does not output the display image to the display device 23 and does not display the display image (step S16 ).

[0073] The control unit 201 determines whether to terminate the process (step S17). For example, if the predetermined termination action has not been performed and the process is determined not to be terminated (step S17: No), the control unit 201 returns the process to step S11. The control unit 201 obtains a new captured image and, based on the state of the marker 10 in the acquired captured image, repeatedly switches the display mode of the displayed image. If the predetermined termination action has been performed and the process is determined to be terminated (step S17: Yes), the control unit 201 terminates the series of processes.

[0074] According to this embodiment, the displayed image can be switched between visible and invisible depending on the status of the marker 10 in the captured image. By switching the display mode of the displayed image, the operator's visibility of the puncture target site is improved, and a visual image of the blood vessels is immediately displayed when necessary, allowing for more accurate puncture. By placing the marker 10 near the area of ​​the indwelling needle 1 held by the operator, the operator can easily operate the marker 10 while holding the indwelling needle 1 with one hand, without using the other hand. Since the marker 10 can be operated with one hand, the display mode can be appropriately switched without interfering with the procedure, even during a two-handed procedure.

[0075] By forming the marker 10 from a near-infrared luminescent material, the blood vessels and the marker 10 can be detected by the light source 21 and camera 22 used to generate the blood vessel visualization image, thereby further simplifying the puncture system 100. By making the marker 10 detachable, it can be reused, improving economic efficiency.

[0076] By presenting the blood vessel visualization image and the mark image through the display image, the state of the mark 10 functioning as a receiving unit for receiving an instruction to switch the display mode can be clearly visually grasped, thereby enabling reliable operation of the mark 10 .

[0077] The puncture system 100 more preferably uses a projector or goggles worn by the operator as the display device 23, but the display device 23 is not limited thereto and may be a display device that is not worn by the operator but is installed at a predetermined location.

[0078] (Second embodiment)

[0079] The second embodiment describes a configuration for determining multiple display modes based on the state of the marker 10. In the following embodiment, differences from the first embodiment are mainly described, and configurations common to the first embodiment are denoted by the same reference numerals and detailed descriptions thereof are omitted.

[0080] Figure 5 This is an explanatory diagram illustrating a structural example of the indwelling needle 1 according to the second embodiment. Figure 5 As shown, the indwelling needle 1 of the second embodiment has a plurality of markings 10. In addition, in this embodiment, the number of markings 10 is 3. The plurality of markings 10 are arranged in a row along the axial direction of the indwelling needle 1. In addition, the number of markings 10 can also be 2 or 4 or more. In addition, the configuration position of the markings 10 is not particularly limited as long as it is near the part of the indwelling needle 1 that the operator holds and the operator can operate all the markings 10 with one hand.

[0081] Each marker 10 may be configured to have different shapes, sizes, directions, line types, etc., so that each marker 10 can be identified. Furthermore, the reaction wavelengths of each marker 10 may be the same or different. By making the reaction wavelengths of the markers 10 different, identification of each marker 10 becomes easier.

[0082] In this embodiment, more display modes are set according to the states of the multiple markers 10. The states of the markers 10 can be set, for example, based on the number of markers 10 recognized in the captured image. In this embodiment, four display modes are set corresponding to the number of markers 10, 0 to 3, respectively.

[0083] Display modes include normal display (displaying the normal display image), brightness-modified display (displaying an image with altered brightness), color-inverted display (displaying a color-inverted image), and non-display (displaying no display image). In brightness-modified display, the brightness of the vascular visualization image within the normal display image can be adjusted to be greater than or less than a predetermined value. In color-inverted display, the pixel values ​​corresponding to the vascular visualization image and the marker image within the normal display image and other regions can be inverted. Furthermore, display modes include saturation-modified display (displaying an image with a predetermined saturation within the normal display image), and contrast-modified display (displaying an image with a predetermined contrast within the normal display image).

[0084] Color inversion, brightness change, contrast change and other display modes can also be further classified into multiple levels according to the degree of inversion and change. For example, regarding brightness change, three display modes can be further set: low brightness, medium brightness and high brightness.

[0085] Figure 6 This is a block diagram showing an example configuration of an information processing device 2 according to the second embodiment. The storage unit 202 of the information processing device 2 according to the second embodiment stores a display mode DB (Data Base) 203, which is data required for executing a program 2P. The display mode DB 203 is a database that stores information related to display modes.

[0086] Figure 7 2 is a diagram showing an example of the content of information stored in the display mode DB 203. The display mode DB 203 stores, for example, a record in which information such as the state of the marker 10 and the display mode are associated. Figure 7 In the example shown, the state of the mark 10 is represented by the number of recognized marks 10, including numbers from 0 to 3. The display mode includes the above-mentioned 4 display modes (normal display, brightness change display, color inversion display and non-display). Figure 7 As shown, different display modes are set according to the number of marks 10.

[0087] When the operator wishes to change to a predetermined display mode, for example, by covering a predetermined number of the multiple markers 10 provided on the indwelling needle 1 with a finger, the operator changes the number of markers 10 recognized by the camera 22. The information processing device 2 determines the position and range of the markers 10 included in the captured image based on the captured image of the indwelling needle 1, thereby obtaining the number of recognizable markers 10. The information processing device 2 may also obtain the number of markers 10 by determining the number of ranges in the captured image whose size is greater than a predetermined value. The information processing device 2 determines the display mode according to the number of markers 10 in the captured image based on the information stored in the display mode DB 203. The information processing device 2 changes the display state of the display image according to the determined display mode.

[0088] The status of the marker 10 is not limited to being determined based on the number of markers 10. For example, the status of the marker 10 may be classified using multiple thresholds set for the size of the range of the marker 10. In this case, the total value of the range of each marker 10 can be calculated based on the captured image, and the calculated total value can be compared with the threshold value for the status of each marker 10 to determine the status of the marker 10.

[0089] The state of the marker 10 may be determined by the amount of change from the start of puncture, using the state of the marker 10 at the start of puncture as a reference. Display mode DB 203 may also store a threshold value for the amount of change in the size of the range of the marker 10.

[0090] The number of markers 10 is not limited to multiple, as long as multiple stages of operation status can be detected. For example, a single marker 10 can be formed within a relatively wide area, and the status of marker 10 can be classified based on the change in the size of the marker 10 caused by the operator's operation of the marker 10. The operator adjusts the degree to which the marker 10 is obscured by the finger to manipulate the marker 10 to achieve the desired display mode.

[0091] The state of marker 10 may also be set based on the duration of the state of marker 10. For example, information processing device 2 determines the state of marker 10 and its duration per unit time based on captured images acquired in time series, thereby calculating the number of detections of the state of marker 10 per unit time. The display mode may also be changed based on the calculated number of detections and the state of marker 10.

[0092] Figure 8 This is a flowchart showing an example of a processing procedure executed in the information processing device 2 according to the second embodiment.

[0093] The control unit 201 of the information processing device 2 obtains an image captured by the camera 22 (step S21). Based on the obtained image, the control unit 201 obtains the status of the marker 10 (step S22). Specifically, the control unit 201 performs image analysis on the obtained image to identify the marker 10 in the image, thereby obtaining the number of markers 10 included in the image. The control unit 201 can also determine the duration of the status of the marker 10 based on the captured images obtained in time series.

[0094] The control unit 201 determines the display mode according to the number of acquired markers 10 based on the information stored in the display mode DB 203 (step S23 ).

[0095] The control unit 201 generates a display image based on the determined display mode (step S24). The control unit 201 performs image analysis on the acquired captured image to identify blood vessels and markers 10 in the captured image, and generates a normal display image including a visualized blood vessel image and a marker image. Furthermore, the control unit 201 performs image processing such as color inversion, brightness modification, and contrast modification on the generated normal display image as needed based on the determined display mode.

[0096] The control unit 201 outputs the generated display image to the display device 23 and displays the display image (step S25). In addition, when the display mode is determined to be non-display, the processing of steps S24 and S25 can be omitted.

[0097] The control unit 201 determines whether to end the process (step S26). If it determines that the process is not to be ended (step S26: No), the control unit 201 returns the process to step S21. If it determines that the process is to be ended (step S26: Yes), the control unit 201 ends the series of processes.

[0098] According to this embodiment, the display mode switching operation performed by the marker 10 can be used for a wider variety of display modes, thereby improving the convenience of the system. By setting a variety of marker 10 states and setting a variety of display modes for each marker 10 state, the display mode can be easily switched according to the state of the marker 10. By considering the duration of the marker 10 state, it is possible to switch between more display modes. The marker 10, with a simple structure, can function as a receiving unit for receiving instructions for a variety of display modes.

[0099] The embodiments disclosed herein are to be considered in all respects as illustrative and not limiting. The technical features described in the embodiments can be combined with each other, and the scope of the present invention is intended to include all modifications within the claims and equivalents thereto.

[0100] The order shown in each embodiment is not limited. Within the scope of no contradiction, the order of each process can be changed and executed. In addition, multiple processes can be executed in parallel. The processing subject of each process is not limited. Within the scope of no contradiction, the processing of each device can also be executed by other devices.

[0101] The matters described in the various embodiments can be combined with each other. Furthermore, independent claims and dependent claims described in the claims can be combined with each other in all possible combinations, regardless of the format of citation. Furthermore, the claims use a format that describes a claim that references two or more other claims (multiple claim format), but are not limited to this. Multiple claims that reference at least one multiple claim (multiple multiple claims) can also be described.

[0102] Description of Reference Numerals

[0103] 100…puncture system; 1…indwelling needle; 10…marker; 11…catheter; 12…catheter seat; 13…inner needle; 14…inner needle seat; 15…filter; 2…information processing device; 21…light source; 22…camera (photographing device); 23…display device; 201…control unit; 202…storage unit; 2P…program; 2A…recording medium; 203…display mode DB; 3…biological body.

Claims

1. A puncture system, characterized in that: have: a blood vessel visualization device capable of displaying a blood vessel visualization image that visualizes the blood vessels of a living body; and A puncture device, which is provided with a marking, The blood vessel visualization device acquires a state of a marker in the puncture instrument and determines a display mode of a blood vessel visualization image based on the acquired state of the marker.

2. The puncture system according to claim 1, characterized in that: The state of the mark includes the size of the range of the mark.

3. The puncture system according to claim 1 or 2, characterized in that: Obtain an image of the marker, The display mode is determined based on the size of the range of the marker in the acquired image.

4. The puncture system according to claim 1 or 2, characterized in that: The display mode includes displaying or non-displaying the blood vessel visualization image.

5. The puncture system according to claim 1 or 2, characterized in that: The display mode includes at least one of color, brightness, and contrast of the blood vessel visualization image.

6. The puncture system according to claim 1 or 2, characterized in that: The states of the markers are classified into three or more types, and a different display mode is set for each state of the marker.

7. The puncture system according to claim 1 or 2, characterized in that: The mark is provided near a portion of the puncture device that is held by a user.

8. The puncture system according to claim 1 or 2, characterized in that: The marker emits, fluoresces or reflects near-infrared light.

9. The puncture system according to claim 1 or 2, characterized in that: The blood vessel visualization device includes a light source that irradiates light of a specific wavelength, an imaging device that images the blood vessels of the living body and the marker, and a display device that displays the blood vessel visualization image.

10. An information processing method, characterized in that: The following processing is performed by the computer: Obtaining the status of the marking in the puncture device having the marking, A display method of a blood vessel visualization image that visualizes blood vessels of a living body is determined based on the acquired state of the marker.

11. A computer program, characterized in that Causes the computer to perform the following processing: Obtaining the status of the marking in the puncture device having the marking, A display method of a blood vessel visualization image that visualizes blood vessels of a living body is determined based on the acquired state of the marker.

12. An information processing device, characterized in that: A control unit is provided, which performs the following processing: Obtaining the status of the marking in the puncture device having the marking, A display method of a blood vessel visualization image that visualizes blood vessels of a living body is determined based on the acquired state of the marker.

Images