Healthcare System
The medical system optimizes 3D image data generation by managing two-dimensional data storage through coordinated acquisition and association with three-dimensional coordinates, addressing inefficiencies in existing methods and maintaining system performance.
Patent Information
- Application Number
- JP2022511716
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-03-30
- Filing Date
- 2021-03-08
- Publication Date
- 2024-11-28
- Estimated Expiration
- 2041-03-08
AI Technical Summary
Existing methods for generating 3D image data of hollow organs using image diagnostic techniques like IVUS and OCT face inefficiencies in data storage and management, leading to excessive storage requirements and potential system slowdowns.
A medical system comprising a first acquisition unit for obtaining three-dimensional coordinates, a second acquisition unit with a transmitting/receiving unit for generating two-dimensional data, a storage unit for associating these data with coordinates, and a setting unit to manage data storage based on specified ranges and capacities, ensuring efficient data storage and retrieval.
The system improves storage efficiency by selectively storing and managing two-dimensional data based on three-dimensional coordinates, preventing excessive data accumulation and maintaining system performance during 3D image data generation.
Smart Images

Figure 0007591562000001 
Figure 0007591562000002 
Figure 0007591562000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to medical systems. [Background technology]
[0002] In recent years, imaging diagnostic methods such as IVUS (Intravascular Ultrasound) and OCT (Optical Coherence Tomography) have been used to obtain tomographic images of hollow organs. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2010-201077 A Summary of the Invention [Problem to be solved by the invention]
[0004] It is possible to generate 3D image data in the longitudinal direction of a tubular organ from a tomographic image of the tubular organ acquired by IVUS, OCT, etc. The present inventor has been actively studying a method for efficiently using a memory area such as a storage device when generating 3D image data of a tubular organ from an image diagnosis method such as IVUS.
[0005] The present disclosure has been made in consideration of the above-mentioned problems, and aims to improve the storage efficiency of storage devices and the like that store data in a method of generating 3D image data of tubular organs using an imaging diagnostic method such as IVUS. [Means for solving the problem]
[0006] A medical system according to an embodiment of the present disclosure includes a first acquisition unit, a second acquisition unit, a storage unit, an input unit, and a setting unit. An angiography device,The first acquisition unit is configured to be capable of acquiring three-dimensional coordinates of the subject's tubular organ. The second acquisition unit is inserted into the subject's tubular organ and has a transceiver unit at its tip capable of transmitting and receiving waves of a predetermined wavelength, and is configured to be capable of generating two-dimensional data from signals acquired by the transceiver unit. The memory unit stores the two-dimensional data generated from the signals acquired by the second acquisition unit. The input unit is configured to be capable of specifying a range of the two-dimensional data to be associated with the three-dimensional coordinates when associating the three-dimensional coordinates with the two-dimensional data. The setting unit sets the amount of two-dimensional data of the tubular organ to be stored in the memory unit in association with the three-dimensional coordinates based on the above range. The angio device is configured to be able to acquire an angio image of a hollow organ. The data acquisition interval in a range specified by the input unit is set based on the capacity of the memory unit, the data of the angio image of the angio device is associated with the three-dimensional coordinates acquired by the first acquisition unit, and two-dimensional data is acquired based on the angio image every time the second acquisition unit moves the set interval. Effect of the Invention
[0008] According to the above medical system, it is possible to improve the storage efficiency of storage, etc., for saving data in a method for generating 3D image data of a hollow organ using an imaging diagnostic method such as IVUS. [Brief description of the drawings]
[0009] [Figure 1] 1 is a schematic diagram showing a medical system according to a first embodiment of the present disclosure. [Diagram 2] 2A to 2C are diagrams showing states before and after a pull-back operation is performed in the diagnostic imaging catheter in FIG. 1. [Diagram 3] FIG. 2 is a cross-sectional view showing the configuration of the tip side of the diagnostic imaging catheter. [Figure 4] FIG. 2 is a cross-sectional view showing the configuration of the base end side of the diagnostic imaging catheter. [Diagram 5] FIG. 13 is a diagram showing positions at which two-dimensional data of a hollow organ is generated. [Figure 6] FIG. 13 is a diagram showing the selection of two-dimensional data acquired from a blood vessel (hollow organ). [Figure 7] 4 is a flowchart showing a 3D image data generating method according to the first embodiment of the present disclosure. [Figure 8] FIG. 11 is a schematic diagram showing a medical system according to a second embodiment of the present disclosure. [Figure 9]10 is a flowchart showing a 3D image data generating method according to a second embodiment of the present disclosure. [Figure 10] FIG. 13 is a diagram showing the selection of two-dimensional data by machine learning when multiple two-dimensional data are acquired at a certain position of a hollow organ in order to generate 3D image data of the hollow organ. [Figure 11] FIG. 13 is a diagram showing the selection of two-dimensional data by machine learning when multiple two-dimensional data are acquired at a certain position of a hollow organ in order to generate 3D image data of the hollow organ. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] (First embodiment) Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Note that the dimensional ratios of the drawings are exaggerated for convenience of explanation and may differ from the actual ratios. A medical system 1 according to this embodiment is used in percutaneous coronary intervention (PCI), which is used when treating patients with cardiac artery diseases.
[0011] 1, a medical system 1 in the present disclosure includes a first acquisition unit 100, a second acquisition unit 200, an external device 300, and a main server 400. The details will be described below.
[0012] (1st acquisition part) The first acquisition unit 100 is configured to be able to acquire three-dimensional coordinates of a tubular organ of a subject. The first acquisition unit 100 includes an irradiation unit 110, a detection unit 120, a bed 130, a first storage unit 140, a processor 150, and an input / output unit 160.
[0013] The irradiation unit 110 is configured to be able to irradiate radiation of a predetermined wavelength, such as X-rays, toward the bed 130. The irradiation unit 110 can be mounted on a gantry of a known medical CT or the like. The irradiation range of the radiation irradiated from the irradiation unit 110 can be restricted by an aperture or the like.
[0014] The detection unit 120 receives X-rays and the like irradiated from the irradiation unit 110. The detection unit 120 may include an image sensor such as a CMOS. The detection unit 120 may be mounted on a gantry or the like of a known medical CT, similar to the irradiation unit 110. The irradiation unit 110 and the detection unit 120 may be configured to rotate the gantry at a position where the bed 130 can be irradiated with X-rays and the like.
[0015] The bed 130 is placed at a position where the X-rays and the like from the irradiation unit 110 can be irradiated.
[0016] The first storage unit 140 includes a ROM, a RAM, an auxiliary storage unit, etc. A program required for generating an X-ray image is stored in the ROM. Data acquired by the detection unit 120 is read into the RAM, and an image generated by the processor 150 is displayed on a display (not shown) or the like. The processor 150 is, for example, a CPU or the like, and controls the irradiation unit 110, the detection unit 120, the bed 130, and the first storage unit 140. The auxiliary storage unit of the first storage unit 140 includes at least one of an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc.
[0017] The processor 150 can form a tomographic image (two-dimensional data) of the human body and an image in which hollow organs such as blood vessels are extracted from the data acquired by the detection unit 120. The data of hollow organs and the like formed by the processor 150 includes three-dimensional coordinates that can be associated with the two-dimensional data, and is stored in the auxiliary storage unit. The first acquisition unit 100 is electrically connected to the main server 400, and is configured to be able to transmit the data stored in the auxiliary storage unit to the main server 400. The position of the three-dimensional coordinates stored in the auxiliary storage unit may be specified by the processor 150, or may be specified by the user via the input / output unit 160. The first acquisition unit 100 may be electrically connected to the main server 400 by wire or wirelessly.
[0018] The input / output unit 160 may include at least one of a mouse, a keyboard, a button, a touch panel, a display, etc. Through the input / output unit 160, a user can instruct the first acquisition unit 100 to acquire three-dimensional coordinates, and can display the acquired three-dimensional coordinates visibly to the user.
[0019] (Second acquisition part) Next, a catheter for diagnostic imaging (hereinafter referred to as an imaging catheter or a catheter device) will be described as an example of the second acquisition unit. Fig. 2 is a diagram for explaining pullback in the catheter for diagnostic imaging related to the second acquisition unit 200. Fig. 3 is a diagram showing the tip side of the catheter for diagnostic imaging related to the second acquisition unit 200. Fig. 4 is a cross-sectional view showing the base end side of the catheter for diagnostic imaging.
[0020] The second acquisition unit 200 according to this embodiment is a dual-type imaging diagnostic catheter having both functions of intravascular ultrasound (IVUS) and optical coherence tomography (OCT). However, medical instruments connectable to the external device 300 are not limited to the above, and may be, for example, an IVUS catheter or a catheter used for purposes other than acquiring diagnostic images (e.g., a treatment catheter, etc.).
[0021] The imaging diagnostic catheter associated with the second acquisition section 200 will be described with reference to FIGS.
[0022] As shown in FIG. 1, the imaging diagnostic catheter associated with the second acquisition unit 200 is driven by being connected to an external device 300 .
[0023] 1, 2(A), and 2(B), the diagnostic imaging catheter associated with the second acquisition unit 200 includes a long sheath (corresponding to a "medical long body") 210 inserted into a body cavity of a living body, and an outer tube 220 provided on the base end side of the sheath 210. The diagnostic imaging catheter includes an inner shaft 230 inserted into the outer tube 220 so as to be movable forward and backward, and a drive shaft 240 having a signal transmitting / receiving unit 245 at its tip for transmitting and receiving signals and provided rotatably within the sheath 210. The diagnostic imaging catheter includes a unit connector 250 provided on the base end side of the outer tube 220 and configured to receive the inner shaft 230, and a hub 260 provided on the base end side of the inner shaft 230.
[0024] In the description of this specification, the side of the imaging diagnostic catheter that is inserted into a body cavity is referred to as the tip side, the side of the hub 260 provided on the imaging diagnostic catheter is referred to as the base side, and the extension direction of the sheath 210 is referred to as the axial direction.
[0025] The sheath 210 is inserted into a hollow organ of a subject.
[0026] 2(A), the drive shaft 240 passes through the sheath 210, the outer tube 220 connected to the base end of the sheath 210, and the inner shaft 230 inserted into the outer tube 220, and extends to the inside of the hub 260. A signal transmitting / receiving unit 245 capable of transmitting and receiving waves of a predetermined wavelength (about several MHz) is provided at the tip of the drive shaft 240.
[0027] The hub 260, the inner shaft 230, the drive shaft 240, and the signal transmitting / receiving unit 245 are connected to each other so as to move forward and backward in the axial direction integrally. Therefore, for example, when the hub 260 is pushed toward the tip side, the inner shaft 230 connected to the hub 260 is pushed into the outer tube 220 and the unit connector 250.
[0028] Then, the drive shaft 240 and the signal transmitting / receiving unit 245 move toward the distal end inside the sheath 210. For example, when the hub 260 is pulled toward the proximal end, the inner shaft 230 is pulled out from the outer tube 220 and the unit connector 250 as shown by the arrow a1 in Figures 1 and 2(B) . Also, when the hub 260 is pulled toward the proximal end, the drive shaft 240 and the signal transmitting / receiving unit 245 move toward the proximal end inside the sheath 210 as shown by the arrow a2 in Figure 1 .
[0029] 2(A), when the inner shaft 230 is pushed all the way toward the tip side, the tip of the inner shaft 230 reaches near the relay connector 270. At this time, the signal transmitting / receiving unit 245 is located near the tip of the sheath 210. The relay connector 270 is a connector that connects the sheath 210 and the outer tube 220.
[0030] 2(B), a connector 231 for preventing disengagement is provided at the tip of the inner shaft 230. The connector 231 for preventing disengagement has a function of preventing the inner shaft 230 from disengaging from the outer tube 220. The connector 231 for preventing disengagement is configured to catch at a predetermined position on the inner wall of the unit connector 250 when the hub 260 is pulled all the way toward the base end.
[0031] As shown in FIG. 3, the drive shaft 240 includes a flexible tubular body 241, in which an electric signal cable 242 and an optical fiber 243 connected to a signal transmitting / receiving unit 245 are arranged. The tubular body 241 can be formed, for example, of a multi-layer coil with different winding directions around the axis. Examples of materials for the coil include stainless steel and Ni-Ti (nickel-titanium) alloy. In this embodiment, the electric signal cable 242 is electrically connected to an electrode terminal 265b provided in a connector unit 265 described later. The electric signal cable 242 is configured to include two signal lines 242a and 242b for transmitting and receiving high-frequency voltage.
[0032] As shown in FIG. 3, the signal transmitting / receiving unit 245 has an ultrasonic transmitting / receiving unit 245a that transmits and receives ultrasonic waves, and an optical transmitting / receiving unit 245b that transmits and receives light.
[0033] The ultrasonic transmission / reception unit 245a includes a transducer and has a function of transmitting ultrasonic waves based on a pulse signal into the body cavity and receiving ultrasonic waves reflected from the biological tissue in the body cavity. The ultrasonic transmission / reception unit 245a is electrically connected to the electrode terminal 265b at the base end side of the imaging diagnostic catheter via the electric signal cable 242.
[0034] The transducer included in the ultrasonic transmission / reception unit 245a may be made of a piezoelectric material such as ceramics or quartz crystal.
[0035] The optical transmitter / receiver 245b continuously transmits the transmitted measurement light into the body cavity and continuously receives the reflected light from the biological tissue in the body cavity. The optical transmitter / receiver 245b is provided at the tip of the optical fiber 243 and has a ball lens (optical element) having a lens function of collecting light and a reflecting function of reflecting light.
[0036] The signal transmitting / receiving unit 245 is accommodated inside a housing 246 as shown in Fig. 3. The base end side of the housing 246 is connected to the drive shaft 240. As shown in Fig. 3, the housing 246 has a shape in which an opening is provided on the cylindrical surface of a cylindrical metal pipe so as not to impede the progression of the ultrasonic waves transmitted and received by the ultrasonic transmitting / receiving unit 245a and the light transmitted and received by the optical transmitting / receiving unit 245b.
[0037] 3, the sheath 210 has a lumen 210a into which the drive shaft 240 is inserted so as to be capable of advancing and retreating. A guidewire insertion member 214 is attached to the distal end of the sheath 210, and is arranged in parallel with the lumen 210a provided in the sheath 210 and includes a guidewire lumen 214a through which a guidewire G can be inserted.
[0038] The sheath 210 and the guidewire insertion member 214 can be integrally configured by heat fusion or the like. The guidewire insertion member 214 is provided with a marker 215 having X-ray contrast. The marker 215 is made of a metal coil having high X-ray opacity, such as Pt or Au. In addition, by providing the marker in the housing 246, the position of the signal transmitting / receiving unit 245 and the three-dimensional coordinates acquired by the first acquisition unit 100 can be identified in real time from a contrast image.
[0039] A communication hole 216 that connects the inside and outside of the lumen 210a is formed at the distal end of the sheath 210. In addition, a reinforcing member 217 for firmly joining and supporting the guidewire insertion member 214 is provided at the distal end of the sheath 210.
[0040] The reinforcing member 217 has a communication passage 217a that communicates between the inside of the lumen 210a disposed on the proximal side of the reinforcing member 217 and the communication hole 216. The reinforcing member 217 does not necessarily have to be provided at the distal end of the sheath 210.
[0041] The communication hole 216 is a priming liquid discharge hole for discharging the priming liquid. When the imaging diagnostic catheter is used, a priming process is performed in which the priming liquid is filled into the sheath 210 in order to reduce attenuation of ultrasound due to air in the sheath 210 and efficiently transmit and receive ultrasound. When performing the priming process, the priming liquid is released to the outside from the communication hole 216, and gas such as air can be discharged from the inside of the sheath 210 together with the priming liquid.
[0042] The sheath 210, the guidewire insertion member 214, and the reinforcing member 217 are formed of a flexible material, and the material is not particularly limited, and examples thereof include various thermoplastic elastomers such as styrene-based, polyolefin-based, polyurethane-based, polyester-based, polyamide-based, polyimide-based, polybutadiene-based, trans-polyisoprene-based, fluororubber-based, and chlorinated polyethylene-based, and a combination of one or more of these (polymer alloy, polymer blend, laminate, etc.) can also be used. Note that a hydrophilic lubricating coating layer that exhibits lubricity when wet can be disposed on the outer surface of the sheath 210.
[0043] As shown in FIG. 4, hub 260 includes hub body 261 having a hollow shape, connector case 265c connected to the base end side of hub body 261, and port 262 communicating with the inside of hub body 261.
[0044] The hub 260 includes projections 263a and 263b for positioning (directing) the hub 260 when connecting to an external device 300, and a connection pipe 264b for holding the drive shaft 240.
[0045] The hub 260 includes a bearing 264c that rotatably supports the connection pipe 264b, and a seal member 264a that prevents the priming solution from leaking from between the connection pipe 264b and the bearing 264c toward the base end side. The hub 260 includes a connector section 265 in which an electrode terminal 265b and an optical connector 265a that are connected to the external device 300 are disposed.
[0046] The inner shaft 230 is connected to the tip end of the hub body 261. The drive shaft 240 is drawn out from the inner shaft 230 inside the hub body 261.
[0047] An injection device S (see FIG. 1) for injecting a priming liquid when performing a priming process is connected to the port 262. The injection device S includes a connector S1 connected to the port 262, a tube S2 connected to the connector S1, and a three-way stopcock S3 connected to the tube S2.
[0048] The injection device S is connected to the three-way stopcock S3 and includes a first syringe S4 and a second syringe S5 capable of injecting priming fluid into the port 262. The second syringe S5 has a larger capacity than the first syringe S4 and is used as an auxiliary syringe when the amount of priming fluid injected by the first syringe S4 is insufficient, for example.
[0049] The connection pipe 264b holds the drive shaft 240 in order to transmit the rotation of the electrode terminal 265b and the optical connector 265a, which are rotationally driven by the external device 300, to the drive shaft 240. An electric signal cable 242 and an optical fiber 243 are inserted inside the connection pipe 264b.
[0050] The connector unit 265 includes an optical connector 265a optically connected to an optical fiber, and an electrode terminal 265b electrically connected to the electric signal cable 242. A signal received by the ultrasonic transmitting / receiving unit 245a is transmitted to the external device 300 via the electrode terminal 265b, where it is subjected to a predetermined process and displayed as an image. A signal received by the optical transmitting / receiving unit 245b is transmitted to the external device 300 via the optical connector 265a, where it is subjected to a predetermined process and displayed as an image.
[0051] (external device) With reference to FIG. 3, the imaging diagnostic catheter associated with the second acquisition section 200 is connected to an external device 300 and driven.
[0052] As described above, the external device 300 is connected to the connector portion 265 (see FIG. 4) provided on the proximal end side of the hub 260.
[0053] 1, the external device 300 has a motor 300a which is a power source for rotating the drive shaft 240, and a motor 300b which is a power source for axially moving the drive shaft 240. The rotational motion of the motor 300b is converted into axial motion by a ball screw 300c connected to the motor 300b.
[0054] The operation of the external device 300 is controlled by a control device 301 electrically connected thereto. The control device 301 includes a second storage unit 301b (corresponding to a storage unit), a processor 301a (corresponding to a setting unit), and an input unit 301c. The control device 301 is electrically connected to a monitor 302. The processor 301a generates two-dimensional data of the hollow organ from the signal acquired by the signal transmitting / receiving unit 245.
[0055] The second storage unit 301b stores the two-dimensional data generated from the signal acquired (received) by the second acquisition unit 200. The second storage unit 301b includes a ROM for storing programs and the like used when generating the two-dimensional data, a RAM for temporarily storing programs and data as a working area, an auxiliary storage unit for storing the generated two-dimensional data, and the like.
[0056] The 3D image data of the tubular organ is generated by the main server 400, which will be described later, using a plurality of frames of tomographic images acquired by the imaging diagnostic catheter associated with the second acquisition unit 200. Here, the number of frames of the tomographic images used for generating the 3D image data is set based on the remaining storage capacity of the auxiliary storage unit associated with the second storage unit 301b at the time when the three-dimensional coordinates and the two-dimensional data are associated with the second storage unit 301b. Here, the remaining storage capacity at the time means the remaining storage capacity at the time in the auxiliary storage unit constituting the second storage unit 301b or the remaining storage capacity at the time among the maximum storage capacity that can be set by the user for one piece of 3D image data. Note that, if the user does not set the available storage capacity for one piece of 3D image data, the available storage capacity for 3D image data may be set in advance as an initial setting so as to be changeable.
[0057] The auxiliary storage unit of the second storage unit 301b stores signals and the like received by the signal transmission / reception unit 245. The auxiliary storage unit of the second storage unit 301b can be configured to include at least one of a hard disk drive (HDD), a solid state drive (SSD), a memory card, a CD, a DVD, a Blu-ray (registered trademark) Disc (BD), and the like. The control device 301 is electrically connected to the main server 400, and can transmit to the main server 400 a cross-sectional image (two-dimensional data) generated by the control device 301 from a signal received by the signal transmission / reception unit 245.
[0058] The processor 301a selects two-dimensional data to be associated with three-dimensional coordinates from the two-dimensional data stored in the second storage unit 301b based on a range for generating 3D image data specified by an input unit 301c (described later). The processor 301a has one or more processors. The processor 301a is, for example, any one of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit).
[0059] Fig. 5 is a diagram showing the generating positions of the two-dimensional data acquired by the second acquisition section 200. Fig. 6 is a diagram showing the deletion of the generated two-dimensional data. As described above, the 3D image data is generated from the two-dimensional data (tomographic images) acquired by the second acquisition section 200 for a predetermined number of frames. The acquired two-dimensional data is generated by the second acquisition section 200 at intervals in the longitudinal direction of the hollow organ, such as positions 1-10 shown in Fig. 5.
[0060] When a medical professional uses the imaging diagnostic catheter associated with the second acquisition unit 200 to obtain a tomographic image of a predetermined position, the medical professional moves the drive shaft 240 back and forth within the hollow organ.
[0061] A medical professional basically transmits and receives the signals necessary to generate a tomographic image by moving the drive shaft 240 in one direction within the tubular organ, from the tip end to the base end or from the base end to the tip end, as shown by data 1-5 in Figure 6.
[0062] However, during the procedure, as necessary, the drive shaft 240 may pass the same position multiple times in the longitudinal direction of a tubular organ such as a blood vessel, such as positions 6 and 7 in data 6-9 in FIG. 6, and two-dimensional data may be generated at that position.
[0063] In this embodiment, when the second storage unit 301b stores a plurality of two-dimensional data of the same position in a hollow organ, such as positions 6 and 7 (data 6-9) in FIG. 6, one of the two-dimensional data is deleted from the second storage unit 301b.
[0064] When the generated two-dimensional data are at the same position in the hollow organ, the processor 301a deletes from the second storage unit 301b the two-dimensional data for which the time when the signal required for generating the 3D image data was received (acquired) is not the latest, i.e., the acquisition time is old. Specifically, in Fig. 6, data 6 and 7 are deleted. Note that the above time may be the time when the two-dimensional data was generated instead of the time when the signal required for generating the two-dimensional data was acquired.
[0065] The input unit 301c is configured to be able to specify the range of the two-dimensional data when associating the three-dimensional coordinates acquired by the first acquisition unit 100 with the two-dimensional data in order to generate the 3D image data. In this embodiment, the input unit 301c is configured to be able to specify the area in which the 3D image data is to be generated as a start point and an end point. The input unit 301c may also be configured to be able to specify the storage capacity of the auxiliary storage unit that can be used for each piece of 3D image data. The input unit 301c can be configured to include at least one of a mouse, a keyboard, a touch panel, a button, and the like.
[0066] (Main Server) The main server 400 stores the three-dimensional coordinates acquired by the first acquisition unit 100 and the two-dimensional data generated by the second acquisition unit 200 in association with each other. The main server 400 includes a third storage unit 410, a processor 420, and an input / output unit 430.
[0067] The third storage unit 410 stores the three-dimensional coordinates acquired by the first acquisition unit 100 and the two-dimensional data generated by the second acquisition unit 200 in association with each other. Specifically, when the above-mentioned signal transmission / reception unit 245 receives an ultrasonic wave at a specific position, the position is collated with the three-dimensional coordinates acquired by the first acquisition unit 100. This allows the second acquisition unit 200 to identify the generation position of the two-dimensional data in real time when the second acquisition unit 200 receives an ultrasonic signal while pulling back and generates the two-dimensional data.
[0068] The third storage unit 410 includes a RAM, a ROM, an auxiliary storage unit, etc. A program for associating three-dimensional coordinates with two-dimensional data is stored in the ROM, and the three-dimensional coordinates acquired from the first acquisition unit 100 and the two-dimensional data generated by the second acquisition unit 200 are read out to the RAM. The auxiliary storage unit stores data that associates the three-dimensional coordinates with the two-dimensional data.
[0069] The auxiliary storage unit is not particularly limited, but can be configured to include an HDD, an SSD, etc., similar to the first acquisition unit 100, etc.
[0070] The processor 420 is configured to associate the three-dimensional coordinates acquired by the first acquisition unit 100 with the two-dimensional data generated by the second acquisition unit 200.
[0071] The processor 420 includes one or more processors. The processor 420 is, for example, any one of a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), and the like.
[0072] The two-dimensional data generated by the imaging diagnostic catheter associated with the second acquisition unit 200 can be used to generate 3D image data based on three-dimensional coordinates using a technique such as volume rendering.
[0073] The input / output unit 430 is configured to be able to instruct to associate the three-dimensional coordinates acquired by the first acquisition unit 100 with the two-dimensional data generated by the second acquisition unit 200. The input / output unit 430 may include a mouse, a keyboard, a button, a display, a touch panel, etc.
[0074] (Example of use) Next, a method using the medical system 1 according to this embodiment will be described.
[0075] In general, in PCI, a balloon catheter or the like is placed in the narrowed part of a patient's blood vessel etc. and dilated (also called pre-dilation), a stent or the like is placed in the narrowed part, and a balloon catheter or the like is placed in the narrowed part to dilate (also called post-dilation). The method described below can be used during pre-dilation or post-dilation.
[0076] First, a medical professional places the subject on the bed 130 of the first acquisition unit 100, operates the input / output unit 160, and uses the irradiation unit 110 and detection unit 120, etc. to acquire (store) the three-dimensional coordinates of the subject's blood vessels in the first memory unit 140 (S1).
[0077] Next, the medical staff uses the second acquisition unit 200 to generate two-dimensional data.
[0078] Specifically, the medical professional connects a device for injecting a priming fluid to port 262 while pulling hub 260 to the most proximal end side, and injects the priming fluid into lumen 210 a of sheath 210 .
[0079] When the priming liquid is injected into the lumen 210a, the priming liquid is discharged to the outside of the sheath 210 through the communication passage 217a and the communication hole 216. This allows gas such as air to be discharged from the inside of the sheath 210 to the outside together with the priming liquid.
[0080] After the priming process, the user connects the external device 300 to the connector portion 265 of the imaging diagnostic catheter as shown in Fig. 3. Then, the user pushes the hub 260 into the unit connector 250 until it abuts against the base end of the unit connector 250, and moves the signal transmitting / receiving portion 245 to the tip side.
[0081] Next, the medical staff forms a port in the wrist or thigh using an introducer kit. Next, a guide wire (not shown) is inserted to near the entrance of the coronary artery (coronary artery) of the living body's heart. Then, a guiding catheter is inserted along the guide wire to the target site. Next, the surgeon removes the guide wire and inserts another guide wire through the guiding catheter to the lesion. Next, a catheter for image diagnosis related to the second acquisition unit 200 is inserted along the other guide wire to the lesion.
[0082] Next, the distal end of the diagnostic imaging catheter is projected from the distal end opening of the guiding catheter. A known guiding catheter can be used.
[0083] Next, the blood in the blood vessels is temporarily replaced with a flushing liquid such as a contrast agent. As in the priming process described above, a syringe containing the flushing liquid is connected to the port of the guiding catheter, and the plunger of the syringe is pressed to inject the flushing liquid into the lumen of the guiding catheter.
[0084] The flushing liquid passes through the lumen of the guiding catheter and is introduced into the blood vessel through the tip opening. The introduced flushing liquid washes away the blood around the tip of the sheath 210, filling the area around the tip of the sheath 210 with flushing liquid. In a mode in which tomographic images are acquired only by IVUS, the above-mentioned step of replacing with flushing liquid can be omitted.
[0085] When obtaining a tomographic image at a target position in a blood vessel, the signal transmitting / receiving unit 245 moves toward the base end side while rotating together with the drive shaft 240 (pullback operation). Simultaneously with the pullback operation, the ultrasonic transmitting / receiving unit 245a transmits ultrasonic waves toward the blood vessel wall and receives ultrasonic waves reflected by the blood vessel wall.
[0086] At the same time, the optical transceiver 245b also transmits measurement light toward the vascular wall and receives the reflected light reflected by the vascular wall. As described above, the ultrasonic waves transmitted from the ultrasonic transceiver 245a and the measurement light transmitted from the optical transceiver 245b cross each other, so that the area inspected by the ultrasonic waves in the living body can be superimposed on the area inspected by the light.
[0087] The rotation and movement of the drive shaft 240 are controlled by a control device 301. A connector portion 265 provided in the hub 260 is rotated while connected to an external device 300, and the drive shaft 240 rotates in conjunction with this.
[0088] Furthermore, the signal transmitting / receiving unit 245 transmits ultrasound and light into the body based on a signal sent from the control device 301. Signals corresponding to the reflected waves and reflected light received by the signal transmitting / receiving unit 245 are sent to the control device 301 via the drive shaft 240 and the external device 300. The control device 301 generates a tomographic image (two-dimensional data) of the hollow organ based on the signal sent from the signal transmitting / receiving unit 245 (S2).
[0089] A medical professional specifies, via the input unit 301c, an area of a hollow organ that is to be generated as a three-dimensional image from the three-dimensional coordinates acquired by the first acquisition unit 100 or the two-dimensional data generated by the second acquisition unit 200 (S3).
[0090] The processor 301a calculates the size of an area that can be used as a storage area for three-dimensional image data of a hollow organ in the auxiliary storage unit of the second storage unit 301b.
[0091] Then, the processor 301a calculates the interval (number of frames) of the region from the start point to the end point in the tomographic image generated by the second acquisition unit 200 based on the capacity of the available storage area in the second storage unit 301b.
[0092] The processor 420 of the main server 400, in response to instructions from the input / output unit 430, matches the three-dimensional coordinates from the first acquisition unit 100 with the two-dimensional data specified in the second acquisition unit 200 using the program in the third memory unit 410, and stores them in the auxiliary memory unit of the third memory unit 410.
[0093] Therefore, depending on the relationship between the current capacity of the auxiliary storage unit of the second storage unit 301b and the area designated by the user for generating 3D image data, the two-dimensional data acquired from the second acquisition unit 200 is partially used. For example, the processor 301a uses every other two-dimensional data generated by the second acquisition unit 200 in the longitudinal direction of the hollow organ, and deletes the remaining two-dimensional data from the second storage unit 301b.
[0094] In addition to the above, when there are multiple pieces of two-dimensional data at the same position of the tubular organ as shown in FIG. 6 as described above, the processor 301a can also delete the two-dimensional data other than the most recent data from the second storage unit 301b.
[0095] The two-dimensional data generated by the second acquisition unit 200 in this manner is selected by the processor 301a, associated (corresponded) with the three-dimensional coordinates acquired by the first acquisition unit 100, and then stored (contained / saved) in the third memory unit 410 (S4).
[0096] As described above, the medical system 1 according to this embodiment includes the first acquisition unit 100, the second acquisition unit 200, the second storage unit 301b, the input unit 301c, and the processor 301a. The first acquisition unit 100 is configured to acquire three-dimensional coordinates of a tubular organ of a subject. The second acquisition unit 200 is inserted into the tubular organ of a subject, and is provided with a signal transmission / reception unit 245 capable of transmitting and receiving waves of a predetermined wavelength at its tip, and is configured to generate two-dimensional data from a signal acquired by the signal transmission / reception unit 245. The second storage unit 301b is configured to store the two-dimensional data generated from the signal acquired by the second acquisition unit 200. The input unit 301c is configured to specify a range of two-dimensional data associated with the three-dimensional coordinates when associating the three-dimensional coordinates with the two-dimensional data. The processor 301a is configured to select two-dimensional data associated with three-dimensional coordinates from the two-dimensional data stored in the second storage unit 301b based on the range specified by the input unit 301c.
[0097] In this way, the processor 301a is configured to select the two-dimensional data stored in the second storage unit 301b when generating 3D image data of a hollow organ, so that the amount of data stored in the second storage unit 301b can be prevented from becoming excessively large.
[0098] In addition, when two-dimensional data are acquired at the same position in the longitudinal direction of a hollow organ such as a blood vessel, one of the two-dimensional data at the same position stored in the second storage unit 301b is deleted. In order to generate 3D image data of a hollow organ, one piece of two-dimensional data at the same position is sufficient, and the remaining two-dimensional data at the same position is likely unnecessary. Therefore, by configuring as described above, two-dimensional data can be efficiently stored in the second storage unit 301b.
[0099] In addition, as described above, the two-dimensional data is assigned the time when the signal was acquired or the time when the two-dimensional data was generated. When two-dimensional data is generated multiple times at the same position of the hollow organ, the data to be deleted is configured to be the two-dimensional data with the older signal acquisition time or the older two-dimensional data generation time. When the signal transmitting / receiving unit 245 passes the same position multiple times, it can be considered that the signal transmitting / receiving unit 245 needs to pass through the hollow organ at a newer time than at an older time. Therefore, by configuring as described above, the two-dimensional data required for generating 3D image data of the hollow organ can be efficiently stored in the second storage unit 301b.
[0100] Furthermore, multiple frames of two-dimensional data are acquired to generate a 3D image of a hollow organ. The number of frames of two-dimensional data is set based on the storage capacity at the time when the three-dimensional coordinates and the two-dimensional data are associated in the second storage unit 301b. This configuration makes it possible to prevent a situation in which an enormous amount of two-dimensional data is stored, causing the system to operate slowly, regardless of the storage capacity of the second storage unit 301b at the time.
[0101] Second embodiment Fig. 8 is a diagram showing a medical system 1a according to the second embodiment, and Fig. 9 is a flowchart showing a 3D image data generating method according to the second embodiment. In the first embodiment, the area for generating a 3D image is set after acquiring two-dimensional data by the second acquisition unit 200, but it can also be configured as follows.
[0102] A medical system 1a according to this embodiment will be described below. As shown in Fig. 8, the medical system 1a includes a first acquisition unit 100, a second acquisition unit 200, an external device 300A, a main server 400A, and an angiography device 500. In this embodiment, the first acquisition unit 100 and the second acquisition unit 200 are the same as those in the first embodiment, and therefore description thereof will be omitted.
[0103] (external device) The external device 300A includes motors 300a, 300b, a ball screw 300c, a control device 301A, and a monitor 302. Note that the motors 300a, 300b, the ball screw 300c, and the monitor 302 of the external device 300A are similar to those in the first embodiment, and therefore description thereof will be omitted.
[0104] The control device 301A includes a processor 301d (corresponding to a "setting unit"), a second storage unit 301e (corresponding to a "storage unit"), and an input unit 301f.
[0105] The processor 301d sets the amount of two-dimensional data of the hollow organ to be stored in the second storage unit 301e in association with the three-dimensional coordinates acquired by the first acquisition unit 100, based on the range specified by the input unit 301f.
[0106] The processor 301d sets the data acquisition interval based on the range specified by the input unit 301c using the matching result between the two-dimensional data from the angio device 500 and the two-dimensional data from the first acquisition unit 100 performed by the processor 420a described below. The two-dimensional data from the first acquisition unit 100 and the two-dimensional data from the angio device 500 can be read out from the third storage unit 410a of the main server 400A.
[0107] The second storage unit 301e stores two-dimensional data generated from a signal acquired by the second acquisition unit 200, similar to the first embodiment. The second storage unit 301e includes a ROM, a RAM, and an auxiliary storage unit, similar to the second storage unit 301b. The RAM of the second storage unit 301e can temporarily store the matching result of the two-dimensional data of the first acquisition unit 100 and the angiography device 500 read from the third storage unit 410a of the main server 400A. The ROM of the second storage unit 301e can store a program for acquiring two-dimensional data in a range specified by the input unit 301f and at an interval calculated by the processor 301d. The auxiliary storage unit of the second storage unit 301e can be configured similarly to the first embodiment.
[0108] The input unit 301f is configured to be able to specify a range of two-dimensional data to be associated with the three-dimensional coordinates acquired by the first acquisition unit 100 when associating the three-dimensional coordinates with the two-dimensional data. The input unit 301f is configured to be able to set a start point and an end point for the angio image data of the angio apparatus 500, which is associated with the three-dimensional coordinates acquired by the first acquisition unit 100 in this embodiment. Details will be described later.
[0109] (Main Server) The main server 400A stores the three-dimensional coordinates acquired by the first acquisition unit 100 and the two-dimensional data generated by the second acquisition unit 200 in association with each other. The main server 400A includes a third storage unit 410a, a processor 420a, and an input / output unit 430a, as shown in FIG.
[0110] The third storage unit 410a can include a ROM, a RAM, an auxiliary storage unit, etc., similar to the first embodiment. The ROM of the third storage unit 410a can store a program or the like for comparing an image obtained by the first acquisition unit 100 with two-dimensional data from the angiography apparatus 500 to identify the most similar image.
[0111] The RAM of the third storage unit 410a can store the two-dimensional data acquired from the first acquisition unit 100 and the two-dimensional data of the angio image acquired from the angio device 500. The auxiliary storage unit of the third storage unit 410a can store the matching results of the two-dimensional data of the first acquisition unit 100 and the angio device 500. From these data, the three-dimensional coordinates of the first acquisition unit 100 can be associated with the two-dimensional data of the angio device 500.
[0112] (Angio Equipment) The angiography apparatus 500 is configured to be able to acquire an angiography image of a hollow organ. The angiography apparatus 500 is similar to the first acquisition unit 100, except that the irradiation unit 110 and the detection unit 120 are not rotatable like the gantry of the first acquisition unit 100. Therefore, a detailed description will be omitted.
[0113] (Example of use) Next, a 3D image data generating method according to this embodiment will be described with reference to FIG.
[0114] First, a medical professional places the subject on the bed 130 of the first acquisition unit 100, gives instructions from the input / output unit 160, and uses the irradiation unit 110 and detection unit 120, etc. to acquire (store) two-dimensional data and three-dimensional coordinates of the subject's blood vessels in the first memory unit 140 (S1).
[0115] Next, the medical staff injects a contrast agent into a hollow organ such as a blood vessel, and uses the angiography device 500 to display an angiography image (two-dimensional data) of the hollow organ on a display or the like related to the input / output unit of the angiography device 500 (S2). The image displayed on the input / output unit of the angiography device 500 can be transmitted as data to the main server 400A.
[0116] Next, the medical staff operates the input / output unit 430a of the main server 400A to perform pattern matching by comparing the two-dimensional data acquired by the first acquisition unit 100 with two-dimensional data of the angio image acquired by the angio device 500 (S3). Since the two-dimensional data of the first acquisition unit 100 is associated with three-dimensional coordinates, the two-dimensional data by the angio device 500 can be associated with the three-dimensional coordinates acquired by the first acquisition unit 100 through the above matching (S4).
[0117] Next, the medical staff specifies, via the input unit 301f, the region of the hollow organ to be generated as a 3D image from the 3D coordinates acquired by the first acquisition unit 100 and the 2D image based on the angio image, from the start point to the end point (S5).
[0118] Next, the processor 301d calculates the size of an area that can be used as a storage area for the three-dimensional image data of the hollow organ in the auxiliary storage unit of the second storage unit 301e.
[0119] Then, the processor 301d calculates the data acquisition interval in the range from the start point to the end point specified by the input unit 301f, based on the capacity of the available storage area in the second storage unit 301e (S6).
[0120] Then, the second acquisition unit 200 acquires two-dimensional data of the hollow organ (S7). When acquiring images at set intervals, the signal transmission / reception unit 245 can acquire two-dimensional data every time it moves at the set interval based on the angio images acquired by the angio apparatus 500. Acquisition of tomographic images of the hollow organ by the second acquisition unit 200 is similar to step S2 in Fig. 7 in the first embodiment, and therefore will not be described.
[0121] The processor 420a of the main server 400A uses the program in the third storage unit 410a to associate the three-dimensional coordinates from the first acquisition unit 100 with the two-dimensional data acquired by the second acquisition unit 200 in response to an instruction (input) from the input / output unit 430a. Then, the processor 420a stores the data in the auxiliary storage unit of the third storage unit 410a.
[0122] Thus, in this embodiment, the medical system 1a includes the first acquisition unit 100, the second acquisition unit 200, the second storage unit 301e, the processor 301d, and the input unit 301f. The first acquisition unit 100 acquires three-dimensional coordinates of the tubular organ of the subject. The second acquisition unit 200 includes a signal transmission / reception unit 245 that is inserted into the tubular organ of the subject and is capable of transmitting and receiving waves of a predetermined wavelength at its tip, and generates two-dimensional data from a signal acquired by the signal transmission / reception unit 245. The second storage unit 301e stores the two-dimensional data generated from the signal acquired by the second acquisition unit 200. The input unit 301f is configured to be able to specify a range of two-dimensional data associated with the three-dimensional coordinates when associating the three-dimensional coordinates with the two-dimensional data. The processor 301d sets the amount of data of the two-dimensional data of the tubular organ stored in the second storage unit 301e in association with the three-dimensional coordinates based on the above range.
[0123] With this configuration, it is possible to prevent the amount of two-dimensional data stored in the second storage unit 301e from becoming excessively large.
[0124] The medical system 1a also includes an angio apparatus 500 capable of acquiring an angio image of a hollow organ. The first acquisition unit 100 is configured to acquire two-dimensional data of the hollow organ associated with three-dimensional coordinates. The input unit 301f is configured to specify the above-mentioned range for the angio image data from the angio apparatus 500 associated with the three-dimensional coordinates acquired by the first acquisition unit 100. By configuring in this way, it is possible to prevent the amount of data stored in the second storage unit 301e from becoming excessively large, as in the above case.
[0125] The second storage unit 301e is configured to store two-dimensional data acquired at set intervals from the start point to the end point. Therefore, even if a process of deleting data from the second storage unit is not performed as in the first embodiment, it is possible to prevent the amount of data stored in the second storage unit 301e from becoming excessively large.
[0126] The present disclosure is not limited to the above-described embodiment, and various modifications are possible within the scope of the claims.
[0127] In the above embodiment, the second acquisition unit 200 generates a plurality of two-dimensional data at the same position in the hollow organ, and when the processor 301a deletes any of the two-dimensional data, the two-dimensional data to be deleted is the oldest one. However, the present disclosure is not limited to the above as long as the storage efficiency of the second storage unit can be improved.
[0128] 10 and 11 are diagrams illustrating a case where any of the two-dimensional data generated by the second acquisition unit is selected using a trained model generated by machine learning in one embodiment of the present disclosure.
[0129] In addition to the above, the two-dimensional data generated by the second acquisition unit 200 may be input with either a correct answer label or an abnormality label assigned thereto, and the processor 301a may be configured to select images to be deleted using a trained model generated by machine learning.
[0130] The image to which the correct answer label has been assigned may be an image without noise or with very little noise, such as the two-dimensional data shown in Fig. 10. The image to which the abnormality label has been assigned may be an image containing noise N (also called artifacts) such as a guidewire shadow or image blur, as shown in Fig. 11. The generated trained model is stored in the ROM or the like constituting the second storage unit.
[0131] In this way, when multiple pieces of data are acquired at the same position in a hollow organ, the data to be deleted can be selected using a trained model generated by machine learning. This configuration can efficiently reduce the amount of 2D data required to generate 3D image data and improve the accuracy of image selection of 2D data.
[0132] Also, it has been explained that the configuration for specifying the range of two-dimensional data associated with three-dimensional coordinates for data of an angio image by the angio apparatus 500 is applied to the medical system 1a according to the second embodiment. However, the specification of the range of two-dimensional data associated with three-dimensional coordinates for data of an angio image by the angio apparatus 500 may be applied to the medical system 1 according to the first embodiment. This application is based on Japanese Patent Application No. 2020-060604 filed on March 30, 2020, the disclosure of which is incorporated by reference in its entirety. [Explanation of symbols]
[0133] 1, 1a Healthcare system; 100 1st acquisition part, 200 Second Acquisition Division, 300, 300A external device, 301a, 301d processor (setting unit), 301b, 301e second storage section (storage section), 301c, 301f Input section.
Claims
1. A first acquisition unit capable of acquiring three-dimensional coordinates of a hollow organ of a subject; a second acquisition unit that is inserted into the tubular organ of the subject and has a transceiver unit at a tip thereof capable of transmitting and receiving waves of a predetermined wavelength, and that is capable of generating two-dimensional data from a signal acquired by the transceiver unit; a storage unit that stores the two-dimensional data generated from the signal acquired by the second acquisition unit; an input unit capable of specifying a range of the two-dimensional data to be associated with the three-dimensional coordinates when associating the three-dimensional coordinates with the two-dimensional data; a setting unit that sets a data amount of the two-dimensional data of the hollow organ to be stored in the storage unit in association with the three-dimensional coordinates based on the range; An angiography device capable of acquiring an angiography image of a hollow organ, setting an interval for acquiring data within a range designated by the input unit based on the capacity of the storage unit; Corresponding data of the angio image of the angio apparatus to the three-dimensional coordinates acquired by the first acquisition unit; A medical system comprising: a first acquiring unit that acquires the two-dimensional data based on the angio image, the second acquiring unit acquiring the two-dimensional data each time the second acquiring unit moves the set interval.
2. The medical system according to claim 1 , wherein when a plurality of pieces of the two-dimensional data for the same position of a tubular organ are stored in the storage unit, the two-dimensional data for the same position is deleted from the storage unit.
3. The two-dimensional data is provided with a time when a signal related to the two-dimensional data is acquired or when the two-dimensional data is generated; The medical system according to claim 2 , wherein the two-dimensional data to be deleted from the storage unit is selected based on the time.
4. The medical system according to claim 2 , wherein the two-dimensional data to be deleted from the memory unit is selected using a trained model generated by machine learning.
5. The two-dimensional data is acquired in a plurality of frames in the range, The medical system according to any one of claims 1 to 4, wherein the number of frames of the two-dimensional data is set based on the capacity of the memory unit at the time when the three-dimensional coordinates and the two-dimensional data are associated with each other.
Citation Information
Patent Citations
Ultrasonic image generator
JP1998005224A
Ultrasonic image processor
JP2004135950A
Method of registering 2d image data of hollow tube together with 3D image data of hollow tube
JP2005253963A
Biomedical tomographic image generating apparatus and information processing method for the same
JP2010201077A
Catheter with ultrasound sensor and method for creating a volume graphic by means of the catheter
US20140039294A1
