Medical image processing devices, X-ray diagnostic systems, and storage media

By combining X-ray and ultrasound image processing to calculate catheter travel assistance information, the problem of operational difficulties caused by the narrow field of view of ultrasound catheters is solved, and the efficiency and accuracy of catheter surgery are improved.

CN117653179BActive Publication Date: 2026-11-17CANON MEDICAL SYST CORP
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202311156008.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2023-08-01
Filing Date
2023-09-07
Publication Date
2026-11-17
Estimated Expiration
2043-09-07

AI Technical Summary

Technical Problem

In catheter surgery, the narrow field of view of ultrasound catheters causes the area of ​​interest to fall out of the field of view. Operators need to frequently adjust the position of the catheter to keep the area of ​​interest in the field of view, which increases the difficulty and burden of the operation.

Method used

By using medical image processing equipment, combined with X-ray and ultrasound images, the system calculates catheter movement assistance information to help the operator adjust the catheter position appropriately, bringing the area of ​​interest into or close to the field of vision.

Benefits of technology

It allows operators to more easily control the ultrasound catheter, improving surgical efficiency, reducing the frequency of visual field loss, and lowering the difficulty of operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117653179B_ABST
    Figure CN117653179B_ABST
Patent Text Reader

Abstract

A medical image processing apparatus, an X-ray diagnostic system, and a storage medium are provided. The medical image processing apparatus includes processing circuitry that acquires an ultrasound image generated based on signals collected by a detector of an ultrasound catheter inserted into a subject; acquires an X-ray image depicting an object to be imaged, the object being imaged being at least one of the detector of the ultrasound catheter, a medical device inserted into the subject, or a region of interest within the subject; detects the position of the detector of the ultrasound catheter depicted in the X-ray image, and the position of the object to be imaged depicted in at least one of the ultrasound image and the X-ray image; and calculates, based on the position of the detector of the ultrasound catheter and the position of the object to be imaged, travel assistance information for moving the ultrasound catheter to bring the object to be imaged into the field of view of the detector, or travel assistance information for moving the ultrasound catheter to bring the object to be imaged closer to the center of the field of view of the detector.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is based on Japanese Patent Application 2022-142553 (filed on September 7, 2022) and Japanese Patent Application 2023-125592 (filed on August 1, 2023), from which it enjoys priority benefits. This application incorporates the entire contents of those applications by reference. Technical Field

[0002] The embodiments disclosed in this specification and accompanying drawings relate to medical image processing apparatus, X-ray diagnostic systems, and storage media. Background Technology

[0003] In the past, to improve the precision and efficiency of treatment, multiple medical imaging diagnostic devices of different types, such as X-ray diagnostic devices, ultrasound diagnostic devices, X-ray CT (Computed Tomography) devices, and magnetic resonance imaging devices, were sometimes used together. As an example, the combined use of X-ray and ultrasound diagnostic devices in catheter-guided image-guided therapy (IVR) is cited.

[0004] X-ray diagnostic devices are instruments that transmit X-rays through the body of a patient and visualize the transmitted image. For example, in catheter-based IVR, the physician inserts the catheter into the patient while confirming its position within the blood vessel using fluoroscopic or radiographic images from X-ray diagnostic devices such as X-ray angiography equipment. After the catheter has traveled to the treatment (or diagnostic) site of the patient, ultrasound images are sometimes used to visualize tissues that are difficult to identify from fluoroscopic and radiographic images, such as soft tissues.

[0005] Furthermore, transesophageal echocardiography (TEE) has been known to be useful in catheter treatment of structural heart diseases (SHD) such as left atrial appendage occlusion, as well as in observing the anatomy and physiological function of the heart and great vessels. However, TEE involves inserting an ultrasound endoscope through the mouth into the esophagus to observe the heart, thus generally requiring general anesthesia. In contrast, intracardiac echocardiography (ICE), an ultrasound catheter with a phased array element at its tip for transmitting and receiving ultrasound waves, can be performed under local anesthesia and is therefore less invasive than TEE. Therefore, ICE, used in conjunction with X-ray diagnostic equipment, has attracted attention in SHD treatment and other applications.

[0006] However, generally speaking, because the area of ​​the ultrasound image generated from the signal collected by the ICE, i.e., the imaging area of ​​the ICE (hereinafter referred to as the field of view), is narrower than that of the TEE, parts or all of the affected area such as the left atrial appendage, which is the area of ​​interest in treatments such as SHD, and medical devices such as left atrial appendage closure devices, may sometimes fall out of the ICE's field of view. Furthermore, when part or all of the area of ​​interest falls out of the ICE's field of view, the operator needs to move the ICE appropriately so that the area of ​​interest is depicted within the ICE's field of view.

[0007] Furthermore, even when the treatment target site or medical device, which is the area of ​​interest, is partially depicted within the ICE's field of view, exploring and displaying two-dimensional ultrasound images from the ICE's field of view to confirm the placement status of the medical device is a complex task. Additionally, when part or all of the area of ​​interest is not depicted within the ICE's field of view, searching for two-dimensional ultrasound images of the area of ​​interest while moving the ICE is a significant burden for the surgeon.

[0008] On the other hand, in recent years, catheter-assisted surgical robots have also been developed to assist in procedures using catheters. These robots are developed to enable catheter-assisted surgery from a remote location, or to fully or semi-automate catheter-assisted procedures. In other words, the surgeon may sometimes also be the catheter-assisted surgical robot. Summary of the Invention

[0009] One of the technical problems to be solved by the embodiments disclosed in this specification and accompanying drawings is to assist the operator in properly advancing the ultrasonic catheter. However, the technical problems to be solved by the embodiments disclosed in this specification and accompanying drawings are not limited to the above-mentioned technical problems. Other technical problems can also be identified as those corresponding to the effects of the structures shown in the following embodiments.

[0010] One embodiment of a medical image processing apparatus includes a processing circuit that acquires an ultrasound image generated based on signals collected by a detector of an ultrasound catheter inserted into the body of a subject; acquires an X-ray image depicting an object to be photographed, the object being photographed being at least one of the detector of the ultrasound catheter, a medical device inserted into the body of the subject, and a region of interest within the body of the subject; detects (a) the position of the detector of the ultrasound catheter depicted in the X-ray image, and (b) the position of the object to be photographed depicted in at least one of the ultrasound image and the X-ray image; and calculates, based on the detected position of the detector of the ultrasound catheter and the position of the object to be photographed, travel assistance information for moving the ultrasound catheter to bring the object to be photographed into the field of view of the detector, or travel assistance information for moving the ultrasound catheter to bring the object to be photographed closer to the center of the field of view of the detector.

[0011] The medical image processing device with the above structure can assist the operator in properly guiding the ultrasonic catheter. Attached Figure Description

[0012] Figure 1 This is a first schematic diagram showing a structural example of an X-ray diagnostic system equipped with the medical image processing apparatus of the first embodiment.

[0013] Figure 2 This is a second schematic diagram showing a structural example of an X-ray diagnostic system equipped with the medical image processing apparatus of the first embodiment.

[0014] Figure 3 This is a diagram illustrating an example of the surgical site in the first embodiment.

[0015] Figure 4 The first figure is used to illustrate an example of the surgery of the first embodiment.

[0016] Figure 5 The second figure is used to illustrate an example of the surgery in the first embodiment.

[0017] Figure 6 This is a schematic diagram illustrating a structural example of the medical image processing apparatus according to the first embodiment.

[0018] Figure 7 This is a flowchart illustrating an example of the operation of the medical image processing apparatus according to the first embodiment.

[0019] Figure 8 This is a diagram used to illustrate the X-ray image capture of the first embodiment.

[0020] Figure 9This is a diagram used to illustrate the position information of the ultrasonic detector in the first embodiment and the field of view in the ultrasonic image.

[0021] Figure 10 This is a perspective view illustrating an example of the travel assistance of the ultrasound catheter when the entire medical device of the first embodiment is out of the field of view of the ultrasound catheter detector, namely (a) before travel assistance and (b) after travel assistance.

[0022] Figure 11 This is a perspective view illustrating an example of the travel assistance of an ultrasound catheter when a part of the medical device of the first embodiment is out of the field of view of the detector of the ultrasound catheter, (a) before travel assistance and (b) after travel assistance.

[0023] Figure 12 This is a flowchart illustrating the operation of a medical image processing apparatus according to a variation of the first embodiment, Example 1.

[0024] Figure 13 This is a schematic diagram illustrating a structural example of the medical image processing apparatus according to the second embodiment.

[0025] Figure 14 This is a flowchart illustrating an example of the operation of the medical image processing apparatus according to the second embodiment.

[0026] Figure 15 This is a diagram illustrating an example of the ultrasonic images and their output sequence of the second embodiment.

[0027] Figure 16 This is a perspective view illustrating an example of the movement of the ultrasonic catheter 3 based on ultrasonic images from the second embodiment, specifically (a) before and (b) after movement assistance. Figure 17 This is a schematic diagram illustrating a structural example of an X-ray diagnostic system equipped with a medical image processing device and an auxiliary robot according to the third embodiment.

[0028] Figure 18 This is a schematic diagram illustrating a structural example of the medical image processing apparatus according to the third embodiment. Detailed Implementation

[0029] Hereinafter, embodiments of the medical image processing apparatus, X-ray diagnostic system, and storage medium will be described in detail with reference to the accompanying drawings.

[0030] (First Implementation) Figure 1 This is a first schematic diagram showing a structural example of an X-ray diagnostic system 1 equipped with the medical image processing apparatus of the first embodiment. For example, such as... Figure 1As shown, the X-ray diagnostic system 1 is configured to include a medical image processing device 100 and an X-ray diagnostic device 200. The medical image processing device 100 and the X-ray diagnostic device 200 are interconnected via a network 2. In addition, an ultrasound diagnostic device 300 is also connected to the network 2.

[0031] Figure 2 This is a second schematic diagram showing a structural example of an X-ray diagnostic system 1 equipped with the medical image processing apparatus of the first embodiment. Figure 2 The diagram shows a schematic representation of the structure of the X-ray diagnostic apparatus 200 of the first embodiment and the ultrasound diagnostic apparatus 300 connected to the X-ray diagnostic system 1.

[0032] like Figure 2 As shown, the X-ray diagnostic apparatus 200 of the first embodiment includes a stand 210, an examination bed 220, a controller 230, and an image processing device 240. The stand 210, the examination bed 220, and the controller 230 are generally located in an operating room (examination / treatment room), while the image processing device 240 is located in a control room adjacent to the operating room.

[0033] The stand device 210 includes an X-ray high-voltage generator 211, an X-ray irradiation device 212, a top plate (catheter workbench) 221, a C-arm 214, an X-ray detection device 215, a C-arm drive control mechanism 231, and a diagnostic bed drive control mechanism 232.

[0034] X-ray irradiation device 212 is disposed at one end of C-arm 214. X-ray irradiation device 212 is configured to move back and forth under the control of controller 230. X-ray irradiation device 212 includes an X-ray source 216 (e.g., an X-ray tube) and a movable aperture device 217. The X-ray tube receives a high-voltage power supply from the X-ray high-voltage generator 211 and generates X-rays according to the conditions of the high-voltage power supply. The movable aperture device 217 movably supports aperture blades made of X-ray-shielding material at the X-ray irradiation port of the X-ray tube. Alternatively, a line quality adjustment filter for adjusting the line quality of the X-rays generated by the X-ray tube may be provided on the front surface of the X-ray tube.

[0035] X-ray inspection device 215 is positioned opposite the other end of C-arm 214, namely X-ray irradiation device 212. X-ray inspection device 215 is configured to move back and forth under the control of controller 230. X-ray inspection device 215 includes FPD (Flat Panel Detector) 218 ​​and ADC (Analog to Digital Converter) 219.

[0036] The FPD 218 has multiple detection elements arranged in a two-dimensional configuration. The detection elements of the FPD 218 are arranged orthogonally to the scan lines and signal lines. Alternatively, a grid may be provided on the front surface of the FPD 218.

[0037] The ADC 219 converts the projection data of the time-series analog signal (video signal) output from the FPD 218 into a digital signal and outputs it to the image processing device 240.

[0038] The C-arm 214 positions the X-ray irradiation device 212 and the X-ray detection device 215 opposite each other with the subject as the center. Under the control of the controller 230, the C-arm 214 drives the X-ray irradiation device 212 and the X-ray detection device 215 to move in an arc along the arc direction of the C-arm 214 via the C-arm drive control mechanism 231. Furthermore, the X-ray diagnostic device 200 is described as having a structure in which the C-arm 214 causes the X-ray irradiation device 212 and the X-ray detection device 215 to operate as a single unit, but this is not a limitation. For example, the X-ray diagnostic device 200 may also have a structure in which the X-ray irradiation device 212 and the X-ray detection device 215 operate independently without the C-arm 214.

[0039] Figure 2 This describes a structural example of a single-plane X-ray diagnostic device 200 with only one C-arm, but the X-ray diagnostic device 200 can also be a dual-plane X-ray diagnostic device 200 capable of simultaneous X-ray imaging from two directions through two arms.

[0040] The examination table 220 is supported on the ground, with a supporting top plate 221. Under the control of the controller 230, the examination table 220 can be moved by sliding (X, Z axis direction), moving up and down (Y axis direction), and rolling via the examination table drive control mechanism 232. Furthermore, the case where the stand device 210 is a lower tube type with the X-ray irradiation device 212 located below the top plate 221 will be described, but it can also be an upper tube type with the X-ray irradiation device 212 located above the top plate 221.

[0041] The controller 230 includes a CPU (Central Processing Unit) and memory (not shown). Under the control of the image processing device 240, the controller 230 controls the driving of the X-ray irradiation device 212, the X-ray detection device 215, and the C-arm 214 of the stand assembly 210, as well as the driving of the examination table 220, for alignment. Furthermore, under the control of the image processing device 240, the controller 230 controls the operation of the X-ray irradiation device 212, the X-ray detection device 215, and the C-arm drive control mechanism 231, etc., to perform surgical X-ray imaging or X-ray fluoroscopy.

[0042] The image processing device 240 is based on a computer and includes a processing circuit 241, a storage circuit 242, an input interface 243, a network interface 244, and a display 250.

[0043] The processing circuit 241 is a circuit that controls the overall operation of the X-ray diagnostic apparatus 200 by executing software processing, such as a dedicated or general-purpose processor, and by executing programs stored in the storage circuit 242. It controls the controller 230 based on operator input via the input interface 243, the execution of various programs read from the storage circuit 242, and various data. Furthermore, the processing circuit 241 generates an X-ray image (fluoroscopic image or radiographic image) of the subject P based on signals obtained from the stage device 210, and controls the X-ray diagnostic apparatus 200 to display the X-ray image stored in the storage circuit 242 on a display 250 or similar surface.

[0044] The storage circuit 242 stores various programs, diagnostic information, diagnostic protocols, and other data and image data used for controlling the controller 230, image processing, and display processing. The storage circuit 242 is implemented, for example, using semiconductor memory elements such as RAM (Random Access Memory), flash memory, hard disks, optical disks, etc.

[0045] Network interface 244 is an interface used for communication with various devices connected to network 2 via wired or wireless means. For example, X-ray diagnostic device 200 can exchange various data and images with medical image processing device 100, ultrasound diagnostic device 300, etc. via network interface 244.

[0046] Input interface 243 includes an input device operable by an operator and input circuitry for inputting signals from the input device. The input device may be a mouse, keyboard, touchpad for input via a touch surface, touchscreen integrating the display screen and touchpad, contactless input circuitry using an optical sensor, or voice input circuitry.

[0047] The display 250 displays a GUI for receiving instructions from the operator using the input interface 243, X-ray images generated in the image processing device 240, and the like. Additionally, the display 250 displays various messages and information to inform the operator of the processing status and results of the X-ray diagnostic device 200. Furthermore, the display 250 may have a speaker and be able to output sound. The display 250 can also display data, images, etc., received from various devices connected to the network 2, and various auxiliary images and information generated by the medical image processing device 100 for assisting surgery.

[0048] On the other hand, such as Figure 2 As shown, the ultrasound diagnostic device 300 is configured to include an ultrasound device body 310, an input interface 320, and a display 330, as well as an ultrasound conduit 3. The ultrasound conduit 3 is connected to the ultrasound device body 310 in a communicative manner.

[0049] The main body 310 of the ultrasonic device is based on a computer and has a transceiver circuit 311, a processing circuit 312, a storage circuit 313, and a network interface 314.

[0050] The transceiver circuit 311 supplies an ultrasonic drive signal to the ultrasonic conduit 3 and generates reflected wave data based on the reflected wave signal received by the ultrasonic conduit 3.

[0051] The processing circuit 312 is a circuit that controls the overall operation of the ultrasound diagnostic device 300 by executing software processing, such as a dedicated or general-purpose processor, and by executing programs stored in the storage circuit 313. It controls the processing of the transceiver circuit 311 based on input from the operator via the input interface 320, the execution of various programs read from the storage circuit 313, and various data. Furthermore, the processing circuit 312 generates ultrasound image data based on the reflected wave signal received by the ultrasound conduit 3, and generates an ultrasound image for display based on the generated ultrasound image data. Additionally, the processing circuit 312 controls the ultrasound diagnostic device 300 to display the ultrasound image for display stored in the storage circuit 313 on a display 330 or similar device.

[0052] Storage circuit 313 stores various data such as programs, diagnostic information, diagnostic protocols, reflected wave data, and image data used for ultrasonic transceiver, image processing, and display processing. Storage circuit 120 is implemented, for example, using semiconductor memory elements such as RAM (Random Access Memory), flash memory, hard disk, optical disk, etc.

[0053] Network interface 314 is an interface for communicating with various devices connected to network 2 via wired or wireless means. For example, ultrasound diagnostic device 300 can exchange various data with medical image processing device 100, X-ray diagnostic device 200, etc. via network interface 314.

[0054] Input interface 320 includes an input device operable by an operator and input circuitry for inputting signals from the input device. The input device may be a mouse, keyboard, touchpad for input via a touch surface, touchscreen integrating the display screen and touchpad, contactless input circuitry using an optical sensor, or voice input circuitry.

[0055] The display 330 displays a GUI for receiving instructions from the operator using the input interface 320, ultrasound images generated in the ultrasound device body 310, and the like. Additionally, the display 330 displays various messages and information to inform the operator of the processing status and results of the ultrasound device body 310. Furthermore, the display 330 may have a speaker and output sound. The display 330 can also display data, images, etc., received from various devices connected to the network 2, and various auxiliary images and information generated by the medical image processing device 100 for assisting surgery.

[0056] exist Figure 2 The diagram also illustrates an ultrasound catheter 3 used in surgery. In this specification, the ultrasound probe inserted into the heart cavity of the patient P and connected to the main body 310 of the ultrasound device in a communicative manner is primarily referred to as the ultrasound catheter 3. Examples of ultrasound catheters 3 include ICEs (Intracranial Electrosurgical Units), which can be inserted into the body cavity from the femoral vein, travel into the heart, and scan the left atrium, left atrial appendage, aorta, mitral valve, aortic valve, etc., to generate ultrasound images. Alternatively, an ultrasound catheter 3 can also be a device that is inserted into tubular tissues such as blood vessels of the patient P, scans tubular tissues, etc., and generates ultrasound images.

[0057] The ultrasound catheter 3 is inserted into the body cavity of the subject P, where it is manipulated. For example... Figure 9 As shown, the ultrasonic conduit 3 has a detector 30 at its front end, and the array surface 31 of the detector 30 has multiple piezoelectric elements. These piezoelectric elements generate ultrasonic waves from the ultrasonic device body 310 based on a drive signal supplied via cable 32, and also receive reflected waves from the object P and convert them into electrical signals. The array surface 31 is a two-dimensional array capable of scanning three-dimensional space. Alternatively, the array surface 31 can also be a one-dimensional array capable of scanning two-dimensional space.

[0058] exist Figure 2 The illustration also shows a surgical catheter 4 according to a first embodiment for use in surgery. In this specification, a surgical catheter 4 is defined as a thin medical instrument primarily used to insert into the body cavity, blood vessels, or other tubular tissues of a subject P for treatment, diagnosis, or as an aid in the treatment process. The surgical catheter 4 is configured, for example, to include a thin tube called a catheter, a guidewire for guiding the catheter to the treatment site, and a medical device 40 attached to the tip of the catheter.

[0059] The device operation unit 41 is a tool used by surgeons such as doctors to manually insert the surgical catheter 4 into the blood vessels of the subject P and guide it to the designated target site. Here, the designated target site refers to the site that is auxiliary to the treatment, diagnosis, or treatment process, and may also be referred to as the area of ​​interest within the body of the subject P.

[0060] Medical device 40 is a component used at a predetermined treatment site after the surgical catheter 4 is inserted into the body of the patient P. Examples of medical devices 40 include occlusion devices, balloons, and stents (e.g.,...). Figure 5 Medical equipment 40a).

[0061] Medical device 40 can also be a component used at a designated site during treatment after the surgical catheter 4 has been inserted into the body of the patient P. Medical device 40 can also be a puncture needle (e.g., Figure 4 Medical devices 40b, etc. Alternatively, multiple medical devices 40 may be mounted on a single surgical catheter 4.

[0062] Figures 3 to 5 These are diagrams illustrating an example of the surgical site in the first embodiment and an example of the surgery in the first embodiment, namely, septal puncture and left atrial appendage occlusion surgery. In left atrial appendage occlusion surgery, generally, after the ultrasound catheter 3 and the surgical catheter 4 are inserted into the body of the subject P through a blood vessel, they proceed toward the right atrium, the left atrium, and the vicinity of the left atrial appendage, which is the treatment site.

[0063] Specifically, such as Figure 4 As shown, the ultrasound catheter 3 and surgical catheter 4 are used to perform septal puncture near the left atrial appendage, the site of treatment. Septal puncture refers to the procedure of creating a hole in the atrium using a puncture needle during treatment. The surgeon observes both the medical device 40b and the designated site of treatment, or one of them. Therefore, the surgeon manipulates both the ultrasound catheter 3 and the surgical catheter 4, advancing the ultrasound catheter 3 to a position that allows for good visualization of both the medical device 40b and the site of treatment. For example, during septal puncture, the area of ​​interest within the body of the patient P near the atrial septum is observed through the ultrasound catheter 3.

[0064] Next, after septal puncture, as Figure 5 As shown, firstly, to determine the size of the occlusion device, the size of the left atrial appendage, the treatment site, is measured using an ultrasound catheter 3. Secondly, an occlusion device of suitable size for the left atrial appendage is guided into the left atrium. Thirdly, contrast agent is circulated to observe the shape of the left atrial appendage on an X-ray image just before the occlusion device is placed. Fourthly, the occlusion device at the tip of the surgical catheter 4 is deployed and placed to occlude the left atrial appendage. In this fourth stage, the surgeon observes the condition of the treatment site, such as the tightness of the left atrial appendage and the occlusion device, and performs procedures such as re-placement of the occlusion device based on the observations.

[0065] That is, in the fourth stage, the surgeon manipulates both the ultrasound catheter 3 and the surgical catheter 4 to observe both the medical device 40 and the designated treatment site, or one of them, so that the ultrasound catheter 3 is advanced to a position where both the medical device 40 and the treatment site are well depicted. For example, in a left atrial appendage occlusion surgery, the area of ​​interest within the left atrial appendage, which is the subject P, is observed through the ultrasound catheter 3.

[0066] In addition, Figures 3 to 5 In this embodiment, as an example of surgery according to the first embodiment, a left atrial appendage occlusion surgery and occlusion device have been described. However, this embodiment does not exclude intracardiac surgeries other than left atrial appendage occlusion surgery, such as atrial septal defect occlusion surgery, mitral valve occlusion surgery, balloon aortic valve reconstruction surgery, and other surgical and treatment procedures. Furthermore, the use of medical device 40 other than puncture needles and occlusion devices is not excluded. Additionally, as a surgical example of the first embodiment, a treatment process and treatment based on medical device 40 have been described. However, this embodiment does not exclude diagnosis based on medical device 40.

[0067] Figure 6 This is a schematic diagram illustrating a structural example of the medical image processing apparatus according to the first embodiment. Figure 6 As shown, the medical image processing apparatus 100 of the first embodiment can be connected to the X-ray diagnostic apparatus 200 and the ultrasound diagnostic apparatus 300, and can be configured as a workstation or a personal computer, for example. The medical image processing apparatus 100 provides the surgeon with images or information to assist in the surgery.

[0068] The medical image processing device 100 includes at least a processing circuit 110, a storage circuit 120, an input interface 130, and a network interface 140.

[0069] Additionally, the medical image processing device 100 may also include a display 150. The display 150 provides the surgeon with travel assistance information for the ultrasonic catheter 3 generated by the medical image processing device 100. The display 150 may be, for example, a large display device positioned in a location easily visible to the surgeon, or it may have a speaker and be able to output the travel assistance information soundfully. Furthermore, in addition to displaying data such as travel assistance information generated by the processing circuit 110, the display 150 may also display various images, including images used to assist in the surgery generated by the medical image processing device 100, as well as data and images received from various devices connected via the network 2.

[0070] Network interface 140 is an interface for communicating with various devices connected to network 2 via wired or wireless means. For example, medical image processing device 100 can exchange various data with X-ray diagnostic device 200, ultrasound diagnostic device 300, etc. via network interface 140.

[0071] Input interface 130 includes an input device operable by an operator and input circuitry for inputting signals from the input device. The input device may be a mouse, keyboard, touchpad for input via a touch surface, touchscreen integrating the display screen and touchpad, contactless input circuitry using an optical sensor, or voice input circuitry.

[0072] The storage circuit 120 is composed of semiconductor storage elements such as RAM (Random Access Memory), flash memory, hard disk, optical disk, etc. The storage circuit 120 stores various processing programs used in the processing circuit 110 (including applications and the operating system, etc.) and data required for program execution. Additionally, the storage circuit 120 can store various data, such as image data, input through the input interface 130 or the network interface 140.

[0073] The processing circuit 110 has a dedicated or general-purpose processor and performs various functions described later by executing software processing through programs stored in the storage circuit 120. The processing circuit 110 implements the functions of the first acquisition function F01, the second acquisition function F02, the detection function F03, the determination function F04, and the calculation function F05.

[0074] use Figure 7 The flowchart shown and Figures 8 to 11 The diagrams shown illustrate these functions. Figure 7 This is a flowchart illustrating an example of the operation of the medical image processing apparatus 100 according to the first embodiment, or a medical image processing program.

[0075] In step ST10, an ultrasound image generated from signals collected by the ultrasound diagnostic device 300 is acquired by the detector 30 of the ultrasound catheter 3 inserted into the body of the subject P, who is being diagnosed or treated. The processing of acquiring the ultrasound image of the subject P in step ST10 is performed by the first acquisition function F01.

[0076] In step ST11, an X-ray image of the subject P, which is being diagnosed or treated, is acquired using the X-ray diagnostic device 200. The X-ray image acquired in step ST11 is an X-ray image depicting the object being imaged, which is at least one of the detector 30 of the ultrasound catheter 3, the medical device 40 inserted into the body of the subject P, and the region of interest within the body of the subject.

[0077] in addition, Figure 8 This is a diagram used to illustrate the X-ray image capture of the first embodiment. (Example) Figure 8 As shown, the X-ray image in step ST11 is a photographic image (static image) or a fluoroscopic image (moving image) taken by irradiating the same area with X-rays from at least two directions. The processing of obtaining the X-ray image data of the subject P in step ST11 is performed by the second acquisition function F02.

[0078] In step ST12, the position of the detector 30 of the ultrasonic conduit 3, as depicted in the X-ray image obtained in step ST11, is detected. Based on multiple X-ray images of the same location obtained in step ST11, for example, according to the principle of a stereo camera, the position of the detector 30 of the ultrasonic conduit 3 in, for example, an X-ray coordinate system is determined. The process of detecting the position of the detector 30 of the ultrasonic conduit 3 in step ST12 is performed by detection function F03. Furthermore, here, as... Figure 2 As shown, the X-ray coordinate system is a right-handed coordinate system in which the left-right axis of the subject is set as the X-axis, the dorsal-ventral axis as the Y-axis, and the cephalopod axis as the Z-axis.

[0079] Figure 9 This is a diagram used to illustrate the position information of the ultrasonic detector in the first embodiment and the field of view in the ultrasonic image. For example... Figure 9 As shown, the position information of the detector 30 of the ultrasonic conduit 3 includes, for example, the centroid position of the detector 30 in the X-ray coordinate system and the normal vector of the array surface 31 of the detector 30 extending from the centroid position.

[0080] In addition, Figure 9 In this embodiment, the array surface 31 of the detector 30 of the ultrasonic conduit 3 is a two-dimensional array. In this specification, with the position of the detector 30 of the ultrasonic conduit 3 and the angle of the array surface 31 of the detector 30 fixed, multiple sector-shaped two-dimensional ultrasonic images generated based on the collected ultrasonic data are referred to as "views". Furthermore, the range corresponding to the three-dimensional ultrasonic image that overlaps these multiple "views" across the entire range, i.e., the range corresponding to the set of all "views", is referred to as the "field of view".

[0081] The "field of view" can be calculated as long as the scanning range of the detector 30 is determined while the position of the detector 30 of the ultrasonic conduit 3 and the angle of the array surface 31 of the detector 30 are fixed.

[0082] Return to Figure 7In step ST13, using the ultrasound image obtained in step ST10, it is determined whether an object being imaged, which is at least one of the regions of interest within the medical device 40 and the subject, has entered the field of view of the detector 30 of the ultrasound catheter 3. Specifically, if the ultrasound image obtained in step ST10 shows an object being imaged, which is at least one of the regions of interest within the medical device 40 and the subject, it is determined that the object has entered the field of view of the detector 30. Conversely, if the ultrasound image obtained in step ST10 does not show an object being imaged, which is at least one of the regions of interest within the medical device 40 and the subject, it is determined that the object has not entered the field of view of the detector 30. The process of determining whether the object being imaged has entered the field of view of the detector 30 of the ultrasound catheter 3 in step ST13 is performed by the determination function F04.

[0083] In addition, when the "field of view" is composed of a "view", that is, when the field of view of the detector 30 is two-dimensional, the process of determining whether the object being photographed has entered the field of view of the detector 30 of the ultrasonic conduit 3 in step ST13 can also be performed.

[0084] Step ST14 is performed when "yes" is indicated in step ST13, meaning that part or all of the imaging object, which is at least one of the areas of interest within the medical device 40 and the subject, enters the field of view of the detector 30 of the ultrasound catheter 3. In step ST14, the position of the imaging object, which is at least one of the ultrasound image obtained in step ST10 and the X-ray image obtained in step ST11, is detected based on at least one of these. The process of detecting the position of the imaging object in step ST14 is performed by detection function F03.

[0085] In the case of detecting the position of the medical device 40 in step ST14 based on the ultrasound image obtained in step ST10, the position of the center of gravity of the medical device 40 in the X-ray coordinate system is detected based on the position of the medical device 40 depicted in the ultrasound image, such as the position of the medical device 40 within the field of view.

[0086] For example, in cases where only the end portion of the medical device 40 is depicted in the ultrasound image, or where the medical device 40 depicted in the ultrasound image does not include its center of gravity, ... Figure 5 Let's take medical equipment 40a as an example for explanation. Figure 5As shown, the centroid position of the medical device 40a (40) in the X-ray coordinate system can also be estimated based on the size of the treatment site, which may become the medical device 40a (40), and the unfolded shape of the medical device 40a (40) (e.g., sphere, ellipsoid, toroidal, cylindrical, etc.). The size of the treatment site can be, for example, data measured when determining the size of the medical device 40a (40), or X-ray images taken to observe the shape of the treatment site before placing the medical device 40a (40).

[0087] In the case where the position of the imaging object, which is at least one of the areas of interest within the medical device 40 and the subject, is detected in step ST14 based on the X-ray image obtained in step ST11, the centroid position of the imaging object, which is at least one of the areas of interest within the medical device 40 and the subject, in the X-ray coordinate system can also be detected based on the multiple X-ray images obtained in step ST11, using, for example, the principle of a stereo camera.

[0088] Step ST15 is performed if step ST13 is "No," meaning that the object being imaged, which is at least one of the regions of interest within the medical device 40 and the subject, does not enter the field of view of the detector 30 of the ultrasound catheter 3. In step ST15, the position of the object being imaged, which is at least one of the regions of interest within the medical device 40 and the subject, as depicted in the X-ray image obtained in step ST11, is detected. Based on multiple X-ray images obtained in step ST11, the centroid position of the object being imaged in the X-ray coordinate system is detected using, for example, the principle of a stereo camera. This position of the object being imaged indicates that it is at least one of the regions of interest within the medical device 40 and the subject. The process of detecting the position of the object being imaged in step ST15 is performed by the detection function F03.

[0089] In step ST16, the field of view of the detector 30 is calculated based on the position of the detector 30 of the ultrasonic conduit 3 detected in step ST12, i.e., the centroid position of the array surface 31 constituting the detector 30, the normal vector calculated based on the orientation of the array surface 31, and the specified scanning range of the detector 30 (i.e., the known scanning range). Figure 9 As shown, with the position of the detector 30 of the ultrasonic conduit 3 and the angle of the array surface 31 of the detector 30 fixed, the field of view of the detector 30 can be calculated based on the scanning range of the detector 30. The calculation of the field of view of the detector 30 of the ultrasonic conduit 3 in step ST16 is performed by the calculation function F05.

[0090] In step ST17, based on the position of the ultrasound catheter 3 detector 30 and the position of the imaging object, which is at least one of the areas of interest within the medical device 40 and the subject, travel assistance information is calculated to allow the ultrasound catheter 3 to travel so that the imaging object enters the field of view of the detector 30. Alternatively, travel assistance information is calculated to allow the ultrasound catheter 3 to travel so that the imaging object, which is at least one of the areas of interest within the medical device 40 and the subject, approaches the center of the field of view of the detector 30. The processing of calculating the travel assistance information of the ultrasound catheter 3 in step ST17 is performed by calculation function F05.

[0091] Figure 10 and Figure 11 These are perspective views illustrating an example of the travel assistance of the ultrasound catheter 3 when a part of the medical device 40 of the first embodiment is out of the field of view of the detector 30 of the ultrasound catheter 3, namely (a) before travel assistance and (b) after travel assistance.

[0092] The following uses Figure 10 and Figure 11 Regarding step ST17, the case where the imaging object is the medical device 40 will be explained. However, the imaging object is not limited to the medical device 40. It may also be the area of ​​interest inside the subject, or the area of ​​interest inside the subject that includes both the medical device 40 and the area of ​​interest inside the subject. Similarly, the travel assistance of the ultrasound catheter 3 can be performed even if part or all of the imaging object is out of the field of view of the detector 30 of the ultrasound catheter 3.

[0093] like Figure 10 (a) and Figure 11 As shown in (a), in step ST17, when the medical device 40 is partially or completely removed from the field of view of the detector 30 of the ultrasound catheter 3, the amount of travel and direction of travel of the ultrasound catheter 3, and the angle of the array surface 31 of the detector 30 are calculated so that the medical device 40 can enter the field of view of the detector 30 of the ultrasound catheter 3, or so that the medical device 40 can approach the center of the field of view of the detector 30 of the ultrasound catheter 3. Furthermore, in this specification, the amount of travel and direction of travel can also be the amount of retraction and direction of retraction. In other words, the amount of travel and direction of travel can be the amount of movement and the direction of movement.

[0094] Furthermore, in step ST17, even when the medical device 40 is moved from a state where it is completely within the field of view of the detector 30 of the ultrasound catheter 3, it is possible to calculate the amount of travel and direction of travel of the ultrasound catheter 3, or the angle of the array surface 31 of the detector 30, so that part or all of the medical device 40 does not leave the field of view of the detector 30 of the ultrasound catheter 3.

[0095] like Figure 10 (a) and Figure 11 As shown in (a), the travel amount and direction of the ultrasonic conduit 3 are, for example, the amount by which the center of gravity of the detector 30 of the ultrasonic conduit 3 in the X-ray coordinate system moves from position (x1, y1, z1) to position (x2, y2, z2). Additionally, the angle of the array surface 31 of the detector 30 is the amount of rotation about the axis of the detector 30.

[0096] When part or all of the medical device 40 is not within the field of view of the detector 30, for example, by assuming the centroid position of the medical device 40 in the X-ray coordinate system, the size of the treatment object that may become the diameter of the medical device 40, and the unfolded shape of the medical device 40, which are known through step ST14 or ST15, it can be determined that the field of view of the detector 30 overlaps with the entirety of the medical device 40 in three-dimensional space. Based on this overlap, the travel distance and direction of the ultrasound catheter 3, as well as the angle of the array surface 31 of the detector 30, required to overlap the entirety of the medical device 40 with the field of view of the detector 30 in three-dimensional space can be calculated.

[0097] The travel amount and direction of the ultrasound catheter 3, and the angle of the array surface 31 of the detector 30 are preferably the amount by which the entire medical device 40 is "maximally converged" within the field of view of the detector 30 of the ultrasound catheter 3. In this specification, "maximally converged" means that the entire medical device 40 enters the field of view of the detector 30 of the ultrasound catheter 3 and is depicted as much as possible within the field of view of the detector 30.

[0098] When a portion of the medical device 40 enters the field of view of the detector 30 of the ultrasound catheter 3, the direction of travel of the ultrasound catheter 3 can be determined based on which view among the multiple ultrasound images acquired in step ST10 depicts the medical device 40. For example, if the field of view of the detector 30 of the ultrasound catheter 3 comprises 10 views from view V1 to view V10, and the medical device 40 is only depicted in views V1 and V2, then it is considered that the medical device 40 is outside the field of view of the detector 30 on the view V1 side, and the direction depicting view V1 and outside the field of view of the detector 30 on the view V1 side can be taken as the direction of travel of the ultrasound catheter 3. Furthermore, the number of views is not limited to 10.

[0099] In addition, the travel assistance information of the ultrasound catheter 3 is information on the travel speed of the ultrasound catheter 3 used to determine the appropriate position of the tissue or organ of the subject P located at the tip of the ultrasound catheter 3, and information related to the recommended path for the ultrasound catheter 3 to travel or to travel in a detour based on the determined travel speed to avoid collision with the tissue or organ of the subject P.

[0100] Return to Figure 7 In step ST18, the travel assistance information of the ultrasonic catheter 3 calculated in step ST17 is output. The travel assistance information of the ultrasonic catheter 3 is output to the display 150 and displayed on the display 150. Alternatively, the travel assistance information of the ultrasonic catheter 3 can also be output to at least one of the displays 250 of the X-ray diagnostic apparatus 200 and the display 330 of the ultrasonic diagnostic apparatus 300, and displayed on these displays.

[0101] The output of the travel assistance information of the ultrasonic duct 3 to the display includes at least one of the travel assistance information calculated in step ST17.

[0102] By providing the surgeon with travel assistance information for the ultrasound catheter 3, it is expected that the number of operations for the ultrasound catheter 3 can be reduced, and the workflow that can be focused on the operation of the surgical catheter 4 can be further improved.

[0103] In the first embodiment, steps ST10, ST11, and ST12 can be performed in any order after step ST11, and are not limited to the order of steps ST10, ST11, and ST12. They can also be in the order of steps ST11, ST12, and ST10, or in the order of steps ST11, ST10, and ST12.

[0104] (Modification 1 of the first embodiment) Figure 12 This is a flowchart illustrating an operation example or a medical image processing program of a modified example 1 of the first embodiment. For example... Figure 12 As shown, step ST13 can also be omitted, and the next step after step ST12 can be set as step ST15.

[0105] (Second Implementation) Figure 13 This is a diagram illustrating a structural example of the medical image processing apparatus 100 according to the second embodiment. Second Embodiment ( Figure 13 ) and the first implementation method ( Figure 7 The difference is that, Figure 13The processing circuit 110 of the medical image processing device 100 shown has an image output function F06. The image output function F06 is the function of outputting ultrasound images.

[0106] in addition, Figure 14 This is a flowchart illustrating an operation example or a medical image processing procedure of the medical image processing apparatus 100 according to the second embodiment. For example... Figure 14 As shown, step ST20 is performed after step ST18. In step ST20, an ultrasound image depicting a portion or all of the imaging object that is part of or part of the region of interest within the medical device 40 and the subject is extracted from the multiple ultrasound images obtained in step ST10, and the extracted ultrasound image is output. The processing of the output ultrasound image in step ST20 is performed by the image output function F06.

[0107] The method for extracting the ultrasound image in step ST20 is simply to extract an ultrasound image that depicts at least a portion or all of the imaging object within the medical device 40 and the body of the subject. For example, from the viewpoint of outputting an ultrasound image focused on the treatment site, the ultrasound image in step ST20 can also be set to depict ultrasound images of both the treatment site and the medical device 40.

[0108] Figure 15 This is an example diagram illustrating an ultrasound image of the second embodiment. Figure 15 In the exemplified case of left atrial appendage occlusion surgery, for example, if the field of view of ultrasound catheter 3 is (in) Figure 15 The middle section (a collection of all views from view V1 to view V10) depicts ultrasound images of both the left atrial appendage and the occlusion device (medical device 40). Figure 15 If the range of views from view V4 to view V8 is set as the ultrasound image of step ST20, then it becomes easier to focus on the observation of the treatment site, such as the left atrial appendage and the tightness of the occlusion device.

[0109] In addition, in step ST20, there is no particular restriction on the output order of the multiple extracted ultrasound images, but the output order can be set in order to facilitate the identification of the condition of the treatment site. Figure 15 This diagram illustrates an example of the output sequence of the ultrasonic images in the second embodiment. The output sequence of the ultrasonic images can also be a reciprocating sequence from the ultrasonic images at one end of the extracted view's range towards the ultrasonic images at the other end. According to... Figure 15This can be explained by, for example, the output order of repeating views V4, V5, V6, V7, V8, V7, V6, V5, V4, V5, and so on. Furthermore, the starting view for output is arbitrary, but it's also possible to use the ultrasound image near the center of the extracted view's range as the starting point, and then output the ultrasound images from both ends repeatedly. According to... Figure 15 Provide an explanation, for example, the output order of repeating views V6, V7, V8, V7, V6, V5, V4, V5, V6, V7, V8, V7, ...

[0110] Figure 16 This is a perspective view illustrating an example of (a) before and (b) after the travel assistance of the ultrasonic catheter 3, based on the ultrasonic image of the second embodiment. Figure 16 (a) is with Figure 15 The same figure depicts multiple extracted ultrasound images. As described above, the travel amount and direction of the ultrasound catheter 3, and the angle of the array surface 31 of the detector 30 are preferably amounts that "maximally converge" to at least one part or all of the imaging object, which is a region of interest within the medical device 40 and the body of the subject, within the field of view of the detector 30 of the ultrasound catheter 3.

[0111] Therefore, it is also possible to... Figure 16 As shown in (b), travel assistance information for advancing the ultrasonic conduit 3 to bring the object being imaged into the field of view of the detector 30 is calculated. Alternatively, travel assistance information for advancing the ultrasonic conduit 3 to bring the object being imaged closer to the center of the field of view of the detector 30 can also be calculated. In this case, the travel assistance information is calculated, for example, by extracting an ultrasonic image depicting part or all of the object being imaged from multiple ultrasonic images obtained in step ST10, and based on the extracted ultrasonic image.

[0112] The output of the ultrasound image in step ST20 can be performed on the display 150, or on at least one of the displays 250 of the X-ray diagnostic device 200 and the display 330 of the ultrasound diagnostic device 300.

[0113] For example, by extracting and outputting ultrasound images depicting part or all of the medical device 40, the operator's search workload for ultrasound images of the medical device 40 and the treatment site area is reduced. Additionally, for example, by extracting and outputting ultrasound images depicting the area of ​​interest within the subject, observation of the treatment site area during treatment or the treatment process becomes easier.

[0114] (Third implementation method) Figure 17 This is a block diagram illustrating a structural example of the X-ray diagnostic system 1 equipped with the medical image processing apparatus of the third embodiment. The medical image processing apparatus 100 of the third embodiment has the function of controlling the auxiliary robot 6. Here, the auxiliary robot 6 is, for example, a device capable of inserting an ultrasound catheter 3 or a surgical catheter 4 into the subject P and moving them to the treatment site of the subject based on user operation via an operating table set at a remote location, or capable of inserting an ultrasound catheter 3 or a surgical catheter 4 into the subject P and moving them to the treatment site of the subject based on control data from a remote location.

[0115] like Figure 17 As shown, the assistive robot 6, in addition to the operating table, also has a robot body 60. The robot body 60 is positioned near the examination table 220, and inserts an ultrasound catheter 3 or a surgical catheter 4 into the patient P, guiding them to the treatment site. The operating table of the assistive robot 6 can be located at a distance from the operating room or within the operating room. The assistive robot 6 can also be connected to the X-ray diagnostic system 1 via network 2.

[0116] Figure 18 This is a diagram illustrating a structural example of the medical image processing apparatus 100 according to the third embodiment. Compared with the first embodiment (… Figure 6 ) and the second embodiment ( Figure 13 The difference lies in that the processing circuit 110 of the medical image processing device 100 in the third embodiment has a robot control function F07. The robot control function F07 is a function that sends and receives control data between the medical image processing device 100, the X-ray diagnostic device 200 and the auxiliary robot 6 which is another structure, and controls the movement of the auxiliary robot 6.

[0117] The robot control function F07 in the third embodiment converts the calculated travel assistance information of the ultrasonic catheter 3 into control data for the auxiliary robot 6 and outputs it to the auxiliary robot 6. Thus, the movement of the auxiliary robot 6 is controlled in a manner that allows the ultrasonic catheter 3 to travel based on the travel assistance information.

[0118] The robot control function F07 can also determine the appropriate travel speed of the ultrasound catheter 3 for the tissue or organ of the patient P at the tip of the ultrasound catheter 3, based on travel assistance information related to the recommended path. Alternatively, it can control the movement of the assistive robot 6 by controlling the ultrasound catheter 3 to travel at the determined speed or by traveling in a circuitous manner to avoid collisions with the tissue or organ of the patient P. For example, in moving organs such as the heart, the movement of the assistive robot 6 can be controlled to reduce the travel speed of the medical device.

[0119] According to at least one embodiment described above, it is possible to assist the operator in properly advancing the ultrasonic catheter.

[0120] Furthermore, in the above embodiments, the term "processor" includes, for example, dedicated or general-purpose CPUs (Central Processing Units), GPUs (Graphics Processing Units), application-specific integrated circuits (ASICs), programmable logic devices (e.g., simple programmable logic devices (PLDs), complex programmable logic devices (PLDs), and field-programmable gate arrays (FPGAs). When the processor is, for example, a CPU, it reads and executes a program (medical image processing program) stored in a memory circuit, thereby implementing various functions. Alternatively, when the processor is, for example, an ASIC, instead of storing the program in a memory circuit, the functionality equivalent to that program is directly assembled into the processor's circuitry as logic circuitry. In this case, the processor reads and executes the hardware processing of the program assembled in the circuitry to implement various functions. Alternatively, the processor can also combine software processing and hardware processing to implement various functions.

[0121] Furthermore, while the above embodiments illustrate an example where a single processor in the processing circuit implements each function, multiple independent processors can also be combined to form the processing circuit, with each processor implementing its respective function. Additionally, when multiple processors are used, the program storage circuit can be set up separately for each processor, or a single storage circuit can store programs corresponding to the functions of all processors.

[0122] Several embodiments of the present invention have been described, but these embodiments are given by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other ways, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the scope of the invention as described in the claims and its equivalents.

Claims

1. A medical image processing device, comprising a processing circuit, The processing circuit: Acquire ultrasound images based on signals collected by a detector from an ultrasound catheter inserted into the body of the subject; Obtain an X-ray image depicting an object to be photographed, the object being photographed being at least one of the detector of the ultrasonic catheter, a medical device inserted into the body of the subject, and a region of interest within the body of the subject; Detect (a) the position of the detector of the ultrasonic catheter depicted in the X-ray image, and (b) the position of the photographic object depicted in at least one of the ultrasonic image and the X-ray image; Based on the detected position of the detector of the ultrasonic conduit and the position of the object being photographed, travel assistance information is calculated to move the ultrasonic conduit so that the object being photographed enters the field of view of the detector, or to move the ultrasonic conduit so that the object being photographed approaches the center of the field of view of the detector.

2. The medical image processing device according to claim 1, wherein, The processing circuit, Further determine whether the object being photographed has entered the field of view of the detector. When the object being photographed is depicted in the acquired ultrasonic image, it is determined that the object has entered the field of view of the detector; when the object is not depicted in the acquired ultrasonic image, it is determined that the object has not entered the field of view of the detector.

3. The medical image processing device according to claim 2, wherein, The processing circuit, When the object being photographed enters the field of view of the detector, The position of the object being imaged within the field of view is detected based on the ultrasonic image, and the position of the detector in the ultrasonic conduit is detected based on the X-ray image.

4. The medical image processing device according to claim 2, wherein, The processing circuit, When the object being photographed does not enter the field of view of the detector, Based on the X-ray image, the position of the detector in the ultrasonic catheter and the position of the object being imaged are detected.

5. The medical image processing device according to claim 2, wherein, The processing circuit, When the object being photographed does not enter the field of view of the detector, Based on the X-ray image, the centroid position of the array surface constituting the detector and the orientation of the array surface are detected. The field of view of the detector is calculated based on the centroid position of the array surface, the normal vector calculated based on the orientation of the array surface, and the specified scanning range of the detector.

6. The medical image processing apparatus according to claim 1 or 2, wherein, The travel assistance information calculated by the processing circuit includes at least one of the following: the travel amount of the ultrasonic catheter, the travel direction of the ultrasonic catheter, the angle of the array surface of the ultrasonic catheter, and the recommended path information of the ultrasonic catheter.

7. The medical image processing apparatus according to claim 1 or 2, wherein, It also features a display for providing the operator with travel assistance information for the ultrasonic catheter.

8. The medical image processing apparatus according to claim 1 or 2, wherein, The processing circuit further controls the auxiliary robot that assists the ultrasonic catheter.

9. The medical image processing apparatus according to claim 7, wherein, The processing circuit extracts a portion or all of the ultrasonic image depicting the photographed object from the acquired multiple ultrasonic images, and further outputs the extracted ultrasonic image to the display.

10. The medical image processing apparatus according to claim 1, wherein, The processing circuit, Extract an ultrasonic image depicting part or all of the photographed object from multiple acquired ultrasonic images. Based on the extracted ultrasonic images, travel assistance information is calculated to guide the ultrasonic catheter to bring the object being photographed into the field of view of the detector, or to guide the ultrasonic catheter to bring the object being photographed closer to the center of the field of view of the detector.

11. The medical image processing apparatus according to claim 9, wherein, The processing circuit outputs the extracted multiple ultrasonic images in a sequential manner from one end of the extracted range to the other, or outputs the ultrasonic images at both ends of the extracted range in a sequential manner, starting from the ultrasonic image near the center of the extracted range.

12. The medical image processing apparatus according to claim 1, wherein, The area of ​​interest within the subject's body is a site that is helpful in the treatment, diagnosis, or treatment process.

13. An X-ray diagnostic system, comprising a medical image processing device and a network interface capable of communicating with the medical image processing device via a network. The medical image processing device includes a processing circuit. The processing circuit, Acquire ultrasound images based on signals collected by a detector from an ultrasound catheter inserted into the body of the subject; Obtain an X-ray image depicting an object to be photographed, the object being photographed being at least one of the detector of the ultrasonic catheter, a medical device inserted into the body of the subject, and a region of interest within the body of the subject; Detect (a) the position of the detector of the ultrasonic catheter depicted in the X-ray image, and (b) the position of the photographic object depicted in at least one of the ultrasonic image and the X-ray image; Based on the detected position of the detector of the ultrasonic conduit and the position of the object being photographed, travel assistance information is calculated to move the ultrasonic conduit so that the object being photographed enters the field of view of the detector, or to move the ultrasonic conduit so that the object being photographed approaches the center of the field of view of the detector.

14. The X-ray diagnostic system according to claim 13, wherein, The processing circuit further controls an auxiliary robot that assists in the operation of the ultrasonic catheter.

15. A computer-readable storage medium storing a medical image processing program for causing a computer to perform the following steps: Acquire ultrasound images based on signals collected by a detector from an ultrasound catheter inserted into the body of the subject; Obtain an X-ray image depicting an object to be photographed, the object being photographed being at least one of the detector of the ultrasonic catheter, a medical device inserted into the body of the subject, and a region of interest within the body of the subject; Detect (a) the position of the detector of the ultrasonic catheter depicted in the X-ray image, and (b) the position of the photographic object depicted in at least one of the ultrasonic image and the X-ray image; Based on the detected position of the detector of the ultrasonic conduit and the position of the object being photographed, travel assistance information is calculated to move the ultrasonic conduit so that the object being photographed enters the field of view of the detector, or to move the ultrasonic conduit so that the object being photographed approaches the center of the field of view of the detector.

Citation Information

Patent Citations

  • Image display control device, image display control method and program

    JP2022142553A

  • Information processing system, information processing method, and program

    JP2023125592A

  • Medical information processing system, medical information processing apparatus, and ultrasonic diagnostic apparatus

    JP2020005785A

  • System for Cardiac Condition Detection and Characterization

    US20110245669A1