Program, information processing method, and information processing system

Abstract

Provided are a program and similar that make a catheter system easier to use.　This program causes a computer to perform a process wherein a catheter for diagnostic imaging that has been inserted into a hollow organ is used to acquire a plurality of tomographic images (485) generated along the hollow organ, first information relating to the condition of the hollow organ or the condition of the area around the hollow organ is acquired on the basis of the acquired tomographic images (485), and first assistive information that aids diagnosis or treatment is outputted on the basis of the acquired first information.

Description

[Technical Field]

[0001] The present invention relates to a program, an information processing method, and an information processing system. [Background technology]

[0002] BACKGROUND ART A catheter system is used in which a diagnostic imaging catheter is inserted into a hollow organ such as a blood vessel to capture a tomographic image (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 164071 Summary of the Invention [Problem to be solved by the invention]

[0004] Skill is required to interpret cross-sectional images taken using diagnostic imaging catheters. Even more skill is required to plan treatment strategies based on the results of the interpretation or by combining the results with other medical information. Therefore, extensive training is required to use the catheter system.

[0005] In one aspect, an object is to provide a program or the like that makes it possible to easily use a catheter system. [Means for solving the problem]

[0006] The program acquires a plurality of tomographic images generated along the hollow organ using a diagnostic imaging catheter inserted into the hollow organ, acquires first information on the state of the hollow organ or the state around the hollow organ based on the acquired tomographic images, and outputs first support information for assisting diagnosis or treatment based on the acquired first information, and the first support information is a diagnostic image of the hollow organ or the state around the hollow organ. The shape ofAreas that are judged to require treatment and areas that are judged not to require treatment are indicated by different colors. Current situation Schematic diagram and a schematic diagram obtained by modifying the schematic diagram based on a treatment goal, a recommended treatment, and specifications of equipment to be used for the treatment, and the first support information is displayed on one screen. The processing is executed by a computer. [Effects of the Invention]

[0007] In one aspect, a program or the like can be provided that makes it easy to use the catheter system. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram illustrating an overview of a catheter system. [Figure 2] FIG. 1 is an explanatory diagram illustrating an overview of a catheter for diagnostic imaging. [Figure 3] FIG. 1 is an explanatory diagram illustrating the configuration of a catheter system. [Figure 4] FIG. 1 is an explanatory diagram illustrating an overview of processing by a catheter system. [Figure 5] FIG. 2 is an explanatory diagram illustrating the configuration of a first model. [Figure 6] 10 is an example of a screen displayed by the catheter system. [Figure 7] 10 is an example of a screen displayed by the catheter system. [Figure 8] 10 is a flowchart illustrating the flow of processing of a program. [Figure 9] 10 is an example of a screen displayed by the catheter system of the second embodiment. [Figure 10] 10 is a flowchart illustrating the flow of processing of a program according to the second embodiment. [Figure 11] FIG. 10 is an explanatory diagram illustrating the configuration of a catheter system according to a third embodiment. [Figure 12] FIG. 10 is an explanatory diagram for explaining an outline of processing by the catheter system of the fourth embodiment. [Figure 13] FIG. 13 is an explanatory diagram illustrating the configuration of a first model according to a fourth embodiment. [Figure 14]13 is an example of a screen displayed by the catheter system of the fourth embodiment. [Figure 15] 13 is an example of a screen displayed by the catheter system of the fourth embodiment. [Figure 16] 13 is an example of a screen displayed by the catheter system of the fourth embodiment. [Figure 17] 10 is a flowchart illustrating the flow of processing of a program according to a fourth embodiment. [Figure 18] FIG. 10 is an explanatory diagram for explaining an outline of processing by the catheter system of the fifth embodiment. [Figure 19] FIG. 13 is an explanatory diagram illustrating the configuration of a first model according to a fifth embodiment. [Figure 20] 13 is an example of a screen displayed by the catheter system of the fifth embodiment. [Figure 21] 13 is an example of a screen displayed by the catheter system of the fifth embodiment. [Figure 22] FIG. 20 is an explanatory diagram for explaining an outline of processing by the catheter system of the sixth embodiment. [Figure 23] FIG. 13 is an explanatory diagram for explaining an outline of processing by the catheter system of the seventh embodiment. [Figure 24] 13 is an example of a screen displayed by the catheter system of the seventh embodiment. [Figure 25] 13 is a flowchart illustrating the flow of processing of a program according to a seventh embodiment. [Figure 26] 13 is an example of a screen displayed by the catheter system of the eighth embodiment. [Figure 27] 13 is an example of a screen displayed by the catheter system of the eighth embodiment. [Figure 28] 13 is a flowchart illustrating the flow of processing of a program according to the eighth embodiment. [Figure 29] FIG. 10 is an explanatory diagram illustrating the record layout of a training data DB. [Figure 30] 13 is a flowchart illustrating the flow of processing of a program according to a ninth embodiment. [Figure 31] FIG. 10 is an explanatory diagram illustrating the record layout of a correction DB. [Figure 32] 13 is an example of a screen displayed by the catheter system of the tenth embodiment. [Figure 33] 13 is an example of a screen displayed by the catheter system of the tenth embodiment. [Figure 34] 13 is an example of a screen displayed by the catheter system of the tenth embodiment. [Figure 35] 13 is an example of a screen displayed by the catheter system of the tenth embodiment. [Figure 36] 13 is an example of a screen displayed by the catheter system of the tenth embodiment. [Figure 37] 13 is an example of a screen displayed by the catheter system of the tenth embodiment. [Figure 38] 13 is an example of a screen displayed by the catheter system of the tenth embodiment. [Figure 39] FIG. 22 is a functional block diagram of the catheter system of the eleventh embodiment. [Figure 40] FIG. 22 is an explanatory diagram illustrating the configuration of a catheter system according to a twelfth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment 1] FIG. 1 is an explanatory diagram illustrating an overview of a catheter system 10. The catheter system 10 includes a diagnostic imaging catheter 40, an MDU (Motor Driving Unit) 33, and an information processing device 20. The diagnostic imaging catheter 40 is connected to the information processing device 20 via the MDU 33. A display device 31 and an input device 32 are connected to the information processing device 20. The input device 32 is, for example, a keyboard, a mouse, a trackball, or a microphone. The display device 31 and the input device 32 may be stacked together to form a touch panel. The input device 32 and the information processing device 20 may be configured as an integrated unit.

[0010] 2 is an explanatory diagram illustrating an overview of the diagnostic imaging catheter 40. The diagnostic imaging catheter 40 has a probe section 41 and a connector section 45 disposed at the end of the probe section 41. The probe section 41 is connected to the MDU 33 via the connector section 45. In the following description, the side of the diagnostic imaging catheter 40 farther from the connector section 45 will be referred to as the tip side.

[0011] A shaft 43 is inserted inside the probe portion 41. A sensor 42 is connected to the tip side of the shaft 43. A ring-shaped tip marker 44 is fixed near the tip of the probe portion 41.

[0012] The function of the MDU 33 allows the sensor 42 and shaft 43 to move forward and backward while rotating inside the probe part 41. By performing a pull-back operation in which the sensor 42 is rotated while being pulled toward the MDU 33 at a constant speed, multiple cross-sectional images 485 (see FIG. 4) centered on the probe part 41 and approximately perpendicular to the probe part 41 are successively captured at predetermined intervals.

[0013] The sensor 42 is, for example, an ultrasonic transducer that transmits and receives ultrasonic waves, or a transmitter / receiver for OCT (Optical Coherence Tomography) that emits near-infrared light and receives reflected light. The hollow organ into which the diagnostic imaging catheter 40 is inserted is, for example, a blood vessel, pancreatic duct, bile duct, or bronchi.

[0014] 2 shows an example of an imaging diagnostic catheter 40 for IVUS (Intravascular Ultrasound) used to capture an ultrasonic tomographic image from inside a blood vessel. In the following description, the imaging diagnostic catheter 40 will be described as an IVUS catheter.

[0015] The diagnostic imaging catheter 40 is not limited to a mechanical scanning type that mechanically rotates and moves back and forth, but may be an electronic radial scanning type diagnostic imaging catheter 40 that uses a sensor 42 in which multiple ultrasonic transducers are arranged in a ring shape.

[0016] The diagnostic imaging catheter 40 may have a so-called linear scanning type sensor 42 in which a plurality of ultrasonic transducers are arranged in a row along the longitudinal direction. The diagnostic imaging catheter 40 may also have a so-called two-dimensional array type sensor 42 in which a plurality of ultrasonic transducers are arranged in a matrix.

[0017] The diagnostic imaging catheter 40 can capture tomographic images that include not only lumen walls such as blood vessel walls but also reflectors present inside the lumen organ, such as red blood cells, and structures surrounding the lumen organ, such as organs present outside the lumen organ, such as the pericardium and heart. The diagnostic imaging catheter 40 can capture tomographic images that include not only the lumen wall at the portion where the sensor 42 is inserted, but also lumen organs branching from the lumen organ and lumen organs joining the lumen organ.

[0018] In the following description, a set of multiple transverse images 485 from which a longitudinal tomographic image can be generated will be referred to as one set of transverse images 485. Similarly, acquiring one set of transverse images 485 from which a longitudinal tomographic image can be generated using the imaging diagnostic catheter 40 will be referred to as one image acquisition.

[0019] One set of transverse images 485 is acquired, for example, by one pull-back operation by the MDU 33. One set of transverse images 485 may be acquired while the user manually pushes and pulls the diagnostic imaging catheter 40. Here, the push-pull operation of the diagnostic imaging catheter 40 includes both the push-pull operation of the probe portion 41 and the push-pull operation of the sensor 42 inside the probe portion 41.

[0020] For example, the user pulls back or pushes in the sensor 42 at a substantially constant speed. The transverse cross-sectional images 485 acquired during the period from when the user issues an instruction to start acquisition by voice input or the like until when the user issues an instruction to end acquisition constitute one set of transverse cross-sectional images 485.

[0021] A sensor or the like may be provided to detect the amount by which the user pushes or pulls sensor 42. Images acquired while the user pulls or pushes sensor 42 over a predetermined range constitute a set of cross-sectional images 485.

[0022] If the position of the sensor 42 can be detected, the user may push or pull the sensor 42 at any speed and in any direction. The transverse cross-sectional images 485 rearranged in order along the longitudinal direction of the probe portion 41 constitute one set of transverse cross-sectional images 485. If the intervals between the transverse cross-sectional images 485 are not constant, each transverse cross-sectional image 485 is recorded in association with position information along the longitudinal direction of the probe portion 41. In the following description, a case where the intervals between the transverse cross-sectional images 485 are constant will be described as an example.

[0023] 3 is an explanatory diagram illustrating the configuration of the catheter system 10. As described above, the catheter system 10 includes an information processing device 20, an MDU 33, and an imaging diagnostic catheter 40. The information processing device 20 includes a control unit 21, a main memory device 22, an auxiliary memory device 23, a communication unit 24, a display unit 25, an input unit 26, a catheter control unit 271, and a bus.

[0024] The control unit 21 is an arithmetic and control device that executes the program of this embodiment. The control unit 21 uses one or more central processing units (CPUs), graphics processing units (GPUs), tensor processing units (TPUs), multi-core CPUs, etc. The control unit 21 is connected to each hardware unit that constitutes the information processing device 20 via a bus.

[0025] The main memory device 22 is a storage device such as an SRAM (Static Random Access Memory), a DRAM (Dynamic Random Access Memory), a flash memory, etc. The main memory device 22 temporarily stores information required during processing performed by the control unit 21 and programs currently being executed by the control unit 21.

[0026] The auxiliary storage device 23 is a storage device such as an SRAM, a flash memory, a hard disk, or a magnetic tape. The auxiliary storage device 23 stores the programs to be executed by the control unit 21, the first model 71, and various data required for executing the programs. The communication unit 24 is an interface that performs communication between the information processing device 20 and a network.

[0027] Display unit 25 is an interface that connects display device 31 to the bus. Input unit 26 is an interface that connects input device 32 to the bus. Catheter control unit 271 controls MDU 33, controls sensor 42, and generates transverse tomographic images 485 and longitudinal tomographic images based on signals received from sensor 42. The function and configuration of catheter control unit 271 are similar to those of conventionally used ultrasound diagnostic devices, and therefore a description thereof will be omitted. Note that control unit 21 may also realize the function of catheter control unit 271.

[0028] The information processing device 20 is connected to various imaging diagnostic devices 37 such as an X-ray angiography device, an X-ray CT (Computed Tomography) device, an MRI (Magnetic Resonance Imaging) device, a PET (Positron Emission Tomography) device, or an ultrasound diagnostic device via an HIS (Hospital Information System) or the like.

[0029] The information processing device 20 of this embodiment is a dedicated ultrasound diagnostic device, or a personal computer, tablet, smartphone, or the like having the functions of an ultrasound diagnostic device.

[0030] 4 is an explanatory diagram outlining the processing by the catheter system 10. The control unit 21 acquires a set of transverse cross-sectional images 485 from the catheter control unit 271. Based on the acquired transverse cross-sectional images 485, the control unit 21 generates first information including determination information that determines regions to be treated and regions not to be treated.

[0031] The control unit 21 may perform three or more stages of determination, such as "region to be treated," "boundary region between region to be treated and region not to be treated," and "region not to be treated." The control unit 21 may output the inner diameter of the hollow organ in each transverse cross-sectional image 485 together with the first information.

[0032] 4, the control unit 21 determines regions to be treated and regions not to be treated along the longitudinal direction of the hollow organ. The stenosis to be treated is located in the center of the region scanned in one image acquisition operation along the longitudinal direction of the hollow organ.

[0033] The control unit 21 outputs first support information that supports the user in diagnosis or treatment based on the first information. In the example shown in Fig. 4, the first support information includes a schematic diagram showing a treatment target for a hollow organ or the vicinity of the hollow organ, a treatment method such as a recommended treatment and an instrument to be used, and risks such as a risk of complications associated with the treatment.

[0034] Although not shown in the drawings, the first support information also includes information on the treatment method, such as the procedure for performing the recommended treatment and the equipment to be used. The information on the treatment method may be, for example, an instruction manual for the equipment.

[0035] 5 is an explanatory diagram illustrating the configuration of the first model 71. The first model 71 is a model that receives a set of transverse images 485 and outputs whether or not treatment is required for the hollow organ or the surrounding area of ​​the hollow organ corresponding to each of the transverse images 485. Note that the "need for treatment" may refer to whether or not IVR (Interventional Radiology), which performs treatment inside the hollow organ, is required, or whether or not general treatment, including medication and dietary therapy, is required.

[0036] The first model 71 may be a model that receives an input of one transverse image 485 and outputs whether or not treatment is required for the hollow organ or the vicinity of the hollow organ. When using such a first model 71, the control unit 21 inputs the transverse images 485 one by one into the first model 71 and repeats the process of obtaining whether or not treatment is required the number of times equal to the number of transverse images 485.

[0037] As mentioned above, the first model 71 may be a model that accepts a set of cross-sectional images 485 obtained by a pullback operation using the MDU 33, or a model that accepts input of a set of cross-sectional images 485 obtained by manually moving the sensor 42 forward and backward.

[0038] The first model 71 may be a model that accepts input of a partial transverse image 485, such as half or one-third of the transverse image 485 obtained by one pull-back operation by the MDU 33, and outputs whether or not treatment is required for the hollow organ or the surrounding area of ​​the hollow organ. When using such a first model 71, the control unit 21 inputs an acceptable number of transverse images 485 into the first model 71 and repeats the process of acquiring whether or not treatment is required as many times as necessary.

[0039] The first model 71 includes an input layer, a neural network 719, a plurality of softmax layers 711, a selection layer 712 connected to each of the softmax layers 711, and an output layer. The neural network 719 is, for example, a convolutional neural network (CNN) having a plurality of pairs of convolution layers and pooling layers, and a fully connected layer.

[0040] The first model 71 has the same number of softmax layers 711 and selection layers 712 as the number of input cross-sectional images 485. The neural network 719 outputs to each softmax layer 711 a feature value indicating the probability of the need for treatment of the hollow organ corresponding to one cross-sectional image 485 or the surrounding area of ​​the hollow organ.

[0041] The feature quantities are converted into probabilities by the softmax layer 711. Specifically, the softmax layer 711 outputs probabilities for each hierarchy, such as "0 percent or more but less than 10 percent" or "10 percent or more but less than 20 percent."

[0042] The selection layer 712 selects and outputs the probability of whether treatment is required for the hollow organ or the area around the hollow organ corresponding to one transverse cross-sectional image 485. The transverse cross-sectional image 485 selects, for example, the layer with the highest probability and outputs its representative value. The selection layer 712 may calculate and output the probability of whether treatment is required based on the representative value of each layer and the probability for that layer.

[0043] 6 is an example of a screen displayed by the catheter system 10. In the following description, the catheter system 10 used for treating stenosis of a blood vessel, which is a type of hollow organ, will be described as an example.

[0044] 6 includes a schematic diagram field 524, a current dimension field 528, a target shape field 523, a target dimension field 529, a recommended procedure field 534, and a risk field 535. The schematic diagram field 524 displays a schematic diagram of the inner diameter of the luminal organ extracted based on the longitudinal tomographic image generated by the catheter control unit 271, color-coded based on the output of the first model 71. Note that "not to be treated" indicates a portion output by the first model 71 as not requiring treatment.

[0045] The current dimension column 528 displays the minimum inner diameter of the hollow organ and the minimum cross-sectional area of ​​the hollow organ lumen, which the control unit 21 calculates by performing image analysis on the longitudinal tomographic images acquired from the catheter control unit 271. Below the minimum cross-sectional area, the length of the treatment target, which is calculated by adding the slice thickness during scanning to the number of transverse images 485 determined by the first model 71 to be the treatment target, is displayed. The information displayed by the control unit 21 in the schematic diagram column 524 and the current dimension column 528 is an example of the first information.

[0046] The control unit 21 may display a longitudinal tomographic image instead of a schematic diagram in the schematic diagram field 524. In this case, the control unit 21 can display the area to be treated by, for example, surrounding it with a frame or coloring it. The user can check the change in condition of the hollow organ along the longitudinal direction in the schematic diagram field 524.

[0047] The control unit 21 may display a three-dimensional schematic diagram in the schematic diagram field 524 and the target shape field 523. Specifically, the control unit 21 displays, for example, a cutaway model diagram cut along two planes intersecting the central axis of the catheter. The three-dimensional schematic diagram allows the user to easily understand the shape of the inner surface of the hollow organ.

[0048] A schematic diagram deformed based on the treatment goal is displayed in the target shape field 523. The target minimum inner diameter and target minimum cross-sectional area, which are the treatment goals, are displayed in the target dimension field 529. The control unit 21 automatically acquires the treatment goal based on guidelines established by medical societies, medical facilities, etc.

[0049] A specific example of a method for calculating information to be displayed in the target dimension field 529 will be described. For example, if a guideline or the like specifies the target minimum opening rate after treatment based on area, the control unit 21 calculates the target minimum cross-sectional area after treatment by multiplying the cross-sectional area of ​​the lumen of the "non-treatment target" portion by the target minimum opening rate. Furthermore, the control unit 21 calculates the target minimum inner diameter using equation (1).

[0050]

number

[0051] The above-described methods for calculating the target minimum inner diameter and the target minimum cross-sectional area are merely examples, and the present invention is not limited to these. The control unit 21 may display any items other than the target minimum inner diameter and the target minimum cross-sectional area in the target dimension field 529.

[0052] A specific example of a method for generating a schematic diagram deformed based on the treatment goal and displayed in the target shape field 523 will be described. The control unit 21 calculates the vertical midpoint in FIG. 6 of the lumen of the schematic diagram displayed in the schematic diagram field 524. The control unit 21 extracts points above and below the calculated midpoint that are half the target minimum inner diameter calculated based on equation (1). The extracted points indicate the surface of the target lumen after treatment.

[0053] The control unit 21 extracts points indicating the surface of the target lumen after treatment along the horizontal direction in Fig. 6. The control unit 21 generates a schematic diagram deformed based on the treatment target using lines connecting the extracted points, and displays the diagram in the target shape field 523.

[0054] The method for generating the schematic diagram deformed based on the treatment goal described above is merely an example, and the present invention is not limited to this. The control unit 21 can generate the schematic diagram after treatment based on any method.

[0055] The recommended procedure and the specifications of the instrument to be used for that procedure are displayed in the recommended procedure column 534. In the example shown in Figure 6, the procedure of "stent placement" is recommended, and the specifications of an appropriate stent are displayed. The specifications of an appropriate stent vary depending on the inner diameter of the stenotic portion, the length of the portion requiring treatment, etc.

[0056] The procedure that the control unit 21 displays in the recommended procedure field 534 is not limited to "stent placement." The control unit 21 displays recommended procedures such as "balloon angioplasty," "thrombolysis," "atherectomy," "embolization," "cauterization," "drainage," and "filter placement," based on the condition of the luminal organ and the surrounding area of ​​the lumen.

[0057] For example, if the recommended treatment is "balloon angioplasty," the control unit 21 may display treatment conditions such as the pressure and time to be inflated in addition to the specifications of the recommended balloon. For example, if the recommended treatment is "thrombolysis," the control unit may display treatment conditions such as the type, concentration, amount, and injection time of the drug in addition to the specifications of the recommended drug injection catheter.

[0058] The control unit 21 automatically selects a recommended treatment based on guidelines established by medical societies, medical facilities, etc. The control unit 21 extracts recommended device specifications based on the selected treatment, minimum inner diameter, minimum cross-sectional area, and length of the treatment target area.

[0059] The control unit 21 may display the model number, etc. of the recommended device in the recommended action field 534. The control unit 21 may select and display the model number, etc. of the recommended device from the inventory of devices held by the medical institution. The control unit 21 may display multiple model numbers of the recommended devices. Displaying the model number allows paramedical staff such as nurses to quickly prepare the equipment to be used.

[0060] The risk column 535 displays the risk associated with performing the treatment displayed in the recommended treatment column 534. The control unit 21 automatically acquires the risk associated with the recommended treatment based on guidelines established by medical societies, medical facilities, or the like.

[0061] As described above, the control unit 21 displays the first support information using the target shape column 523, the recommended action column 534, and the risk column 535. The control unit 21 may also display validity information indicating the validity of the information, such as the recommendation level defined in the aforementioned guidelines, etc., and the name of the guideline that is the source of the information.

[0062] The control unit 21 may acquire the first support information from a learning model that accepts input of the first information and outputs the first support information. The control unit 21 may acquire the first support information and its accuracy from the learning model and display them.

[0063] For example, if the location where the image acquisition operation was performed is not aligned with the affected area, the scanned area does not include the area requiring treatment. If there is no area requiring treatment, the control unit 21 displays this in the recommended treatment field 534. The user can change the length of insertion of the diagnostic imaging catheter 40 into the hollow organ, and perform the image acquisition operation again.

[0064] Figure 7 is an example of a screen displayed by the catheter system 10. In Figure 7, a placed stent is shown schematically in the target shape field 523. The user can confirm that stent placement is recommended in the target shape field 523 as well as in the recommended procedure field 534.

[0065] The controller 21 may accept a change to the procedure displayed in the recommended procedure field 534. For example, the user can issue an instruction to change "stent placement" to "balloon angioplasty" via a user interface such as a pull-down menu or voice input. The controller 21 outputs the specifications and inflation pressure of the balloon to be used when performing balloon angioplasty to the recommended procedure field 534.

[0066] The balloon specifications output by the control unit 21 include, for example, the name of the balloon, its dimensions, and its type. The balloon dimensions include its total length and its outer diameter when inflated. The balloon type includes, for example, a semi-compliant balloon and a non-compliant balloon. The control unit 21 may also output a compliance chart showing the relationship between the pressure applied to the balloon and its outer diameter.

[0067] 8 is a flowchart illustrating the processing flow of the program. The control unit 21 acquires a set of transverse images 485 from the catheter control unit 271 (step S801). The control unit 21 inputs the acquired transverse images 485 to the first model 71, and acquires first information regarding the necessity of treatment for the hollow organ corresponding to each transverse image 485 or the vicinity of the hollow organ (step S802).

[0068] The control unit 21 determines whether or not treatment is required (step S803). Specifically, the control unit 21 determines whether or not there is a transverse cross-sectional image 485 for which the first model 71 has output a determination that treatment is required.

[0069] If it is determined that no treatment is required (NO in step S803), the control unit 21 displays that no treatment is required in the recommended treatment column 534 (step S804), and then the control unit 21 ends the process.

[0070] If it is determined that treatment is required (YES in step S803), the control unit 21 performs image analysis on the transverse image 485 or longitudinal image obtained from the catheter control unit 271, and calculates the inner diameter and cross-sectional area of ​​the "non-treatment target" portion and the inner diameter and cross-sectional area of ​​the narrowed portion (step S811).

[0071] Specifically, the control unit 21 performs processing such as edge extraction to extract the inner boundary of the hollow organ. The control unit 21 extracts the inner diameter and cross-sectional area of ​​the lumen of the hollow organ from each transverse image 485. The control unit 21 calculates representative values ​​of the inner diameter and cross-sectional area in cross sections determined by the first model 71 to be outside the scope of treatment. The control unit 21 calculates the minimum inner diameter and minimum cross-sectional area in cross sections determined by the first model 71 to require treatment, i.e., the inner diameter and cross-sectional area of ​​the stenotic portion.

[0072] The control unit 21 calculates the length of the treatment target by multiplying the number of transverse images 485 determined by the first model 71 to be the treatment target by the slice thickness during scanning (step S812). Note that the control unit 21 may calculate the length of the treatment target based on the length of a portion where the inner diameter or cross-sectional area is smaller than a predetermined standard.

[0073] The control unit 21 automatically acquires a recommended treatment method based on guidelines established by medical societies, medical facilities, etc. (step S813). The guidelines, etc. are organized in the form of a flowchart or a selection tree, for example, and stored in the auxiliary storage device 23. When the recommended treatment method varies depending on attributes such as the patient's medical history, the control unit 21 acquires necessary information from an electronic medical record, etc., or displays a dialog box requesting user input.

[0074] The control unit 21 automatically acquires a treatment target based on the aforementioned guidelines or the like (step S814). For example, if the guidelines or the like specify a target minimum opening rate after treatment based on area, the control unit 21 calculates a representative value for the cross-sectional area of ​​the lumen of the "non-treatment target" portion. The representative value is any statistical quantity, such as the average, minimum, or maximum value. The representative value may be, for example, the cross-sectional area of ​​the center of the "non-treatment target" portion along the longitudinal direction of the tubular organ.

[0075] The control unit 21 calculates the target minimum cross-sectional area after treatment by multiplying the calculated representative value by the target minimum aperture ratio. Furthermore, the control unit 21 calculates the target minimum inner diameter using the above-mentioned formula (1) based on the target minimum cross-sectional area.

[0076] The above-described methods for calculating the target minimum inner diameter and the target minimum cross-sectional area are merely examples, and the present invention is not limited to these. The control unit 21 may display any items other than the target minimum inner diameter and the target minimum cross-sectional area in the target dimension field 529.

[0077] The control unit 21 may accept input of a treatment goal by the user. The user may input the treatment goal, for example, as a numerical value. The user may also input the treatment goal by tapping on the schematic diagram field 524.

[0078] The control unit 21 acquires a recommended treatment device (step S815). Specifically, the type of treatment device is determined by the treatment method acquired in step S813. For example, when "stent placement" is performed, a stent is used.

[0079] There are various variations of stents with different specifications such as diameter and length, and a stent is selected depending on the condition of the affected area. The control unit 21 determines the diameter and length of the stent based on the inner diameter and cross-sectional area of ​​the "non-treatment target" portion and the stenotic portion calculated in step S811 and the treatment target length calculated in step S812.

[0080] The treatment device recommended by the control unit 21 is not limited to a stent. The treatment device may be any intraluminal indwelling device, such as a filter for placement in a luminal organ or an embolization coil. When the target luminal organ is a blood vessel, the intraluminal indwelling device may be an intravascular indwelling device.

[0081] The treatment device may be a lumen diameter expansion device such as a dilatation balloon or rotablator, an energy treatment device such as a laser treatment catheter, or a drug distribution device such as a drug distribution catheter.

[0082] The control unit 21 automatically acquires the risks associated with the treatment based on the aforementioned guidelines, etc. (step S816) The control unit 21 generates a schematic diagram to be displayed in the schematic diagram field 524 and the target shape field 523 (step S817).

[0083] A specific example of a method for generating a schematic diagram deformed based on the treatment goal and displayed in the target shape field 523 will be described. The control unit 21 calculates the vertical midpoint in FIG. 6 of the lumen of the schematic diagram displayed in the schematic diagram field 524. The control unit 21 extracts points above and below the calculated midpoint that are half the target minimum inner diameter calculated based on equation (1). The extracted points indicate the surface of the target lumen after treatment.

[0084] The control unit 21 extracts points indicating the surface of the target lumen after treatment along the horizontal direction in Fig. 6. The control unit 21 generates a schematic diagram deformed based on the treatment target using lines connecting the extracted points, and displays the diagram in the target shape field 523.

[0085] The method for generating the schematic diagram deformed based on the treatment goal described above is merely an example, and the present invention is not limited thereto. The control unit 21 can generate the schematic diagram after treatment based on any method.

[0086] The control unit 21 displays the screen described with reference to Fig. 6 or 7 (step S818), and then the control unit 21 ends the process.

[0087] According to this embodiment, it is possible to provide a catheter system 10 that automatically determines and outputs the area requiring treatment along the longitudinal direction of the hollow organ, thereby providing a catheter system 10 that can be easily used even by relatively inexperienced users.

[0088] According to this embodiment, it is possible to provide a catheter system 10 that displays the recommended procedure and the specifications of the equipment recommended for that procedure when treatment is required. The user can quickly determine the necessary equipment, even for equipment such as stents, which are available in a wide variety of specifications.

[0089] The control unit 21 may select and display the model number, etc. of the recommended equipment from a list of equipment held by the medical institution. This makes it possible to provide a catheter system 10 that allows the user to quickly decide on equipment. The control unit 21 may also display multiple specifications or model numbers of the recommended equipment. The user can select the equipment to use based on their professional perspective.

[0090] According to this embodiment, a catheter system 10 can be provided that displays the risks of treatment. By checking the risks, the user can carefully perform treatment to avoid the risks. By checking the risk display, paramedical staff can prepare for unexpected situations.

[0091] The control unit 21 may accept the selection of a procedure different from the recommended procedure and display the equipment recommended for that procedure and the risks of that procedure. Even if the user selects a procedure different from the procedure recommended by the control unit 21, the catheter system 10 can be provided to support the user.

[0092] [Embodiment 2] This embodiment relates to a catheter system 10 in which a user manually inputs a lesion site. Explanation of parts common to the first embodiment will be omitted.

[0093] Figure 9 is an example of a screen displayed by the catheter system of embodiment 2. The screen shown in Figure 9 displays a longitudinal tomographic image field 52, a transverse tomographic image field 51, an item selection field 585, a start button 588, and an end button 589. The transverse tomographic image field 51 displays the transverse tomographic image 485 described above. The longitudinal tomographic image field 52 displays the longitudinal tomographic image generated by the catheter control unit 271.

[0094] A transverse section position marker 551 indicating the position of the transverse section image 485 displayed in the transverse section image field 51 is displayed on the edge of the transverse section image field 52. A transverse section position marker 552 indicating the position of the transverse section image displayed in the transverse section image field 52 is displayed on the edge of the transverse section image field 51. For example, the control unit 21 displays the transverse section image 485 with the highest degree of stenosis, which will be described later, in the transverse section image field 51 by default.

[0095] The user can appropriately change the cross section to be displayed by operating the input device 32 to change the positions of the transverse section position marker 551 and the longitudinal section position marker 552. The control unit 21 may also accept voice input from the user.

[0096] The control unit 21 may display markers indicating the positions of characteristic transverse cross-sectional images 485, including the transverse cross-sectional image 485 with the highest degree of stenosis, on the edge of the longitudinal tomographic image field 52. When the user selects a displayed marker, the control unit 21 displays the transverse cross-sectional image 485 corresponding to the selected marker.

[0097] The user can select an item to input by operating the item selection field 585. Fig. 9 shows an example in which "lesion area" is being input. When the selection of the start button 588 is accepted after the selection of "lesion area" is accepted from the item selection field 585, the control unit 21 displays a closed curve 576 in the longitudinal tomographic image field 52 and the transverse tomographic image field 51.

[0098] The user can adjust the closed curve 576 so that it surrounds the "lesion area" by appropriately operating the cursor 575. The control unit 21 automatically adjusts the closed curve 576 that is not being operated by the cursor 575 so that the height of the closed curve 576 superimposed on the longitudinal tomographic image field 52 matches the height of the closed curve 576 superimposed on the transverse tomographic image field 51.

[0099] After enclosing the desired range with the closed curve 576 by also operating the transverse slice position marker 551 and the longitudinal slice position marker 552, the user selects the end button 589. When the selection of the end button 589 is accepted, the control unit 21 accepts the end of setting the "lesion area."

[0100] The "lesion area" is an example of the first information relating to the condition of the hollow organ or the condition of the area around the hollow organ. That is, the control unit 21 acquires the first information input by the user based on a tomographic image generated using the diagnostic imaging catheter 40 inserted into the hollow organ.

[0101] Similarly, the control unit 21 may accept inputs such as "calcification region" and "plaque region." The control unit 21 may also accept designation of the width or length of a specific portion instead of a region. These are all examples of the first region.

[0102] The longitudinal tomographic image field 52 and the transverse tomographic image field 51 may display post-treatment tomographic images 487 (see FIG. 22 ) acquired using the diagnostic imaging catheter 40 after performing intraluminal treatment, specifically, a post-treatment longitudinal tomographic image and a post-treatment transverse tomographic image, respectively. The control unit 21 receives information related to the condition after the treatment based on the post-treatment tomographic image 487.

[0103] 10 is a flowchart illustrating the processing flow of the program of the second embodiment. The control unit 21 acquires a set of transverse tomographic images 485 and longitudinal tomographic images from the catheter control unit 271 (step S831). The control unit 21 displays the acquired transverse tomographic images 485 and longitudinal tomographic images on the screen described with reference to FIG. 9 (step S832). The control unit 21 acquires first information such as the range of the lesion area based on the user's operations on the item selection field 585, the start button 588, the cursor 575, the end button 589, and the like (step S833).

[0104] The control unit 21 calculates the dimensions of the lesion area, such as the area, volume, and length, based on the acquired first information (step S834). The control unit 21 determines whether treatment is necessary based on guidelines established by medical societies, medical facilities, or the like (step S835). The guidelines are organized in the form of, for example, a flowchart or a selection tree and stored in the auxiliary storage device 23.

[0105] When the recommended treatment method varies depending on the attributes of the patient, such as a medical history, the control unit 21 acquires the necessary information from an electronic medical record or the like, or displays a dialog box requesting input by the user.

[0106] If it is determined that no treatment is required (NO in step S835), the control unit 21 displays that no treatment is required in the recommended treatment column 534 (step S804), and then the control unit 21 ends the process.

[0107] If it is determined that treatment is required (YES in step S835), the control unit 21 automatically acquires a recommended treatment method based on the aforementioned guidelines, etc. (step S813). The subsequent processing is the same as the processing flow described using Fig. 8, and therefore description thereof will be omitted.

[0108] According to this embodiment, it is possible to provide a catheter system 10 that allows a user to manually input the first region. For example, it is possible to provide a catheter system 10 that can be used even if a highly accurate first model 71 has not been generated.

[0109] [Embodiment 3] This embodiment relates to a catheter system 10 in which a catheter control device 27 and an information processing device 20 are separate entities. Explanation of parts common to the first embodiment will be omitted.

[0110] 11 is an explanatory diagram illustrating the configuration of a catheter system 10 according to embodiment 3. The catheter system 10 of this embodiment includes an information processing device 20, a catheter control device 27, an MDU 33, and an imaging diagnostic catheter 40. The information processing device 20 includes a control unit 21, a main memory device 22, an auxiliary memory device 23, a communication unit 24, a display unit 25, an input unit 26, and a bus.

[0111] Catheter control device 27 is an ultrasonic diagnostic device for IVUS that controls MDU 33, controls sensor 42, and generates transverse images 485 and longitudinal images based on signals received from sensor 42. The function and configuration of catheter control device 27 are similar to those of conventional ultrasonic diagnostic devices, and therefore a description thereof will be omitted.

[0112] The catheter control device 27 and the information processing device 20 may be directly connected via a cable or wireless communication, or may be connected via a network.

[0113] The information processing device 20 of this embodiment is a general-purpose personal computer, a tablet, a smartphone, a mainframe computer, a virtual machine running on a mainframe computer, a cloud computing system, or a quantum computer. The information processing device 20 may also be a plurality of personal computers performing distributed processing.

[0114] [Embodiment 4] This embodiment relates to a catheter system 10 that maps the types of a plurality of objects included in a tomographic image acquired by a diagnostic imaging catheter 40 in association with the locations of the respective objects.

[0115] 12 is an explanatory diagram outlining the processing performed by the catheter system 10 of embodiment 4. The control unit 21 acquires a set of transverse cross-sectional images 485 from the catheter control unit 271. The control unit 21 generates a transverse object arrangement image 483 based on the acquired transverse cross-sectional images 485. The transverse object arrangement image 483 is an image in which the types of multiple objects included in the transverse cross-sectional image 485 are mapped in association with the ranges of each object.

[0116] The control unit 21 generates a vertical object arrangement image 484 based on a set of horizontal object arrangement images 483. Specifically, the control unit 21 extracts pixels at positions corresponding to the longitudinal tomographic images from each horizontal object arrangement image 483, and performs interpolation processing or the like to reconstruct the images, thereby forming a vertical object arrangement image 484 corresponding to the longitudinal tomographic images. This processing is similar to the method of forming a longitudinal tomographic image from a set of transverse cross-sectional images 485, and therefore detailed description thereof will be omitted.

[0117] Three-dimensional data may be generated based on a set of cross-sectional images 485, and three-dimensional semantic segmentation may be performed to assign a label indicating the type of object to each voxel. From the three-dimensional object layout image generated by the three-dimensional semantic segmentation result, a longitudinal object layout image 484 corresponding to the longitudinal cross-sectional image can be generated.

[0118] The horizontal object arrangement image 483 and the vertical object arrangement image 484 are examples of first information relating to the state of the hollow organ or the state of the surroundings of the hollow organ.

[0119] The first information may include the length, area, angle, volume, etc. of the object calculated based on the horizontal object arrangement image 483 and the vertical object arrangement image 484. The first information may include the length, area, angle, volume, etc. of the hollow organ or the periphery of the hollow organ calculated based on a tomographic image taken using the diagnostic imaging catheter 40.

[0120] When the hollow organ is a blood vessel and the catheter control unit 271 is capable of calculating information about the blood flow, such as the direction or speed of the blood flow, the first information may include information about the blood flow.

[0121] The control unit 21 outputs first support information that supports the user in diagnosis or treatment based on the first information. In the example shown in Fig. 12, the first support information includes a schematic diagram showing a treatment target for a hollow organ or the vicinity of the hollow organ, a treatment method such as a recommended treatment and an instrument to be used, and risks associated with the treatment.

[0122] 13 is an explanatory diagram illustrating the first model 71. The first model 71 is a model that receives a cross-sectional image 485 and outputs a cross-sectional object arrangement image 483 in which the types of multiple objects included in the cross-sectional image 485 are associated with the ranges of each object and mapped. The first model 71 is generated by machine learning.

[0123] In the horizontal object arrangement image 483 shown in Figure 13, vertical hatching indicates the "cross section of the diagnostic imaging catheter 40," horizontal hatching indicates the "wall of the tubular organ," diagonal hatching to the right indicates the "inside of the tubular organ," diagonal hatching to the left indicates the "guide wire," and thin grid-like hatching indicates "calcification."

[0124] The term "guidewire" includes the guidewire itself, multiple echoes generated by the guidewire, and acoustic shadows generated by the guidewire. Similarly, the term "calcification" includes the calcified portion itself, multiple echoes generated by the calcified portion, and acoustic shadows generated by the calcified portion.

[0125] 12 and 13 show that each object is painted in a different color. Painting each object in a different color is one example of a method for displaying each object in a distinctive manner. Each object may be displayed in any manner, such as by surrounding its outer edge, so as to be distinguishable from other objects.

[0126] Here, the "cross section of the diagnostic imaging catheter," "wall of a hollow organ," "inside of a hollow organ," "guidewire," and "calcification" are examples of objects included in the transverse image 485. For example, the "guidewire itself," the "multiple echoes generated by the guidewire," and the "acoustic shadow generated by the guidewire" may each be classified as different objects. Similarly, lesions such as "plaque" and "dissection" that occur in the wall of a hollow organ may each be classified as different objects.

[0127] In the following explanation, a model that receives an input of a set of cross-sectional images 485 and outputs a horizontal object arrangement image 483 corresponding to each cross-sectional image 485 will be explained as an example.

[0128] The first model 71 may be a model that accepts a set of cross-sectional images 485 obtained by a pull-back operation using the MDU 33, or a model that accepts input of a set of cross-sectional images 485 obtained by manually moving the sensor 42 back and forth. The first model 71 may be a model that accepts input of a single cross-sectional image 485. The first model 71 may be a model that accepts input of half, one-third, or the like of the cross-sectional images 485 obtained by a single pull-back operation.

[0129] The first model 71 is, for example, a semantic segmentation model, and includes an input layer, a neural network, and an output layer. The neural network has, for example, a U-Net structure that realizes semantic segmentation. The U-Net structure is composed of multiple encoder layers and multiple decoder layers connected thereafter. Semantic segmentation assigns a label indicating the type of object to each pixel that makes up the input image.

[0130] The control unit 21 determines the display method for each pixel according to the label, thereby generating an output image in which objects are mapped in different colors or background patterns for each type, as shown in the horizontal object arrangement image 483 in FIG.

[0131] The first model 71 may be a model that realizes image segmentation, generated based on the Mask R-CNN model or any other machine learning algorithm.

[0132] By using the entire set of cross-sectional images 485 as input data, information on adjacent cross-sectional images 485 is reflected in the horizontal object arrangement image 483. Therefore, it is possible to realize a first model 71 that is less susceptible to the influence of noise in each cross-sectional image 485 and accurately outputs the range of the object.

[0133] Fig. 14 is an example of a screen displayed by the catheter system of embodiment 4. The screen shown in Fig. 14 includes a vertical object arrangement field 525, a transverse image field 51, a current dimension field 528, a target dimension field 529, a recommended procedure field 534, and a risk field 535. The vertical object arrangement field 525 displays the above-mentioned vertical object arrangement image 484. The transverse image field 51 displays the above-mentioned transverse image 485.

[0134] The current dimension column 528 displays the minimum inner diameter of the hollow organ and the minimum cross-sectional area of ​​the hollow organ lumen, which the control unit 21 calculates by performing image analysis on the longitudinal object arrangement image 484 or the longitudinal tomographic image acquired from the catheter control unit 271. The control unit 21 displays first information on the state of the blood vessel, which is the hollow organ, or the state of the area around the blood vessel, using the vertical object arrangement column 525 and the current dimension column 528.

[0135] The target minimum inner diameter and target minimum cross-sectional area, which are the treatment targets, are displayed in the target dimension field 529. The recommended treatment is displayed in the recommended treatment field 534. The controller 21 may further display the specifications of the instrument to be used for the treatment in the recommended treatment field 534. The risk field 535 displays the risks associated with performing the treatment displayed in the recommended treatment field 534.

[0136] 14, there are two risk items, "dissection" and "plaque rupture." The control unit 21 displays the first support information using a target dimension column 529, a recommended action column 534, and a risk column 535. The control unit 21 may also display in the risk column 535 the risk associated with not performing the action displayed in the recommended action column 534.

[0137] Based on a user's instruction, the control unit 21 may display a longitudinal tomographic image acquired from the catheter control unit 271 in the longitudinal object arrangement field 525 instead of the longitudinal object arrangement image 484. Based on a user's instruction, the control unit 21 may display a transverse object arrangement image 483 in the transverse image field 51 instead of the transverse image 485.

[0138] The control unit 21 may display a functional evaluation result such as fractional flow reserve (FFR) instead of or together with the current dimension field 528. The control unit 21 can measure the fractional flow reserve using a pressure wire inserted into the coronary artery instead of the diagnostic imaging catheter 40.

[0139] FIG. 15 is an example of a screen displayed by the catheter system 10 of the fourth embodiment. When the user instructs the system to indicate the basis for "plaque rupture," which is surrounded by an oval among the risk items displayed in the risk column 535, the control unit 21 displays the screen shown in FIG. 15. The user can input an instruction to display the basis by, for example, double-clicking the character string "plaque rupture" in the risk column 535. The control unit 21 may also accept voice input from the user.

[0140] A transverse image 485 including "unstable plaque," which is the basis for the risk of "plaque rupture," is displayed in the transverse image field 51. Below the transverse image field 51, a reason field 516 is displayed indicating that "unstable plaque" has been determined to exist in this area.

[0141] The control unit 21 extracts the transverse cross-sectional image 485 having the largest area of ​​the object corresponding to, for example, "unstable plaque" and displays it in the transverse cross-sectional image field 51. The control unit 21 moves the transverse cross-sectional position marker 551 to a position indicating the position of the cross-sectional image being displayed in the transverse cross-sectional image field 51.

[0142] In the example screen shown in Fig. 15, no marker indicating the range of "vulnerable plaque" is displayed. The user can directly observe the transverse layer image 485. The user can operate the transverse layer position marker 551 as necessary to observe the transverse layer images 485 before and after the transverse layer image 485 displayed by the control unit 21, and determine what kind of treatment to perform based on a professional perspective.

[0143] Figure 16 is an example of a screen displayed by the catheter system of embodiment 4. When the user instructs to indicate the basis for the presence of "vulnerable plaque," the control unit 21 displays the screen shown in Figure 15. The transverse image field 51 displays a transverse image 485 on which a basis marker 561 indicating the basis region that formed the basis for the determination of "vulnerable plaque" is superimposed.

[0144] The control unit 21 extracts the grounds region using a model visualization method such as Gradient-weighted Class Activation Mapping (Grad-CAM) or Grad-CAM++. The grounds region is a region that has a strong influence on the output of pixels determined to be "calcification" in the multiple cross-sectional images 485 input to the first model 71. The grounds marker 561 is displayed with finer hatching, the greater the influence on the output.

[0145] The cross-sectional image 485 including the "vulnerable plaque" described using FIG. 16 and the evidence marker 561 described using FIG. 16 are examples of evidence information regarding the risk of "plaque rupture."

[0146] A specific example of a method for the user to instruct the user to indicate the basis for the presence of "vulnerable plaque" will be described. For example, while the user operates the cursor to press and hold the reason field 516, the control unit 21 displays the basis marker 561 on the screen described using FIG. 16. When the user stops pressing and holding the reason field 516, the control unit 21 erases the basis marker 561 and returns to the screen described using FIG. 15.

[0147] The control unit 21 may switch between displaying and not displaying the grounds marker 561 every time the user clicks on the reason field 516. The control unit 21 may switch between displaying and not displaying the grounds marker 561 when the control unit 21 receives a long press or click on the cross-sectional image field 51 instead of the reason field 516.

[0148] The control unit 21 may display the basis marker 561 by default and erase the basis marker 561 while the user is pressing and holding the basis marker 561. The control unit 21 may switch between the screen described using FIG. 15 and the screen described using FIG. 16 based on a voice input.

[0149] 17 is a flowchart illustrating the processing flow of the program of embodiment 4. The control unit 21 acquires a set of transverse cross-sectional images 485 from the catheter control unit 271 (step S851). The control unit 21 inputs the acquired transverse cross-sectional images 485 to the first model 71, and acquires a transverse object arrangement image 483 that associates the types of multiple objects included in the transverse cross-sectional image 485 with the range of each object, and the probability that the object determination for each pixel is correct (step S852).

[0150] The control unit 21 generates a vertical object arrangement image 484 based on one set of horizontal object arrangement images 483 (step S853). The control unit 21 records the generated horizontal object arrangement image 483 and vertical object arrangement image 484 in the auxiliary storage device 23.

[0151] The control unit 21 performs image analysis on the horizontal object arrangement image 483 and the vertical object arrangement image 484 to calculate the dimensions of the portion not to be treated and the maximum stenosis portion (step S854). Here, the maximum stenosis portion means the portion where the degree of stenosis is most severe.

[0152] A specific example will be given. The control unit 21 extracts the cross-sectional area of ​​the lumen from each horizontal object arrangement image 483. The cross-sectional area of ​​the lumen can be calculated by multiplying the number of pixels constituting the object representing the lumen by the area per pixel. The control unit 21 determines that the maximum value of the calculated cross-sectional areas is the cross-sectional area of ​​the portion not to be treated, and determines that the minimum value is the cross-sectional area of ​​the most stenotic portion.

[0153] The criteria for determining the non-treatment target portion and the most stenotic portion are not limited to area. For example, they may be determined based on any dimension, such as the maximum inner diameter or average diameter. The control unit 21 may accept the user's designation of the non-treatment target portion and the most stenotic portion.

[0154] The control unit 21 determines the degree of stenosis of the hollow organ (step S855). The degree of stenosis is defined by, for example, equation (1) or equation (2). Stenosis level = 1 - (inner diameter of stenotic area / inner diameter of non-treatment area) ... (1) Stenosis level = 1 - (area of ​​stenotic area / area of ​​non-treatment area) ... (2) The formula for calculating the degree of stenosis is not limited to formula (1) and formula (2). The control unit 21 may accept a selection or input of a method for calculating the degree of stenosis from the user.

[0155] The control unit 21 determines whether treatment is necessary based on guidelines, etc. established by medical societies, medical facilities, etc. (step S856). The guidelines, etc. are organized in the form of, for example, a flowchart or a selection tree and stored in the auxiliary storage device 23.

[0156] When the recommended treatment method varies depending on the attributes of the patient, such as a medical history, the control unit 21 acquires the necessary information from an electronic medical record or the like, or displays a dialog box requesting input by the user.

[0157] If it is determined that treatment is not required (NO in step S856), the control unit 21 displays that treatment is not required in the recommended treatment column 534 (step S804), and then the control unit 21 ends the process.

[0158] If it is determined that treatment is required (YES in step S856), the control unit 21 calculates the length of the stenotic portion to be treated based on the aforementioned guidelines, etc. (step S857). For example, the control unit 21 calculates the length of the range in which the cross-sectional area of ​​the lumen is smaller than a threshold value determined in the guidelines, etc. The control unit 21 automatically obtains a recommended treatment method based on the aforementioned guidelines, etc. (step S813).

[0159] The subsequent processing up to step S816 is the same as the processing flow described using Fig. 8, and therefore description thereof will be omitted. Control unit 21 displays the screen described using Fig. 15 and Fig. 16 (step S861). Thereafter, control unit 21 ends the processing.

[0160] According to this embodiment, it is possible to provide a catheter system 10 that supports a user by displaying a vertical object arrangement image 484. By referring to the vertical object arrangement image 484, the user can quickly understand the tomographic image.

[0161] According to this embodiment, it is possible to provide a catheter system 10 that supports a user by displaying a vertical object arrangement image 484. By referring to the vertical object arrangement image 484, the user can quickly understand the tomographic image.

[0162] According to this embodiment, it is possible to provide a catheter system 10 that can switch between the longitudinal object arrangement image 484 and the longitudinal tomographic image as appropriate, allowing the user to switch between the displayed images as needed for observation.

[0163] According to this embodiment, it is possible to provide a catheter system 10 that displays whether treatment is necessary, the recommended treatment, and the risks. According to this embodiment, it is possible to provide a catheter system 10 that automatically displays a cross-sectional image 485 of a region determined to be at risk and the basis for determining the risk.

[0164] [Embodiment 5] This embodiment relates to a catheter system 10 that receives a tomographic image acquired by an imaging diagnostic catheter 40 and outputs findings related to the condition of a hollow organ or the surrounding area of ​​the hollow organ. Explanation of parts common to the first embodiment will be omitted.

[0165] 18 is an explanatory diagram outlining the processing performed by the catheter system of embodiment 5. The control unit 21 acquires a set of transverse images 485 from the catheter control unit 271. Based on the acquired transverse images 485, the control unit 21 acquires findings regarding the condition of the hollow organ or the surrounding area of ​​the hollow organ, such as the need for treatment and the presence or absence of blood flow stasis.

[0166] The findings acquired by the control unit 21 are probabilities regarding predetermined options such as "yes" or "no" for each of a plurality of items. Details of the findings will be described later. The findings are an example of first information regarding the state of the hollow organ or the state of the surrounding area of ​​the hollow organ.

[0167] The control unit 21 outputs first support information that supports the user in diagnosis or treatment based on the first information. In the example shown in Fig. 18, the first support information includes the condition of the hollow organ or the indwelling device placed around the hollow organ, the recommended treatment method such as treatment and the instruments to be used, and the risks associated with the treatment.

[0168] 19 is an explanatory diagram illustrating the configuration of a first model 71 according to the fifth embodiment. The first model 71 according to the present embodiment is a model that receives a set of transverse cross-sectional images 485 and outputs findings related to the state of a hollow organ or the state around the hollow organ, such as the need for treatment, the presence or absence of blood flow stasis, or the presence or absence of bifurcation. Note that the "need for treatment" may refer to the need for IVR (Interventional Radiology), which performs treatment inside the hollow organ, or the need for general treatment, including medication and dietary therapy.

[0169] The findings output by the first model 71 are probabilities for predetermined options such as "yes" or "no" for each of a plurality of items. Tables 1 to 4 show examples of items for which the first model 71 outputs probabilities. Each row in Tables 1 to 4 shows one item. The first model 71 outputs the probability of the option for each item. Tables 1 to 4 show examples of items included in the findings output by the first model 71.

[0170] Table 1 shows items related to blood flow information.

[0171] [Table 1]

[0172] Table 2 shows items related to blood flow information.

[0173] [Table 2]

[0174] Table 3 shows items related to qualitative shape information of hollow organs and their surroundings.

[0175] [Table 3]

[0176] Table 4 shows items related to property information that indicate the properties of hollow organs and the surrounding areas of hollow organs.

[0177] [Table 4]

[0178] The "in-stent stenosis" shown in Table 4 indicates the presence or absence of stenosis of a stent placed in a luminal organ several months to several years ago. If the transverse image 485 is taken immediately after the stent placement procedure, it indicates the presence or absence of stenosis of the placed stent. In other words, the transverse image 485 may be a tomographic image of an untreated luminal organ, a tomographic image of a luminal organ during follow-up observation after treatment, or a tomographic image of a luminal organ taken immediately after completion of a series of intraluminal organ treatments.

[0179] Table 5 shows items related to device information that indicate the status of an indwelling device such as a stent placed in a luminal organ.

[0180] [Table 5]

[0181] The items shown in Tables 1 to 5 are examples. The first model 71 may output probabilities for some of the items shown in Tables 1 to 5. The first model 71 may output probabilities for items other than the items shown in Tables 1 to 5.

[0182] The options for each item shown in Tables 1 to 5 are examples. For example, for items shown in each table with two options, "yes" or "no," three or more options, such as "large," "small," or "no," may be used.

[0183] In the following explanation, a model that receives input of a set of transverse cross-sectional images 485 and outputs findings regarding the state of a hollow organ or the state of the surrounding area of ​​the hollow organ will be described as an example. Note that the first model 71 may be a model that receives input of a single transverse cross-sectional image 485 and outputs findings regarding the state of the hollow organ or the surrounding area of ​​the hollow organ. Alternatively, it may be a model that receives input of a partial transverse cross-sectional image 485, such as half or one-third of a set of transverse cross-sectional images 485 obtained by a single pull-back operation, and outputs findings regarding the state of the hollow organ or the surrounding area of ​​the hollow organ.

[0184] The first model 71 includes an input layer, a neural network 719, multiple softmax layers 711, and an output layer. The neural network 719 is, for example, a convolutional neural network (CNN) having multiple pairs of convolutional layers and pooling layers, and a fully connected layer. One softmax layer 711 is provided for each row shown in Tables 1 to 4.

[0185] The input layer receives a single image created by combining a set of cross-sectional images 485 in scan order. The output layer outputs the probabilities for each item shown in Tables 1 to 4 via a neural network 719 and a softmax layer 711.

[0186] For example, in FIG. 4, the probability that "need for treatment" is "no" is 95 percent, the probability that "blood flow stagnation" is "no" is 90 percent, and the probability that "bifurcation" is "yes" is 90 percent. Note that the first model 71 may be divided into separate models for Tables 1 to 3. The first model 71 may also be divided into separate models for each item to be output.

[0187] A selection layer that selects and outputs the option with the highest probability may be provided after the softmax layer 711.

[0188] To the first model 71, data at a stage prior to forming the transverse image 485, such as sound ray data acquired by the catheter control unit 271 from the sensor 42, may be input.

[0189] 20 is an example of a screen displayed by the catheter system 10 of embodiment 5. The screen shown in FIG. 20 includes a longitudinal tomographic image field 52, a transverse tomographic image field 51, a findings field 53, a current dimension field 528, a target dimension field 529, a recommended procedure field 534, and a risk field 535.

[0190] The longitudinal tomographic image field 52 displays a longitudinal tomographic image acquired from the catheter control unit 271. The transverse tomographic image field 51 displays a transverse tomographic image 485 acquired from the catheter control unit 271. That is, in Fig. 20, a post-treatment longitudinal tomographic image and a post-treatment transverse tomographic image after treatment on a hollow organ are displayed. The placed stent is depicted in the longitudinal and transverse images 485 in Figure 20. The stent is indicated by a number of black circles.

[0191] The control unit 21 selects, from the findings acquired from the first model 71, findings with a probability higher than a predetermined threshold, and displays them in the findings field 53. The findings displayed by the control unit 21 in the findings field 53 are examples of first information relating to the state of the hollow organ or the state of the surrounding area of ​​the hollow organ.

[0192] The current dimension column 528, the target dimension column 529, the recommended action column 534, and the risk column 535 are similar to the screen of the fourth embodiment described using Fig. 14, and therefore description thereof will be omitted. The information displayed by the control unit 21 in the recommended action column 534, the target dimension column 529, and the risk column 535 is an example of first support information that supports diagnosis or treatment.

[0193] In Figure 20, the finding is "malposition," meaning that the placed stent is not properly in contact with the inner wall of the luminal organ. A procedure to re-expand the stent from the inside by "balloon dilation" is recommended.

[0194] The user can operate the transverse slice position marker 551 and the longitudinal slice position marker 552 to check the state of the stent and the state of the luminal organ, and determine the treatment to be actually performed.

[0195] Figure 21 is an example of a screen displayed by the catheter system 10 of embodiment 5. When the user instructs to indicate the basis for the risk of "dissection," the control unit 21 displays the screen shown in Figure 21. The longitudinal tomographic image field 52 displays a longitudinal tomographic image on which a basis marker 561 indicating the basis region that formed the basis for the determination of "dissection" is superimposed.

[0196] For example, when the wall of a luminal organ at the end of an indwelling stent is thin, or when vulnerable plaque is present near the end of the stent, the control unit 21 displays the risk of "dissection" based on guidelines established by medical societies or medical facilities, etc. The control unit 21 superimposes a reason marker 561 on the area corresponding to the reason for these risks.

[0197] The basis marker 561 described using FIG. 21 is an example of basis information related to the first support information indicating the risk of "dissociation."

[0198] In addition, when the first support information is output using a learning model, the control unit 21 may extract the grounds region and display the grounds marker 561 using a model visualization method such as Grad-CAM or Grad-CAM++.

[0199] This embodiment is almost the same as the processing flow of the first embodiment described using Fig. 8, and therefore only the differences will be briefly described. In step S802, the control unit 21 inputs the transverse image 485 to the first model 71 described using Fig. 19, and obtains findings regarding the condition of the hollow organ or the surrounding area of ​​the hollow organ.

[0200] In step S812, the control unit 21 calculates the length of the stenotic portion to be treated based on the guidelines or the like.

[0201] According to this embodiment, it is possible to provide a catheter system 10 that displays various possible findings to assist the user.

[0202] The control unit 21 may display a basis marker 561 indicating the basis of the finding displayed in the finding field 53. The control unit 21 can extract a basis region related to the finding output from the first model 71 by using a model visualization method such as Grad-CAM or Grad-CAM++.

[0203] In addition to the transverse image 485, medical information acquired in real time, such as images taken using the diagnostic imaging device 37, blood pressure, heart rate, or oxygen saturation, may be input to the first model 71. In addition to the transverse image 485, medical information acquired from the electronic medical record, such as medical history, height, weight, and images taken in the past using the diagnostic imaging device 37, may be input to the first model 71.

[0204] In this case, the first model 71 receives the transverse image 485 and medical information and outputs findings related to the state of the hollow organ or the state around the hollow organ, such as whether treatment is required, whether blood flow is stagnant, whether bifurcation is present, etc. By including medical information other than the transverse image 485 in the input data of the first model 71, it is possible to provide a catheter system 10 that outputs findings with high accuracy.

[0205] [Embodiment 6] The sixth embodiment relates to a catheter system 10 that uses a set of post-treatment tomographic images 487 captured using a diagnostic imaging catheter 40 after a treatment such as stent placement. The treatment is not limited to placing an instrument inside a luminal organ. For example, if the luminal organ is a blood vessel, the treatment may be a procedure that does not involve placing an instrument, such as "balloon angioplasty," "thrombolysis," or "atherectomy." Explanation of parts common to the fifth embodiment will be omitted.

[0206] 22 is an explanatory diagram outlining the processing performed by the catheter system of embodiment 6. In this modification, the control unit 21 acquires a set of post-treatment tomographic images 487 captured using the diagnostic imaging catheter 40 after a treatment such as stent placement has been performed.

[0207] In this embodiment, a second model is used instead of the first model 71 of the fifth embodiment. When a post-treatment tomographic image 487 is input, the second model outputs second information relating to the hollow organ after treatment or the state of the hollow organ. The second model has a configuration similar to that of the first model 71 described using FIG. 19 and outputs items relating to the state after treatment.

[0208] The items shown in Table 4 above are examples of items output by the second model. The items output by the second model are not limited to the qualitative items related to the state of the placement device, such as a stent, shown in Table 4. The second model may output qualitative items such as the average inner diameter of the stent, the dimensional change in the inner diameter of the stent along the longitudinal direction of the luminal organ, or the length of the stent after placement.

[0209] The second model may output items relating to the state after any treatment, such as the state of a hollow organ after dilation surgery, etc. A second model that outputs any other items may be used.

[0210] The user inserts the catheter 40 for diagnostic imaging of the hollow organ after treatment and performs an image acquisition operation. The control unit 21 acquires a set of post-treatment tomographic images 487 from the catheter control unit 271. The control unit 21 inputs the acquired post-treatment tomographic images 487 into the second model to acquire second information regarding the condition of the hollow organ and its surroundings.

[0211] The control unit 21 selects findings with a probability higher than a predetermined threshold from the findings obtained from the second model. The control unit 21 determines whether additional treatment, such as stent re-expansion, is necessary based on the aforementioned guidelines, etc. If it is determined that additional treatment is necessary, the control unit 21 determines second support information, such as target dimensions for the additional treatment, recommended treatment, and risks, based on the aforementioned guidelines.

[0212] The control unit 21 displays the post-treatment tomographic image 487 and the determination result on the display device 31. The screen displayed by the control unit 21 is the same as the screen in the fifth embodiment described using FIGS. 20 and 21.

[0213] In this embodiment, the findings displayed by the control unit 21 in the findings column 53 are examples of second information related to the status of treatment. Similarly, the information displayed by the control unit 21 in the recommended treatment column 534, the target dimension column 529, and the risk column 535 are examples of second support information that supports diagnosis or treatment.

[0214] The method for determining the second support information in this embodiment is the same as the method for determining the first support information in the fifth embodiment, and therefore detailed description thereof will be omitted.

[0215] According to this embodiment, by using a second model that is specifically trained on items related to the condition of the tubular organ and its surroundings after treatment, a catheter system 10 can be provided that outputs highly accurate information regarding the condition after treatment.

[0216] In addition to the post-treatment tomographic image 487, medical information acquired in real time, such as images taken using the diagnostic imaging device 37, blood pressure, heart rate, or oxygen saturation, may be input to the second model. In addition to the post-treatment tomographic image 487, medical information acquired from the electronic medical record, such as medical history, height, weight, and images taken in the past using the diagnostic imaging device 37, may be input to the second model.

[0217] In this case, the second model receives the post-treatment tomographic image 487 and medical information, and outputs second information related to the state of the treatment. By including medical information other than the post-treatment tomographic image 487 in the input data of the second model, it is possible to provide a catheter system 10 that outputs highly accurate second information and second support information.

[0218] [Embodiment 7] This embodiment relates to a catheter system 10 that outputs third support information for supporting diagnosis or treatment based on first information on the state of a hollow organ or the state of the periphery of the hollow organ before treatment and second information on the state of the hollow organ or the state of the periphery of the hollow organ after treatment. Explanation of parts common to the first embodiment will be omitted.

[0219] FIG. 23 is an explanatory diagram illustrating an outline of the processing performed by the catheter system 10 according to the seventh embodiment.

[0220] The user inserts the diagnostic imaging catheter 40 into the hollow organ before treatment and performs an image acquisition operation. The control unit 21 acquires a set of transverse cross-sectional images 485 from the catheter control unit 271. The control unit 21 temporarily stores the acquired transverse cross-sectional images 485 in the auxiliary storage device 23 or the main storage device 22.

[0221] The user inserts the diagnostic imaging catheter 40 into the hollow organ after treatment and performs an image acquisition operation. The control unit 21 acquires a set of post-treatment tomographic images 487 from the catheter control unit 271. The control unit 21 temporarily stores the acquired post-treatment tomographic images 487 in the auxiliary storage device 23 or the main storage device 22.

[0222] The control unit 21 acquires first information on the state of the hollow organ or the surrounding area of ​​the hollow organ, such as whether treatment is necessary or not, whether blood flow is stagnant, etc., based on the acquired transverse image 485. For example, the control unit 21 inputs the transverse image 485 into the first model 71 described using Fig. 5, Fig. 13, or Fig. 19 to acquire the first information.

[0223] The control unit 21 acquires second information regarding the state of the hollow organ and its surroundings after the treatment, such as the state of a stent, based on the acquired post-treatment tomographic image 487. For example, the control unit 21 acquires the second information by inputting the post-treatment tomographic image 487 into the second model described in the sixth embodiment. The control unit 21 may also acquire the second information by inputting the post-treatment tomographic image 487 into the first model 71 described using FIG. 13 or 19.

[0224] The control unit 21 acquires third support information including whether additional treatment is necessary and, if additional treatment is necessary, a recommended treatment method and its risks, based on the first information, the second information, and guidelines established by medical societies or medical facilities, etc. The third support information includes, for example, information on the status of the treatment such as "stent abnormality (malapposition)," information on recommended additional treatment, information on risks, etc. The third support information may also include, for example, information on recommended medication or dietary therapy, etc.

[0225] 24 is an example of a screen displayed by the catheter system 10 of embodiment 7. The screen shown in FIG. 24 includes a pre-treatment longitudinal tomographic image field 521, a post-treatment longitudinal tomographic image field 522, a findings field 53, a current dimension field 528, a target dimension field 529, a recommended treatment field 534, and a risk field 535.

[0226] The pre-treatment longitudinal tomographic image field 521 displays a longitudinal tomographic image taken before IVR using the diagnostic imaging catheter 40. The post-treatment longitudinal tomographic image field 522 displays a longitudinal tomographic image taken after IVR using the diagnostic imaging catheter 40.

[0227] 24, longitudinal tomographic images before and after stent placement are displayed in a pre-treatment longitudinal tomographic image field 521 and a post-treatment longitudinal tomographic image field 522. The pre-treatment longitudinal tomographic image field 521 displays a longitudinal tomographic image including the stent after placement. The stents are indicated by multiple black circles.

[0228] Based on the first information based on the transverse cross-sectional image 485 and the second information based on the post-treatment tomographic image 487, the control unit 21 displays findings regarding the post-treatment condition in the findings field 53 and the post-treatment dimensions in the current dimension field 528. Similarly, the control unit 21 displays recommended additional treatments in the recommended treatment field 534 and the target dimensions for the additional treatment in the target dimension field 529.

[0229] The control unit 21 displays the risk of the additional action in the risk column 535. Note that the control unit 21 may also display in the risk column 535 the risk associated with not taking the additional action displayed in the recommended action column 534.

[0230] As a result of the above, the control unit 21 displays the third support information in the findings column 53, the current dimension column 528, the target dimension column 529, the recommended action column 534, and the risk column 535. Note that the control unit 21 may display the second information acquired from the second model in some or all of the findings column 53, the current dimension column 528, the target dimension column 529, the recommended action column 534, and the risk column 535. The control unit 21 may display the first information acquired from the first model in some of the findings column 53, the current dimension column 528, the target dimension column 529, the recommended action column 534, and the risk column 535.

[0231] In Figure 24, the finding is "malposition," meaning that the placed stent is not properly in contact with the inner wall of the luminal organ. A procedure to re-expand the stent from the inside by "balloon dilation" is recommended.

[0232] The user may operate a button (not shown) to display cross-sectional images before and after the treatment. The user can observe the cross-sectional images before and after the treatment and determine the treatment to be actually performed.

[0233] 25 is a flowchart illustrating the processing flow of the program according to the seventh embodiment. The control unit 21 acquires a set of cross-sectional images 485 from the auxiliary storage device 23 (step S881). The control unit 21 inputs the acquired cross-sectional images 485 into the first model 71 to acquire first information (step S882).

[0234] The control unit 21 acquires one set of post-treatment tomographic images 487 from the catheter control unit 271 or the auxiliary storage device 23 (step S883). The control unit 21 acquires second information based on the post-treatment tomographic images 487 (step S884).

[0235] The control unit 21 determines whether additional treatment is necessary (step S885). For example, if the second information includes information regarding stent abnormality, the control unit 21 determines that additional treatment is necessary. For example, if the treatment is intended to relieve stenosis, the control unit 21 compares the degree of stenosis before and after the treatment, and determines that additional treatment is unnecessary if the target level of improvement has been achieved.

[0236] The control unit 21 may determine whether additional treatment is necessary based on guidelines, etc. established by medical societies or medical facilities, etc. The control unit 21 may determine whether additional treatment is necessary based on a learning model that receives input of the first information and the second information and outputs whether additional treatment is necessary.

[0237] If it is determined that additional treatment is not required (NO in step S885), the control unit 21 displays that additional treatment is not required in the recommended treatment column 534 of the screen described using Fig. 24 (step S886). Thereafter, the control unit 21 ends the processing.

[0238] If it is determined that additional treatment is required (YES in step S885), the control unit 21 automatically acquires a recommended additional treatment method based on the aforementioned guidelines, etc. (step S891). The control unit 21 acquires the risks of additional treatment and the risks of not performing additional treatment based on the aforementioned guidelines, etc. (step S892).

[0239] The control unit 21 displays on the display device 31 the fact that additional treatment is necessary, the recommended additional treatment, and the risks using the screen described using Fig. 24 (step S893). Thereafter, the control unit 21 ends the process.

[0240] According to this embodiment, by combining information on the state of the hollow organ and its surroundings before and after treatment, a catheter system 10 can be provided that outputs highly accurate information on the state of treatment and the need for additional treatment.

[0241] [Embodiment 8] This embodiment relates to a catheter system 10 that displays the position of a tomographic image captured using a diagnostic imaging catheter 40 superimposed on an image acquired from a diagnostic imaging device 37. Explanation of parts common to the fourth embodiment will be omitted.

[0242] 26 is an example of a screen displayed by the catheter system 10 of the eighth embodiment. The screen shown in FIG. 26 includes a findings field 53 and an other device image field 59. The findings field 53 displays findings included in the first support information described above. In addition to the findings field 53, the control unit 21 may also display, for example, a recommended procedure field 534, a target dimension field 529, and a risk field 535.

[0243] The other device image field 59 displays medical images captured by the diagnostic imaging device 37. A scan area 591 indicating the position of the tomographic image captured by the diagnostic imaging catheter 40 is displayed superimposed on the other device image field 59 as a rectangle indicating the outline of the longitudinal tomographic image.

[0244] An outline of a method for displaying the scan area 591 will be described below using an example in which the diagnostic imaging device 37 is an X-ray angiography device. The sensor 42 is mounted on a sensor marker that is opaque to X-rays. Since the tip marker 44 and the sensor marker are opaque to X-rays, they are clearly displayed in the medical image captured by the X-ray angiography device.

[0245] The control unit 21 detects the tip marker 44 and the sensor marker from the medical image. The detected sensor marker indicates the position of the sensor 42. For example, when a set of transverse images 485 is generated using a pullback operation by the MDU 33, both ends of the operating range of the sensor 42 when acquiring the images correspond to the positions of the short sides of the scan area 591.

[0246] The control unit 21 determines the length of the short side of the scan area 591 based on the display range of the transverse cross-sectional image 485 and the scale of the other device image. The control unit 21 superimposes and displays the rectangular scan area 591 determined from the position and length of the short side on the other device image field 59 that displays the medical image.

[0247] By the above processing, even if the tip of the diagnostic imaging catheter 40 is not parallel to the projection surface of the diagnostic imaging device 37, the control unit 21 can display the scan area 591 at the correct position in the other device image field 59.

[0248] Returning to FIG. 26, the explanation will be continued. A plurality of transverse plane position markers 551 are displayed within a scan area 591. A transverse object arrangement image field 515 displaying a transverse object arrangement image 483 corresponding to each transverse plane position marker 551 is displayed around the other device image field 59. The user can appropriately change the cross-sectional position of the transverse object arrangement image 483 by moving the transverse plane position marker 551 via the input device 32. The control unit 21 may also accept voice input from the user.

[0249] That is, in FIG. 26, the control unit 21 displays the horizontal object arrangement image 483, which is the first information described using FIG. 12, on a medical image different from the tomographic image captured using the diagnostic imaging catheter 40.

[0250] The other device image field 59 may display a schema that schematically represents a hollow organ instead of a medical image captured by the diagnostic imaging device 37. In this case, the control unit 21 displays the horizontal object arrangement image 483, which is the first information of the fourth embodiment described with reference to FIG. 12, on the schema.

[0251] Fig. 27 is an example of a screen displayed by the catheter system 10 of embodiment 8. In the screen shown in Fig. 27, a transverse layer image field 51 is displayed instead of the transverse object arrangement image field 515 in Fig. 26. In the transverse layer image field 51, a transverse layer image 485 acquired from the catheter control unit 271 is displayed.

[0252] The control unit 21 displays first information regarding the "treatment target" portion and the "non-treatment target" portion described with reference to Fig. 4 inside the scan area 591. In Fig. 27, the hatched portion in the center of the scan area 591 indicates the "treatment target."

[0253] The control unit 21 may display in real time a longitudinal tomographic image or a longitudinal object arrangement image inside the scan area 591. The control unit 21 may receive a selection regarding the display format of the scan area 591 from the user.

[0254] The control unit 21 may switch between displaying the horizontal object arrangement image 483 and the transverse cross-sectional image 485 based on an instruction from the user. The control unit 21 may display the horizontal object arrangement image 483 and the transverse cross-sectional image 485 side by side. The control unit 21 may display the longitudinal cross-sectional image or the vertical object arrangement image.

[0255] The control unit 21 may display the horizontal object arrangement image 483 generated based on the post-treatment tomographic image 487 in the horizontal object arrangement image field 515. The control unit 21 may display findings based on the post-treatment tomographic image 487 in the findings field 53.

[0256] The horizontal object arrangement image 483 based on the post-treatment tomographic image 487 is an example of the second information described using Fig. 22. The findings based on the post-treatment tomographic image 487 are an example of the second support information described using Fig. 22. The control unit 21 may display the above-mentioned third support information in the findings column.

[0257] For example, the control unit 21 may accept a tap operation by the user and switch between displaying the horizontal object arrangement image 483 based on the transverse cross-sectional image 485 and the horizontal object arrangement image 483 based on the post-treatment tomographic image 487. The control unit 21 may display the horizontal object arrangement image 483 based on the transverse cross-sectional image 485 and the horizontal object arrangement image 483 based on the post-treatment tomographic image 487 side by side.

[0258] 28 is a flowchart illustrating the processing flow of the program according to embodiment 8. During one image acquisition operation, control unit 21 acquires a transverse image 485 and a medical image from catheter control unit 271 and diagnostic imaging device 37, respectively (step S751). Note that the image acquired by control unit 21 in step S751 may be a post-treatment tomographic image 487.

[0259] The control unit 21 detects the tip marker 44 and the sensor marker from the medical image (step S752). For example, when a set of transverse slice images 485 is generated using a pullback operation by the MDU 33, the control unit 21 determines the position and dimensions of the scan area 591 based on the positions of the sensor markers detected at both ends of the pullback operation. The control unit 21 determines the position of the transverse slice position marker 551 based on the scan area 591 (step S753).

[0260] It is desirable that the control unit 21 traces and displays the position corresponding to the scan area 591 on a medical image captured thereafter in real time.

[0261] The control unit 21 inputs the cross-sectional image 485 acquired in step S751 into the first model 71, and acquires a cross-sectional object arrangement image 483 that associates the types of multiple objects included in the cross-sectional image 485 with the range of each object, and the probability that the object determination for each pixel is correct (step S754).

[0262] The control unit 21 generates a vertical object arrangement image based on one set of horizontal object arrangement images 483 (step S755). The control unit 21 records the generated vertical object arrangement image in the auxiliary storage device 23 in response to the user's operation of the vertical section position marker 552 so that the vertical object arrangement image for the specified cross section can be quickly displayed.

[0263] The control unit 21 displays the screen described with reference to Fig. 26 or 27 on the display device 31 (step S756), and then the control unit 21 ends the process.

[0264] According to this embodiment, it is possible to provide a catheter system 10 that superimposes and displays the position of a tomographic image captured using the diagnostic imaging catheter 40 or a transverse object arrangement image 483 generated based on the tomographic image on a medical image captured by the diagnostic imaging device 37. The user can easily change the position of the transverse image 485 to be displayed by operating the transverse layer position marker 551. As described above, it is possible to provide a catheter system 10 that allows the user to easily grasp the positional relationship between the tomographic image and the surrounding organs.

[0265] The diagnostic imaging device 37 is not limited to an X-ray angiography device. For example, an ultrasound diagnostic device combined with an external probe or a TEE (Transesophageal Echocardiography) probe can also capture cross-sectional images different from those captured by the diagnostic imaging catheter 40 in real time.

[0266] When the diagnostic imaging catheter 40 is equipped with both an ultrasonic sensor 42 and an OCT sensor 42, a transverse cross-sectional image 485 using ultrasonic waves and a transverse cross-sectional image 485 using OCT can be captured at approximately the same cross section.

[0267] The catheter system 10 may not display the horizontal object arrangement image 483 and the vertical object arrangement image 484, but may display the transverse image 485 and the longitudinal image acquired from the catheter control unit 271. In this case, the control unit 21 does not need to execute steps S754 and S755.

[0268] Instead of step S754 and step S755, the control unit 21 may input the transverse cross-sectional image 485 acquired in step S571 into the first model 71 described with reference to Fig. 5 or 19 to acquire the first information. The control unit 21 displays the first information or the second information acquired based on the first information together with the medical image captured by the image diagnostic device 37.

[0269] Before or after step S754 and step S755, the control unit 21 may input the transverse image 485 acquired in step S571 into the first model 71 described using Fig. 5 or 19 to acquire first information. The control unit 21 displays the first information or second information acquired based on the first information together with the medical image captured by the image diagnostic device 37, the horizontal object arrangement image 483, and the vertical object arrangement image 484.

[0270] The control unit 21 may superimpose a transverse object arrangement image 483 obtained from a transverse cross-sectional image 485 obtained by OCT, which has excellent resolution, on a transverse cross-sectional image 485 obtained by ultrasound, which has a greater penetration depth than OCT. Additionally, the control unit 21 may appropriately combine and display the transverse cross-sectional image 485 obtained by OCT and the transverse object arrangement image 483, or the transverse cross-sectional image 485 obtained by ultrasound and the transverse object arrangement image 483. A catheter system 10 can be provided that displays information that makes the most of the advantages of both.

[0271] The medical image is not limited to a medical image captured in real time. The control unit 21 may superimpose the scan area 591 on a medical image captured by any imaging diagnostic device, such as a CT, MRI, PET, X-ray angiography device, or ultrasound diagnostic device, and recorded in an electronic medical record, etc. The control unit 21 determines the position of the scan area 591 based on the branching of blood vessels, the position of the heart, etc. included in each image.

[0272] The processing of this embodiment may be executed on the side of the diagnostic imaging device 37 and displayed on a display device connected to the diagnostic imaging device 37 .

[0273] [Embodiment 9] This embodiment relates to a program for generating the first model 71 of the first embodiment described using Fig. 5. Explanation of parts common to the first embodiment will be omitted.

[0274] 29 is an explanatory diagram illustrating the record layout of a training data database. The training data database is a database that records inputs and correct labels in association with each other, and is used for training a model using machine learning. The training data database has a tomographic image data field and a determination result field.

[0275] The tomographic image data field records a set of transverse images 485 captured by a single image acquisition operation. The judgment result field displays the result of an expert's judgment on the necessity of treatment for the hollow organ or the surrounding area of ​​the hollow organ corresponding to each transverse image 485. For example, in the training data shown in the top row of Figure 29, treatment for the hollow organ or the surrounding area of ​​the hollow organ corresponding to the tomographic images No. 1 and No. 2 is not necessary, but treatment for the hollow organ or the surrounding area of ​​the hollow organ corresponding to the tomographic images No. 3 and No. 4 is necessary.

[0276] The "need for treatment" may refer to the need for IVR, which performs treatment inside a hollow organ, or the need for general treatment, including medication and dietary therapy.

[0277] The training data DB stores a large number of combinations of sets of cross-sectional images 485 taken using the diagnostic imaging catheter 40 and the results of a specialist doctor's or other doctor's judgment as to whether or not treatment is necessary.

[0278] 30 is a flowchart illustrating the flow of processing of the program according to the embodiment 9. An example will be described in which machine learning of the first model 71 is performed using the information processing device 20.

[0279] 30 may be executed on hardware separate from the information processing device 20, and the first model 71 after machine learning may be copied to the auxiliary storage device 23 via a network. The first model 71 trained on one piece of hardware may be used by multiple information processing devices 20.

[0280] Prior to executing the program of Figure 30, an untrained model is prepared, which includes, for example, a neural network 719 having a convolutional layer, a pooling layer, and a fully connected layer, multiple softmax layers 711 connected in parallel to the neural network 719, and one selection layer 712 connected to each softmax layer 711.

[0281] The untrained model may be any type of model, such as a decision tree or a random forest, etc. The program in Fig. 30 adjusts each parameter of the prepared model to perform machine learning.

[0282] The control unit 21 acquires training records to be used for training one epoch from the training data DB (step S621). The number of training records to be used for training one epoch is a so-called hyperparameter, and is determined appropriately.

[0283] The control unit 21 generates an input image from the input data included in each acquired training record (step S622). Specifically, the control unit 21 generates a single image by combining the transverse images 485 included in the tomographic image field in the scanning order. The combined transverse images may be recorded in the tomographic image data field.

[0284] The control unit 21 adjusts the parameters of the model so that when an input image is input to the input layer of the model, a correct label is output from the output layer (step S623).

[0285] The control unit 21 determines whether to end the process (step S624). For example, the control unit 21 determines to end the process when learning for a predetermined number of epochs has been completed. The control unit 21 may acquire test data from the training data DB, input it to the model under machine learning, and determine to end the process when an output with a predetermined accuracy is obtained.

[0286] If it is determined not to end the process (NO in step S624), control unit 21 returns to step S621. If it is determined to end the process (YES in step S624), control unit 21 records the parameters of the trained model in auxiliary storage device 23 (step S625). Thereafter, control unit 21 ends the process. Through the above process, a trained first model 71 is generated.

[0287] [Variation 1] A brief description will be given below of an example in which the first model 71 of the fourth embodiment, which was explained using Fig. 13, is generated. When the first model 71 of the fourth embodiment is generated, a training data DB is used in which a set of cross-sectional images 485 taken by the diagnostic imaging catheter 40 and a set of images in which an expert has painted each of the cross-sectional images 485 with a different color or background pattern for each object are recorded in association with each other.

[0288] Prior to executing the program for generating the first model 71, an untrained model, such as a U-Net structure for realizing semantic segmentation, is prepared. As described above, the U-Net structure is composed of multiple encoder layers followed by multiple decoder layers. The program in FIG. 30 adjusts the parameters of the prepared model and performs machine learning.

[0289] After step S622 is completed, control unit 21 generates a single correct image by combining the set of colored images in the scanning order using the same method as in step S622. In step S623, control unit 21 adjusts the parameters of the model so that when an input image is input to the input layer of the model, a correct image is output from the output layer.

[0290] Through the above processing, the control unit 21 generates the first model 71 of the fourth embodiment described with reference to FIG.

[0291] [Variation 2] A brief description will be given below of an example in which the first model 71 of the fifth embodiment, which has been explained using Fig. 19, is generated. When the first model 71 of the fifth embodiment is generated, a training data DB is used in which a set of transverse cross-sectional images 485 taken by the diagnostic imaging catheter 40 is recorded in association with findings on the state of a hollow organ or the state around the hollow organ as determined by an expert.

[0292] Prior to execution of the program for generating the first model 71, an untrained model such as a CNN having a neural network 719 including a convolutional layer, a pooling layer, and a fully connected layer, and a softmax layer 711, is prepared. The untrained model is not limited to a CNN. Any type of model, such as a decision tree or a random forest, can be used.

[0293] In step S623, the control unit 21 adjusts the parameters of the model so that when an input image is input to the input layer of the model, each corresponding finding is output from the output layer.

[0294] Through the above processing, the control unit 21 generates the first model 71 of the fifth embodiment described with reference to FIG.

[0295] [Variation 3] A brief description will be given below of an example in which the second model described in the sixth embodiment is generated. When the second model of the fifth embodiment is generated, a training data DB is used in which a set of post-treatment tomographic images 487 captured by the diagnostic imaging catheter 40 is associated with the state of the hollow organ after treatment as determined by an expert, or findings on the state of the hollow organ and its surroundings. The process of generating the second model 72 is the same as that of the second modification, and therefore will not be described here.

[0296] According to this embodiment, various first models 71 and second models can be generated by machine learning.

[0297] [Embodiment 10] This embodiment relates to a catheter system 10 that allows the user to modify the necessity of treatment output by the first model 71. Explanation of parts common to the first embodiment will be omitted.

[0298] 31 is an explanatory diagram illustrating the record layout of the correction DB. The correction DB is a database that records correction information that associates the lateral object arrangement image 483 and recommended treatment output by the catheter system 10 with corrections made by the user.

[0299] The correction DB has a tomographic image data field, an output data field, and an input data field. The output data field and the correction data field each have a treatment necessity field and a recommended treatment field.

[0300] The tomographic image data field records a set of transverse images 485 captured during one image acquisition operation. The treatment necessity field of the output data field records whether treatment is necessary for the hollow organ or the surrounding area of ​​the hollow organ corresponding to each transverse image 485 output by the control unit 21 to the schematic diagram field 524. The recommended treatment field of the output data field records the recommended treatment output by the control unit 21 to the recommended treatment field 534.

[0301] The treatment necessity field of the correction data field records whether or not treatment is necessary for the luminal organ or the surrounding area of ​​the luminal organ corresponding to each cross-sectional image 485 corrected by the user. The recommended treatment field of the correction data field records the recommended treatment corrected by the user. "No correction" in the correction data field indicates that no correction instructions have been accepted from the user. The correction DB has one record for each correction made by the user to a set of cross-sectional images 485.

[0302] 31 is an example. The modified database has a record layout corresponding to the first model 71 and display items to be used.

[0303] 32 to 38 are examples of screens displayed by the catheter system 10 of embodiment 8. Fig. 32 is a screen that the control unit 21 displays on the display device 31 when the user instructs correction of the schematic diagram field 524 while the screen described using Fig. 6 is being displayed.

[0304] The screen shown in Fig. 32 includes a longitudinal tomographic image field 52, a transverse tomographic image field 51, a schematic diagram field 524, an end button 589, and a stop button 586. The transverse tomographic image field 51 and the longitudinal tomographic image field 52 respectively display the transverse tomographic image 485 and the longitudinal tomographic image generated by the catheter control unit 271. The schematic diagram field 524 displays the schematic diagram of the first embodiment described using Fig. 6.

[0305] The user can appropriately change the cross sections displayed in the longitudinal tomographic image field 52 and the transverse tomographic image field 51 by operating the input device 32 to change the positions of the transverse tomographic position marker 551 and the longitudinal tomographic position marker 552. The user observes the longitudinal tomographic image field 52 and the transverse tomographic image field 51 to determine the boundary between the "non-treatment target" portion and the "treatment target" portion.

[0306] The user operates cursor 575 to appropriately change the boundary line between the "non-treatment target" portion and the "treatment target" portion. When the user selects end button 589, controller 21 determines whether each transverse image 485 is classified as "non-treatment target" or "treatment target" based on the new boundary line defined by the user.

[0307] Fig. 33 shows a screen that the control unit 21 displays on the display device 31 when the user instructs correction of the recommended action field 534 while the screen described using Fig. 6 is displayed. In the screen shown in Fig. 33, a pull-down menu is displayed in the recommended action field 534 from which the type of recommended action can be selected. The user selects the action that they deem appropriate.

[0308] When control unit 21 accepts the user's selection of end button 589, it records the correction content entered by the user using the screens of Figures 32 and 33 in the correction field of the correction DB described using Figure 33. Control unit 21 may also accept correction instructions for current dimension column 528, target dimension column 529, and risk column 535, and record them in the correction DB.

[0309] As described above, the control unit 21 accepts instructions to correct the first information and first support information of the first embodiment described using FIG. 4 via the screen described using FIG. 32.

[0310] Fig. 34 is a screen that the control unit 21 displays on the display device 31 when the user instructs to modify the vertical object arrangement field 525 while the screen described using Fig. 14 is being displayed. The following description will be given by way of example of a case in which the control unit 21 receives an instruction to change an object indicated by an oval filled in black.

[0311] The screen shown in FIG. 34 includes a vertical object arrangement field 525, a cross-sectional image field 51, a current dimension field 528, a target dimension field 529, a recommended action field 534, and a risk field 535, as well as an end button 589 and a stop button 586.

[0312] A pull-down menu showing the classification items of the object is displayed near the object instructed to be changed by the user. The user specifies the correct classification of the object from the pull-down menu by operating the input device 32. The control unit 21 displays the specified object in a color or background pattern corresponding to the object specified by the user.

[0313] The correction of the recommended treatment column 534 etc. is the same as the operation explained using Fig. 33, and therefore the explanation will be omitted. When the selection of the end button 589 is accepted, the control unit 21 associates the transverse cross-sectional image 485, the post-treatment tomographic image 487 before the change, the post-treatment tomographic image 487 after the change, etc., and records them in the correction DB.

[0314] As described above, the control unit 21 accepts instructions to correct the first information and first support information of the fourth embodiment described using FIG. 14 via the screen described using FIG. 34.

[0315] Figure 35 shows a screen that the control unit 21 displays on the display device 31 when the user instructs correction of the findings field 53 while the screen described using Figure 20 is being displayed. In the screen shown in Figure 35, a pull-down menu from which findings can be selected is displayed in the findings field 53. The user selects a finding that they deem appropriate.

[0316] When the control unit 21 receives the user's selection of the end button 589, the control unit 21 records the cross-sectional image 485, the findings before the change, and the findings after the change in the correction DB in association with each other. The control unit 21 may also receive correction instructions for the current dimension column 528, the target dimension column 529, and the risk column 535.

[0317] As described above, the control unit 21 accepts an instruction to correct the first support information in the fifth embodiment described with reference to FIG. 20 via the screen described with reference to FIG.

[0318] As described in the sixth embodiment, the image described using Fig. 20 may display second support information based on the post-treatment tomographic image 487. The control unit 21 receives an instruction to correct the second support information of the sixth embodiment using Fig. 35 via the screen described using Fig. 34.

[0319] Figure 36 shows a screen that the control unit 21 displays on the display device 31 when the user instructs correction of the findings field 53 while the screen described using Figure 24 is being displayed. In the screen shown in Figure 35, a pull-down menu from which findings can be selected is displayed in the findings field 53. The user selects a finding that they deem appropriate.

[0320] When the control unit 21 receives the user's selection of the end button 589, the control unit 21 records the cross-sectional image 485, the findings before the change, and the findings after the change in the correction DB in association with each other. The control unit 21 may also receive correction instructions for the current dimension column 528, the target dimension column 529, and the risk column 535.

[0321] As described above, the control unit 21 accepts an instruction to correct the third support information in the seventh embodiment described with reference to FIG. 20 via the screen described with reference to FIG.

[0322] Figure 37 is a screen that the control unit 21 displays on the display device 31 when the user instructs correction of the findings field 53 while the screen described using Figure 27 is being displayed. In the screen shown in Figure 37, a pull-down menu from which findings can be selected is displayed in the findings field 53. The user selects a finding that they deem appropriate.

[0323] When the control unit 21 accepts the user's selection of the end button 589, the control unit 21 associates the transverse image 485, the findings before the change, and the findings after the change, and records them in the correction DB. As described above, the control unit 21 accepts an instruction to correct the first support information, the second support information, or the third support information via the screen described using Fig. 37.

[0324] 38 shows a screen that the control unit 21 displays on the display device 31 when an instruction to modify the guidelines, etc. used when defining the first support information, second support information, or third support information is received. A list of the guidelines, etc. to be used is displayed. The user can select the desired guideline, etc.

[0325] The control unit 21 may also receive instructions to correct individual items, such as the calculation formula for the stenosis rate, etc. The control unit 21 automatically corrects the decision tree or program corresponding to the guideline, etc., based on the instructions to correct.

[0326] [Embodiment 11] Figure 39 is a functional block diagram of a catheter system 10 according to an eleventh embodiment. The catheter system 10 includes a tomographic image acquisition unit 85, a first information acquisition unit 81, and an output unit 87. The tomographic image acquisition unit 85 acquires multiple tomographic images generated along the blood vessel using a diagnostic imaging catheter inserted into the blood vessel. The first information acquisition unit 81 acquires first information on the state of the blood vessel based on the tomographic images acquired by the tomographic image acquisition unit 85. The output unit 87 outputs first support information for assisting diagnosis or treatment based on the first information acquired by the first information acquisition unit 81.

[0327] [Embodiment 12] This embodiment relates to a form in which an information processing device 20 of this embodiment is realized by operating a general-purpose computer 90 in combination with a program 97. Fig. 40 is an explanatory diagram showing the configuration of the information processing device 20 of embodiment 12. Explanation of parts common to embodiment 3 will be omitted.

[0328] The catheter system 10 of this embodiment includes a computer 90. The computer 90 is equipped with a control unit 21, a main memory device 22, an auxiliary memory device 23, a communication unit 24, a display unit 25, an input unit 26, a reading unit 29, and a bus. The computer 90 is an information device such as a general-purpose personal computer, a tablet, a smartphone, or a server computer.

[0329] The program 97 is recorded on a portable recording medium 96. The control unit 21 reads the program 97 via the reading unit 29 and stores it in the auxiliary storage device 23. The control unit 21 may also read the program 97 stored in a semiconductor memory 98, such as a flash memory, implemented in the computer 90. Furthermore, the control unit 21 may download the program 97 from another server computer (not shown) connected via the communication unit 24 and a network (not shown) and store it in the auxiliary storage device 23.

[0330] The program 97 is installed as a control program for the computer 90, and is loaded into and executed by the main storage device 22. This causes the computer 90 to function as the information processing device 20 described above.

[0331] The technical features (constituent elements) described in each embodiment can be combined with each other, and by combining them, new technical features can be formed. The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0332] 10 Catheter System 20 Information processing equipment 21 Control section 22 Main storage 23 Auxiliary storage device 24 Communications Department 25 Display section 26 Input section 27 Catheter control device 271 Catheter control unit 29 Reading unit 31 Display device 32 Input Devices 33 MDU 37 Diagnostic imaging equipment 40 Diagnostic imaging catheter 41 Probe section 42 sensors 43 Shaft 44 Tip Marker 45 Connector part 483 Horizontal Object Arrangement 484 Vertical Object Arrangement 485 Cross-sectional image (tomogram) 487 Post-treatment tomography 51 Cross section image column 515 Horizontal Object Arrangement Image Column 516 Reason column 52 Longitudinal tomography column 523 Target shape field 524 Schematic diagram column 525 Vertical object placement column 528 Current dimensions column 529 Target dimensions column 53 Findings column 534 Recommended Actions 535 Risk column 551 Cross-Section Marker 552 Longitudinal fault position marker 561 Grounds Marker 575 cursor 576 Closed Curve 585 Item selection column 586 Cancel button 588 Start button 589 Exit button 59 Other device image column 591 Scan Area 71 1st model 711 Softmax Layer 712 Selection Layer 719 Neural Networks 85 Tomographic image acquisition unit 81 1st Information Acquisition Department 87 Output section 90 Computer 96 Portable recording media 97 Programs 98 Semiconductor Memory

Claims

1. acquiring a plurality of tomographic images generated along the hollow organ using an imaging diagnostic catheter inserted into the hollow organ; acquiring first information on the state of the hollow organ or the state of the periphery of the hollow organ based on the acquired tomographic image; outputting first support information for supporting diagnosis or treatment based on the acquired first information; the first support information includes a current schematic diagram showing the shape of the hollow organ or the surrounding area of ​​the hollow organ by color-coding a treatment target area determined to require treatment and a non-treatment target area determined not to require treatment, a schematic diagram obtained by modifying the schematic diagram based on a treatment goal, a recommended treatment, and specifications of equipment to be used for the treatment; The first support information is displayed on one screen. A program that causes a computer to perform a process.

2. The first support information further includes risk information regarding the treatment. The program according to claim 1.

3. Acquire inventory information of equipment held by a medical institution, The first support information includes information about equipment recommended for the treatment selected based on the acquired inventory information and the specifications. The program according to claim 1.

4. The therapeutic device for appropriately performing the treatment is an intraluminal indwelling device, a luminal diameter expanding device, an energy treatment device, or a drug dispersion device; The first support information further includes information regarding a treatment method using the treatment device. The program according to any one of claims 1 to 3.

5. The first information is a change in state of the hollow organ or the periphery of the hollow organ along the longitudinal direction of the hollow organ. The program according to any one of claims 1 to 4.

6. displaying longitudinal tomographic images of the hollow organ and its surroundings generated based on the acquired tomographic images; and accepting input of the first information based on the displayed longitudinal tomographic image.

6. The program according to claim 1.

7. The first information is output from a first model that outputs first information about the state of the hollow organ or the state around the hollow organ when a tomographic image is input to the first model, by inputting the acquired tomographic image to the first model. The program according to any one of claims 1 to 6.

8. The first model outputs the first information when medical information different from the acquired tomographic image is further input. The program according to claim 7.

9. Displaying the first information; Accepting corrections to the first information The program according to claim 7 or 8.

10. Correction information associating the tomographic image with the correction is recorded. The program according to claim 9.

11. Re-learning the first model based on the correction information. The program according to claim 10.

12. outputting first basis information relating to the basis of the first support information together with the first support information; 12. The program according to claim 1.

13. The first support information further includes validity information indicating validity of the information.

13. The program according to any one of claims 1 to 12.

14. The validity information includes information regarding the accuracy of the information. The program according to claim 13.

15. Accepting corrections to the first support information 15. The program according to any one of claims 1 to 14.

16. and accepting a modification of a method for determining the first support information based on the first information.

16. The program according to any one of claims 1 to 15.

17. the tomographic image is a post-treatment tomographic image generated using an imaging diagnostic catheter inserted into a hollow organ after treatment has been performed on the hollow organ, The first information is information regarding the status of the treatment.

17. The program according to any one of claims 1 to 16.

18. After performing a treatment on a hollow organ, a post-treatment tomographic image is obtained using an imaging diagnostic catheter inserted into the hollow organ; acquiring second information regarding the state of the treatment based on the acquired post-treatment tomographic image; and outputting second support information for supporting diagnosis or treatment based on the acquired second information.

18. The program according to any one of claims 1 to 17.

19. displaying a post-treatment longitudinal tomographic image of the hollow organ and the periphery of the hollow organ, which is generated based on the acquired post-treatment tomographic image; and accepting input of the second information based on the displayed post-treatment longitudinal tomographic image.

19. The program of claim 18.

20. The second information is output from a second model that outputs second information regarding the state of treatment when the post-treatment tomographic image is input by inputting the acquired post-treatment tomographic image into the second model.

19. The program of claim 18.

21. The second model outputs the second information when medical information different from the acquired post-treatment tomographic image is further input. The program according to claim 20.

22. Displaying the second information; Accepting corrections to the second information 22. The program according to claim 20 or 21.

23. and recording second correction information that associates the post-treatment tomographic image with the correction.

23. The program of claim 22.

24. Re-learning the second model based on the second correction information.

24. The program of claim 23.

25. and outputting, together with the second support information, basis information regarding the basis of the second support information.

25. The program according to any one of claims 18 to 24.

26. The second support information is superimposed on a medical image or a schema different from the acquired post-treatment tomographic image.

26. The program according to any one of claims 18 to 25.

27. and accepting a modification of a method for determining the second support information based on the second information.

27. The program according to any one of claims 18 to 26.

28. and outputting third support information for supporting diagnosis or treatment based on the first information and the second information.

28. A program according to any one of claims 18 to 27.

29. The third support information is superimposed and displayed on a medical image or a schema different from the acquired post-treatment tomographic image.

29. The program of claim 28.

30. and accepting a modification of a method for determining the third support information based on the first information and the second information.

30. A program according to claim 28 or claim 29.

31. the hollow organ is a blood vessel, The procedure is placement of an intravascular device.

29. The program according to any one of claims 18 to 28.

32. the intravascular device is a stent, The second information is a dimensional change of the inner diameter of the stent along the longitudinal direction of the blood vessel.

32. The program of claim 31.

33. acquiring a plurality of tomographic images generated along the hollow organ using an imaging diagnostic catheter inserted into the hollow organ; acquiring first information on the state of the hollow organ or the state of the periphery of the hollow organ based on the acquired tomographic image; outputting first support information for supporting diagnosis or treatment based on the acquired first information; the first support information includes a current schematic diagram showing the shape of the hollow organ or the surrounding area of ​​the hollow organ by color-coding a treatment target area determined to require treatment and a non-treatment target area determined not to require treatment, a schematic diagram obtained by modifying the schematic diagram based on a treatment goal, a recommended treatment, and specifications of equipment to be used for the treatment; The first support information is displayed on one screen. An information processing method in which processing is performed by a computer.

34. a tomographic image acquisition unit that acquires a plurality of tomographic images generated along the blood vessel using an imaging diagnostic catheter inserted into the blood vessel; a first information acquiring unit that acquires first information on a state of a blood vessel based on the tomographic image acquired by the tomographic image acquiring unit; an output unit that outputs first support information that supports diagnosis or treatment based on the first information acquired by the first information acquisition unit on one screen, The first support information includes a current schematic diagram showing the shape of a hollow organ or the surrounding area of ​​the hollow organ by color-coding treatment target areas determined to require treatment and non-treatment target areas determined not to require treatment, a schematic diagram obtained by modifying the schematic diagram based on a treatment goal, a recommended treatment, and specifications of equipment to be used for the treatment. Information processing system.

Images