Program, information processing method, and information processing device.

Abstract

To provide a program or similar tool that allows users to quickly understand the branching status of side branches, etc. [Solution] The program reads vascular data including multiple transverse images 71 taken from inside the blood vessel using an image acquisition catheter, obtains a reference line 41 for the multiple transverse images 71, determines multiple inclined lines 42 tilted with respect to the reference line 41, determines a lumen projection point 772 by projecting the intersection of each of the multiple inclined lines 42 and the lumen boundary 751 of the blood vessel in the transverse image 71 onto the reference line 41, and causes the computer to perform the process of arranging and displaying the lumen projection points 772 for each of the multiple transverse images 71 along the longitudinal direction of the blood vessel.

Description

Technical Field

[0001] The present invention relates to a program, an information processing method, and an information processing apparatus.

Background Art

[0002] An image acquisition catheter for so-called three-dimensional scanning is used, which continuously acquires a plurality of tomographic images along a blood vessel (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of Invention

Problems to be Solved by the Invention

[0004] A three-dimensional image can be constructed based on a series of images acquired by three-dimensional scanning. The use of the three-dimensional image makes it easy for even relatively inexperienced physicians and paramedical staff to grasp the branching state of side branches and the like.

[0005] However, the construction and display of three-dimensional images impose a high processing load on computers. Therefore, for example, a time lag is likely to occur between when a user instructs a change of viewpoint or the like and when the actual image is displayed. For this reason, the use of three-dimensional images may not be desirable for promptly proceeding with intravascular treatment procedures and the like.

[0006] In one aspect, an object is to provide a program or the like that allows a user to promptly grasp the branching state of side branches and the like.

Means for Solving the Problems

[0007] The present invention relates to: (1) reading blood vessel data including a plurality of tomographic images captured from the inside of a blood vessel by an image acquisition catheter, A reference line is obtained for the aforementioned multiple transverse layer images, Determine a number of inclined lines that are tilted relative to the aforementioned reference line, The luminal projection points are determined by projecting the intersections of each of the plurality of inclined lines and the luminal boundary of the blood vessel in the transverse layer image onto the reference line. The luminal projection points in each of the aforementioned multiple transverse images are displayed aligned along the longitudinal direction of the blood vessel. It is a program that instructs a computer to perform a process.

[0008] Herein, embodiments of the present invention are as follows: (2) The program described in (1) above is further Preferably, the multiple transverse layer images are acquired by three-dimensional scanning, in which the scanning plane is moved in the longitudinal direction of the blood vessel.

[0009] (3) The program described in (1) or (2) above is further Preferably, the vascular data includes information regarding the luminal boundary of the blood vessel in each of the transverse images.

[0010] (4) Any of the programs in (1) to (3) above, Preferably, the reference line passes through the central axis of the image acquisition catheter.

[0011] (5) Any of the programs in (1) to (4) above, Preferably, the inclined line passes through the central axis of the image acquisition catheter.

[0012] (6) Any of the programs in (1) to (5) above, It is preferable to represent the aforementioned luminal projection points with lines interpolated between adjacent luminal projection points.

[0013] (7) Any of the programs in (1) to (6) above, It is preferable to display the lumen projection point together with a longitudinal section obtained by cutting the blood vessel along a plane passing through the reference line in each of the transverse tomographic images.

[0014] (8) The present invention relates to reading blood vessel data including a plurality of transverse tomographic images captured from the inside of a blood vessel by an image acquisition catheter, acquiring a reference plane for cutting the blood vessel in the longitudinal direction based on the blood vessel data, displaying lumen boundaries obtained by respectively projecting lines indicating the lumen boundary of the blood vessel in a plurality of inclined planes that intersect the reference plane at the central axis of the blood vessel and are inclined relative to the reference plane, onto the reference plane the program causing a computer to execute the processing.

[0015] (9) In the program described in the above (8), it is further preferable that the plurality of transverse tomographic images are captured by three-dimensional scanning in which imaging is performed while moving a scanning plane in the longitudinal direction of the blood vessel.

[0016] (10) In the program described in the above (8) or (9), it is further preferable that the blood vessel data includes information related to a blood vessel tissue region in each of the transverse tomographic images, the lumen boundary is displayed together with a longitudinal section of the blood vessel tissue region obtained by cutting the blood vessel tissue region in the plurality of transverse tomographic images along the reference plane.

[0017] (11) The present invention relates to reading blood vessel data including a plurality of transverse tomographic images captured from the inside of a blood vessel by an image acquisition catheter, acquiring a reference line for the plurality of transverse tomographic images, determining a plurality of inclined lines inclined relative to the reference line, determining a lumen projection point obtained by projecting an intersection of each of the plurality of inclined lines and the lumen boundary of the blood vessel in the transverse tomographic image onto the reference line, arranging and displaying the lumen projection point in each of the plurality of transverse tomographic images along the longitudinal direction of the blood vessel An information processing method in which a computer executes a process.

[0018] (12) The present invention relates to, reading vascular data including a plurality of tomographic cross-sectional images captured from the inside of a blood vessel by an image acquisition catheter, acquiring a reference plane that cuts the blood vessel in the longitudinal direction based on the vascular data, displaying luminal boundaries obtained by respectively projecting, onto the reference plane, lines indicating the luminal boundary of the blood vessel on a plurality of inclined planes that intersect the reference plane at the central axis of the blood vessel and are inclined relative to the reference plane An information processing method in which a computer executes a process.

[0019] (13) The present invention relates to, An information processing apparatus comprising a control unit, the control unit, reads vascular data including a plurality of tomographic cross-sectional images captured from the inside of a blood vessel by an image acquisition catheter, acquires a reference line for the plurality of tomographic cross-sectional images, determines a plurality of inclined lines inclined relative to the reference line, determines luminal projection points obtained by projecting, onto the reference line, intersection points between each of the plurality of inclined lines and the luminal boundary of the blood vessel in the tomographic cross-sectional image, arranges and displays the luminal projection points in each of the plurality of tomographic cross-sectional images along the longitudinal direction of the blood vessel An information processing apparatus that executes a process.

[0020] (14) The present invention relates to, An information processing apparatus comprising a control unit, the control unit, reads vascular data including a plurality of tomographic cross-sectional images captured from the inside of a blood vessel by an image acquisition catheter, acquires a reference plane that cuts the blood vessel in the longitudinal direction based on the vascular data, displays luminal contour lines obtained by respectively projecting, onto the reference plane, lines indicating the luminal boundary of the blood vessel on a plurality of inclined planes that intersect the reference plane at the central axis of the blood vessel and are inclined relative to the reference plane It is an information processing device that performs processing.

[0021] (15) The present invention is An information processing device comprising a control unit, The control unit, Based on multiple transverse images taken from inside the blood vessel using an imaging catheter, a longitudinal section of the blood vessel is created, and the luminal boundary of the blood vessel is projected onto this longitudinal section by lines cut by multiple inclined planes intersecting the longitudinal section. It is an information processing device. [Effects of the Invention]

[0022] One aspect of this is that it can provide programs that allow users to quickly grasp the branching status of side branches, etc. [Brief explanation of the drawing]

[0023] [Figure 1] This is an explanatory diagram illustrating the general outline of the information processing procedure. [Figure 2] Lumen contour diagram. [Figure 3] This is an explanatory diagram illustrating the configuration of an information processing system. [Figure 4] This is a flowchart that explains the processing flow of a program. [Figure 5] This is an example screen. [Figure 6] This is an explanatory diagram illustrating the outline of the information processing procedure in Embodiment 2. [Figure 7] This is a flowchart illustrating the processing flow of the program in Embodiment 2. [Figure 8] This is an explanatory diagram illustrating the configuration of the information processing system in Embodiment 3. [Modes for carrying out the invention]

[0024] [Embodiment 1] Figure 1 is an explanatory diagram illustrating the overview of the information processing procedure. A set of multiple transverse images 71 are captured by three-dimensional scanning using an image acquisition catheter 32 (see Figure 3) inserted into a blood vessel. From each transverse image 71, the luminal boundary 751, which is the boundary on the inner side of the blood vessel wall 753 (which is biological tissue), and the EEM 752, which is the boundary on the outer side, are extracted. In the following explanation, the image in which the luminal boundary 751 and EEM 752 have been extracted from the transverse image 71 will be referred to as the transverse classification image 75. The method for extracting the boundaries will be described later.

[0025] The control unit 21 (see Figure 3) accepts the user's specification of the longitudinal section angle. The longitudinal section angle is the angle at which the user wishes to observe the longitudinal section of the blood vessel. Based on the longitudinal section angle, a reference line 41, which is the intersection line of the longitudinal section and the transverse layer image 71, is determined.

[0026] In the following explanation, the blood vessel into which the image acquisition catheter 32 is inserted will be referred to as the main trunk, and the blood vessels branching from the main trunk will be referred to as side branches. Furthermore, in the following explanation, we will use as an example the case in which the control unit 21 displays a longitudinal section obtained by cutting the main trunk in the longitudinal direction on the display unit 25 (see Figure 3) with the longitudinal direction of the main trunk oriented horizontally.

[0027] The control unit 21 defines inclined lines 42 that equally divide the 180-degree scanning angle, which is the display target area, behind the vertical cross-section, for each horizontal classification image 75. The number of divisions is, for example, about 10 to 20. The control unit 21 may also accept a user's specification of the number of divisions. In Figure 1, the area to the right of the vertically indicated reference line 41 is the display target area. Within the display target area, inclined lines 42 with angles θ1 and θ2 are shown clockwise from the reference line 41. θ1 is approximately 30 degrees, and θ2 is approximately 135 degrees.

[0028] The control unit 21 calculates the position of the lumen intersection point 771, which is the intersection point of each inclined line 42 with the lumen boundary 751. The control unit 21 also calculates the lumen projection point 772, which is the foot of the perpendicular drawn from the lumen intersection point 771 to the reference line 41.

[0029] In Figure 1, the transverse layer image 71 and the transverse classification image 75 are shown in XY format (orthogonal coordinate format) corresponding to the actual shape of the blood vessel. However, by using Rθ format (polar coordinate format) with the scan lines of the image acquisition catheter 32 arranged in parallel, the computational amount required to calculate the slope line 42, the lumen intersection 771, and the lumen projection point 772 can be reduced. The method for converting between XY format and Rθ format is well known, so its explanation is omitted.

[0030] The control unit 21 cuts each of the multiple horizontal classification images 75 along the reference line 41, and then interpolates between adjacent horizontal classification images 75 to create a vertical cross-sectional view of the blood vessel wall 753. In the following description, the vertical cross-sectional view of the blood vessel wall 753 created based on the horizontal classification images 75 may be referred to as a longitudinal tomographic image of the blood vessel.

[0031] The control unit 21 creates a lumen contour line 755 by connecting the lumen projection points 772 calculated for each of the multiple horizontal classification images 75 at angles of the inclined lines 42. The control unit 21 displays a lumen contour diagram 81 on the display unit 25, which is a superimposed image of the longitudinal section and the lumen contour line 755.

[0032] Figure 2 is a diagram of the lumen contour 81. The horizontal direction shows the longitudinal direction of the blood vessel. The vertical direction shows the diameter direction of the blood vessel. The hatched area shows the blood vessel wall 753. From the shape of the blood vessel wall 753, it can be seen that a lateral branch extends upward from about 20 percent of the right end of the main trunk.

[0033] The blood vessel wall 753 may also be displayed as a B-mode longitudinal tomographic image obtained by interpolating the brightness on the reference line 41 in multiple transverse tomographic images 71 in the longitudinal direction of the blood vessel. Users proficient in interpreting B-mode images can read the shape of the blood vessel, as well as the state of plaque and calcification, etc.

[0034] Multiple luminal contour lines 755 are displayed inside the vessel wall 753. Each luminal contour line 755 indicates the intersection line between the vessel lumen and the inclined surface 47 (see Figure 6) when the vessel wall 753 is cut by an inclined surface 47 containing multiple inclined lines 42 at the same angle. The user can easily read that side branches extend from sections A and B toward the back of the display unit 25.

[0035] Figure 3 is an explanatory diagram illustrating the configuration of the information processing system 10. The information processing system 10 includes an information processing device 20 and a catheter system 30. The catheter system 30 includes a catheter control device 31, an image acquisition catheter 32, and an MDU (Motor Driving Unit) 33. The image acquisition catheter 32 is connected to the catheter control device 31 via the MDU 33.

[0036] The image acquisition catheter 32 is either an OCT catheter or an IVUS catheter. The image acquisition catheter 32 may also be a dual-sensor type catheter that has the functions of both an OCT catheter and an IVUS catheter.

[0037] The image acquisition catheter 32 comprises a sensor 322, a shaft 323, and a sheath 324. The sheath 324 is a resin tube with its tip bent in a roughly crank shape. A guide wire insertion hole (not shown) is provided on the tip side of the bend.

[0038] A shaft 323 is inserted inside a sheath 324. A sensor 322 is fixed to the tip of the shaft 323. If the image acquisition catheter 32 is an OCT catheter, the sensor 322, which is an OCT sensor, is a ball lens that emits light from a light source and receives reflected light. If the image acquisition catheter 32 is an IVUS catheter, the sensor 322, which is an IVUS sensor, is an ultrasonic sensor that transmits and receives ultrasonic waves.

[0039] In the following explanation, the end of the image acquisition catheter 32 furthest from the MDU 33 will be referred to as the tip end. Catheter images, such as the transverse view 71 of the blood vessel, are output from the catheter control device 31. Catheter images other than the transverse view 71 will be described later.

[0040] The MDU 33 rotates the sensor 322 and shaft 323 inside the sheath 324. Radial scanning is performed as the sensor 322 rotates while transmitting and receiving light or ultrasound. The catheter control device 31 creates one image for each rotation of the sensor 322. The created image is a transverse layer image 71 centered on the sensor 322 and approximately perpendicular to the sheath 324. In the following description, the series of processes from the transmission and reception of data by the sensor 322 to the creation of a single transverse layer image 71 may be referred to as the acquisition of the transverse layer image 71.

[0041] The MDU 33 moves forward and backward inside the sheath 324 while rotating the sensor 322 and shaft 323. By performing a pullback operation that rotates the sensor 322 while pulling it toward the MDU 33 at a constant speed, the catheter control device 31 achieves three-dimensional scanning by continuously capturing multiple transverse layer images 71 approximately perpendicular to the sheath 324 at predetermined intervals.

[0042] In the process described above, the lines formed by the transmission and reception of light or ultrasound by the sensor 322 are referred to as scan lines. Similarly, the surface formed by one rotation of the sensor 322 is referred to as the scanning surface. By performing various signal processing on the scan lines on the scanning surface, a transverse layer image 71 is formed. Three-dimensional scanning is achieved by moving the scanning surface in the longitudinal direction of the blood vessel.

[0043] The information processing device 20 comprises a control unit 21, a main memory 22, an auxiliary memory 23, a communication unit 24, a display unit 25, an input unit 26, and a bus. The control unit 21 is an arithmetic control device that executes the program of this embodiment. One or more CPUs (Central Processing Units), GPUs (Graphics Processing Units), or multi-core CPUs are used in the control unit 21. The control unit 21 is connected to each hardware component of the information processing device 20 via the bus.

[0044] The main memory 22 is a storage device such as SRAM (Static Random Access Memory), DRAM (Dynamic Random Access Memory), or flash memory. The main memory 22 temporarily stores information necessary during processing performed by the control unit 21 and the program currently being executed by the control unit 21.

[0045] The auxiliary storage device 23 is a storage device such as SRAM, flash memory, hard disk, or magnetic tape. The auxiliary storage device 23 stores the program to be executed by the control unit 21, as well as various data necessary for the execution of the program. The communication unit 24 is an interface for communication between the information processing device 20 and the network.

[0046] The display unit 25 is, for example, a liquid crystal display device or an organic EL (Electro-Luminescence) display device. The input unit 26 is, for example, an input device such as a keyboard, mouse, trackball, or microphone. The display unit 25 and the input unit 26 may be stacked together to form a touch panel.

[0047] The display unit 25 may be a connection interface that connects the information processing device 20 to an external display device. A communication unit 24 that connects data to an external display device via a network may implement the functions of the display unit 25 and the input unit 26.

[0048] The information processing device 20 in this embodiment is an information device such as a general-purpose personal computer, tablet, smartphone, or server computer. The information processing device 20 may also be a mainframe computer, a virtual machine operating on a mainframe computer, a cloud computing system, a quantum computer, or multiple personal computers performing distributed processing. The information processing device 20 may be configured integrally with, for example, a catheter control device 31 or a hospital information system (HIS) not shown in the figures.

[0049] The following describes catheter images other than the transverse image 71 created by the catheter control device 31. The catheter control device 31 creates a transverse classification image 75 based on the captured transverse image 71. For example, the catheter control device 31 performs multi-label segmentation on the transverse image 71 to create label data that associates label information with each part of the transverse image 71. By imaging the label data in different ways for each label, the aforementioned transverse classification image 75 is created.

[0050] The catheter control device 31 may extract the lumen boundary 751 and EEM 752 from the transverse layer image 71 by image processing such as contour extraction or pattern matching. Based on the extracted lumen boundary 751 and EEM 752, the catheter control device 31 creates a transverse classification image 75. The transverse classification image 75 created by either method also includes information about the vascular wall 753, i.e., the vascular tissue region, sandwiched between the lumen boundary 751 and EEM 752.

[0051] The catheter control device 31 stores vascular data, including transverse images 71 and transverse classification images 75, in its built-in or external high-capacity storage device. The vascular data also includes various data calculated by the catheter control device 31, such as plaque regions extracted from the transverse images 71, regions where the vessel wall 753 is separated, vessel diameter, and vascular stenosis rate.

[0052] The control unit 21 reads the stored transverse layer images 71 and transverse classification images 75 as appropriate. The catheter control device 31 may transmit the transverse layer images 71 and transverse classification images 75 to the information processing device 20. The information processing device 20 stores the received transverse layer images 71 and transverse classification images 75 in the auxiliary storage device 23 and reads them as appropriate.

[0053] The catheter control device 31 may create only the Rθ format transverse image 71 and transmit it to the information processing device 20. The control unit 21 creates the XY format transverse image 71 and the transverse classification image 75 and stores them in the auxiliary storage device 23 or an external mass storage device.

[0054] The control unit 21 can read a set of transverse images 71 acquired in a single three-dimensional scan and create a B-mode longitudinal image at any angle. Based on a set of transverse classification images 75 created from each of the set of transverse images 71, the control unit 21 can create a longitudinal section of the blood vessel wall 753, i.e., the vascular tissue region, at any angle.

[0055] The control unit 21 may transmit the angle for creating the longitudinal tomographic image to the catheter control device 31, and the catheter control device 31 may create a longitudinal tomographic image at the specified angle and transmit it to the information processing device 20. Since a method for creating a longitudinal tomographic image at an arbitrary angle based on a set of transverse images 71 or transverse classification images 75 is known, a detailed explanation will be omitted.

[0056] Figure 4 is a flowchart illustrating the program's processing flow. Before the program in Figure 4 is executed, the three-dimensional scan is completed, and vascular data, including multiple transverse images 71 and transverse classification images 75 created by the catheter control device 31, is stored in the auxiliary storage device 23 or an external mass storage device.

[0057] The control unit 21 accepts the user's specification of the longitudinal section display angle, that is, the specification of the angle at which the blood vessel is cut in the longitudinal direction (step S501). The control unit 21 determines the angle of each of the inclined lines 42 that divide the 180-degree region behind the longitudinal section into a predetermined number of equal angles (step S502). For example, when dividing into ten equal angles, the control unit 21 determines the angle of each of the nine inclined lines 42 in 18-degree increments based on the angle accepted in step S501.

[0058] The control unit 21 reads a single transverse classification image 75 (step S503). In the series of loops starting from step S503, it is desirable that the control unit 21 reads and processes the transverse classification images 75 corresponding to each transverse layer image 71, in the order in which the transverse layer images 71 acquired by three-dimensional scanning were acquired, or in reverse order.

[0059] The control unit 21 calculates the position of the luminal intersection point 771 where one of the inclined lines 42 whose angle was determined in step S502 intersects with the luminal boundary 751 (step S504). The control unit 21 calculates the luminal projection point 772, which is the foot of the perpendicular line drawn from the luminal intersection point 771 to the reference line 41 (step S505).

[0060] The control unit 21 records in the auxiliary storage device 23 information that identifies the transverse classification image 75 acquired in step S504, specifically a number indicating which transverse layer image 71 in the three-dimensional scan it corresponds to, the angle of the inclined line 42 used, and the position of the luminal projection point 772, associating these with each other (step S506). The position of the luminal projection point 772 can be expressed, for example, as the distance between the center of the radial scan and the luminal projection point 772.

[0061] The control unit 21 determines whether or not it has finished processing all the angles determined in step S502 (step S507). If it determines that it has not finished (NO in step S507), the control unit 21 determines the angle of the next inclined line 42 to be processed from the angles determined in step S502 (step S508). The control unit 21 returns to step S504.

[0062] If it is determined that the process is complete (YES in step S507), the control unit 21 determines whether it has finished processing all the lateral classification images 75 created based on a single three-dimensional scan (step S511). If it is determined that the process is not complete (NO in step S511), the control unit 21 returns to step S503 and reads the next lateral classification image 75 to be processed.

[0063] If it is determined that the process is complete (YES in step S511), the control unit 21 creates a lumen contour line 755 for each angle of the inclined line 42 (step S512). Specifically, the control unit 21 creates the lumen contour line 755 by interpolating the lumen projection points 772 calculated for each lateral classification image 75 and the angle of the inclined line 42, in the order in which the corresponding transverse layer images 71 were taken. In other words, in step S512, the control unit 21 creates the same number of lumen contour lines 755 as the inclined line angles determined in step S502.

[0064] The control unit 21 superimposes the luminal contour line 755 created in step S512 and the longitudinal section of the vascular tissue region created at the angle received in step S501, and displays them on the display unit 25 (step S513). As mentioned above, the method for creating the longitudinal section of the vascular tissue region is well known, so a detailed explanation is omitted. The control unit 21 then terminates the process.

[0065] Furthermore, if the spacing between the transverse layer images 71 in the three-dimensional scan is sufficiently narrow, the control unit 21 may omit step S512 and display points indicating the positions of each lumen projection point 772 on the display unit 25 instead of the lumen contour line 755.

[0066] Figure 5 shows an example screen. A transverse image 71 is positioned at the top of the screen, and a luminal contour diagram 81 is positioned at the bottom of the screen. Two reference line cursors 61 are displayed near the edge of the transverse image 71. The two reference line cursors 61 form an isosceles triangle, and their vertices are positioned opposite each other. The straight line connecting the two vertices passes through the center of the transverse image 71.

[0067] The user can change the position of one of the reference line cursors 61 along the edge of the cross-sectional image 71 by operating an input unit 26, such as a mouse. The control unit 21 moves the reference line cursor 61 that the user is not operating to the opposite side of the center of the cross-sectional image 71 from the reference line cursor 61 that the user is operating. The straight line connecting the two reference line cursors 61 is the reference line 41. In other words, the user uses the reference line cursors 61 to specify the longitudinal section angle.

[0068] In other words, when the user determines the position of the reference line cursor 61, step S501 of the program described using Figure 4 is completed, and the control unit 21 executes the subsequent processing.

[0069] Two transverse layer position cursors 62 are positioned above and below the roughly rectangular luminal contour diagram 81. The two transverse layer position cursors 62 form an isosceles triangle, with their vertices facing each other. The straight line connecting the two vertices is perpendicular to the longitudinal direction of the luminal contour diagram 81, i.e., in the direction of the blood vessel's diameter.

[0070] The user can change the position of one of the transverse layer position cursors 62 along the longitudinal direction of the luminal contour diagram 81 by operating an input unit 26, such as a mouse. The control unit 21 moves the transverse layer position cursor 62 on the side not being operated by the user to the opposite side of the luminal contour diagram 81 from the transverse layer position cursor 62 being operated by the user. The straight line connecting the two reference line cursors 61 indicates the position of the transverse layer image 71 in the area where the three-dimensional scan was performed.

[0071] The control unit 21 displays a cross-sectional image 71 on the screen corresponding to the position of the cross-sectional position cursor 62 specified by the user. Therefore, the user can observe the luminal contour diagram 81 and quickly confirm the cross-sectional image 71 at any point of interest.

[0072] The control unit 21 may display the transverse layer image 71 and the transverse classification image 75 at the same location side by side on a single screen. The control unit 21 may also display multiple sets of transverse layer position cursors 62 and display the transverse layer image 71 at the position selected by each transverse layer position cursor 62.

[0073] The control unit 21 may display diagnostic and treatment support images generated by applying known semantic segmentation methods or multi-label methods, etc., simultaneously with or instead of the transverse image 71.

[0074] According to this embodiment, an information processing system 10 can be provided that allows users to intuitively understand the branching status of blood vessel side branches without constructing a three-dimensional model. Because it does not involve constructing and displaying a computationally intensive three-dimensional model, an information processing system 10 can be provided that quickly responds to user operations and updates the image explained using Figure 5.

[0075] The control unit 21 may also display various vascular data calculated by the catheter control device 31, such as plaque location, blood vessel diameter, and stenosis rate, in addition to the screen described using Figure 5.

[0076] According to this embodiment, by using the screen described with reference to Figure 5, the user can quickly confirm, for example, the transverse layer image 71 at the location where a side branch diverges.

[0077] [Variation 1-1] The control unit 21 may process the luminal boundary 751 located in front of the longitudinal section using the same procedure as for the luminal boundary 751 located behind, to draw the luminal contour line 755. Specifically, in step S502 of the program described using Figure 4, the control unit 21 divides the 360-degree range into equal angles at predetermined angles.

[0078] As a result, in the loop from step S504 to step S508, the control unit 21 calculates the lumen projection points 772 that correspond to the entire circumference of the lumen boundary 751 depicted in the transverse classification image 75. Therefore, in step S512, the control unit 21 creates a number of lumen contour lines 755 corresponding to a 360-degree range.

[0079] Furthermore, it is desirable that the control unit 21 displays the lumen contour lines 755 corresponding to inclination angles from 0 to 180 degrees and the lumen contour lines 755 corresponding to inclination angles from 180 to 360 degrees in different colors.

[0080] Let's explain with a specific example. The control unit 21 displays the luminal contour lines 755 corresponding to inclination angles from 0 to 180 degrees located behind the longitudinal section in cool colors such as blue or bluish-purple, and the luminal contour lines 755 corresponding to inclination angles from 180 to 360 degrees located in front of the longitudinal section in warm colors such as red or orange. Generally, cool colors tend to be perceived as being further away and warm colors as being closer, so the user can intuitively grasp the three-dimensional shape of the luminal boundary 751. The control unit 21 may also accept the user's specification of the display colors.

[0081] Let's explain with another specific example. The control unit 21 displays the luminal contour lines 755 corresponding to the inclination angles located behind the longitudinal section with light-colored lines, and the luminal contour lines 755 corresponding to the inclination angles located in front of the longitudinal section with dark-colored lines. Generally, dark-colored lines are more clearly visible, allowing the user to intuitively grasp the three-dimensional shape of the luminal boundary 751.

[0082] The control unit 21 may receive instructions from the user to switch between displaying only the lumen contour line 755 corresponding to the inclination angle on the far side of the vertical cross-section, displaying only the lumen contour line 755 corresponding to the inclination angle on the near side of the vertical cross-section, and displaying the lumen contour line 755 around the entire circumference, and reflect these instructions in the display.

[0083] Furthermore, if the inclination angles divided into equal angles in step S502 include 0 degrees, 180 degrees, or 360 degrees on the plane of the longitudinal section, it is desirable that the control unit 21 does not create or display the luminal contour lines 755 corresponding to these angles. This is because the luminal contour lines 755 corresponding to these angles would overlap with the boundary lines of the blood vessel wall 753 depicted in the longitudinal section view.

[0084] [Variation 1-2] The control unit 21 may create and animate a luminal contour diagram 81 corresponding to a plurality of longitudinal section angles defined at predetermined angles. Specifically, the control unit 21 repeatedly executes the program described using Figure 4, and in step S501, it automatically determines the longitudinal section angles at predetermined angle intervals.

[0085] Let's explain with a specific example. The control unit 21 repeatedly executes the program in Figure 4, for example, while changing the vertical cross-sectional angle in increments of 10 degrees from 0 degrees. After the program in Figure 4 is executed 35 times, the lumen contour diagram 81 for one full rotation is sequentially created and displayed. The control unit 21 may record the lumen contour diagram 81 for one full rotation and display it as an animation based on user instructions. The user can specify the animation playback speed, reverse playback, and pause as appropriate.

[0086] [Embodiment 2] This embodiment relates to an information processing system 10 that creates longitudinal cross-sectional views of vascular tissue regions at multiple angles, and then creates a luminal contour diagram 81. Parts common to Embodiment 1 will not be described.

[0087] Figure 6 is an explanatory diagram illustrating the outline of the information processing procedure in Embodiment 2. A set of multiple transverse images 71 are captured by three-dimensional scanning using an image acquisition catheter 32 inserted into a blood vessel. From each transverse image 71, the luminal boundary 751, which is the boundary on the inner side of the blood vessel wall 753 (which is biological tissue), and the EEM 752, which is the boundary on the outer side, are extracted to create a transverse classification image 75.

[0088] The control unit 21 accepts a specification of the longitudinal section angle by the user. The longitudinal section angle is the angle at which the user wishes to observe the longitudinal section of the blood vessel. Based on the longitudinal section angle, a reference line 41, which is the intersection line of the longitudinal section and the transverse layer image 71, is determined. The above process is the same as the process of Embodiment 1 described using Figure 1.

[0089] In the following explanation, the plane containing the reference line 41 in each transverse image 71 will be referred to as the reference plane 46. The reference plane 46 is the plane that cuts the blood vessel in the longitudinal direction. The reference plane 46 corresponds to the longitudinal cross-sectional image of the blood vessel at the angle that the user wants to observe.

[0090] The control unit 21 defines an inclined surface 47 that divides the scanning angle of 180 degrees, which is the display target area, into equal angles, located behind the reference surface 46. The reference surface 46 and the inclined surface 47 intersect at the central axis of the blood vessel, that is, at the central axis of the image acquisition catheter 32 when three-dimensional scanning is performed.

[0091] The number of divisions is, for example, around 10 to 20. The control unit 21 may accept a user's specification of the number of divisions. In Figure 6, inclined surfaces 47 are shown at approximately 45 degrees, 90 degrees, and 150 degrees clockwise from the reference surface 46.

[0092] The control unit 21 calculates the lumen boundary 751 at each inclined surface 47. Specifically, for each inclined surface 47, the control unit 21 calculates the intersection points with the lumen boundary 751 in each transverse classification image 75 and interpolates them in the longitudinal direction of the blood vessel to calculate the lumen boundary 751 at each inclined surface 47.

[0093] The control unit 21 calculates the lumen contour line 755 by projecting the lumen boundary 751 on each inclined surface 47 onto the reference surface 46. The control unit 21 displays a lumen contour diagram 81 on the display unit 25, which is a superimposed image of the longitudinal section and the lumen contour line 755.

[0094] Figure 7 is a flowchart illustrating the processing flow of the program in Embodiment 2. Before the program in Figure 7 is executed, the three-dimensional scan is completed, and multiple transverse layer images 71 and transverse classification images 75 created by the catheter control device 31 are stored in the auxiliary storage device 23 or an external mass storage device.

[0095] The control unit 21 accepts the user's specification of the longitudinal section display angle, that is, the specification of the angle at which the blood vessel is cut in the longitudinal direction (step S521). The control unit 21 determines the angle of each inclined surface 47 that divides the 180-degree region behind the longitudinal section into a predetermined number of equal angles (step S522).

[0096] The control unit 21 selects one inclined surface 47 to be processed in the subsequent loop (step S523). The control unit 21 reads one transverse classification image 75 (step S524). The control unit 21 calculates the position of the lumen intersection 771, which is the intersection point between the lumen boundary 751 in the transverse classification image 75 read in step S524 and the inclined surface 47 selected in step S523 (step S525).

[0097] The control unit 21 determines whether it has finished processing all the transverse classification images 75 created based on a single three-dimensional scan (step S526). If it determines that it has not finished (NO in step S526), ​​the control unit 21 returns to step S524.

[0098] If it is determined that the process is complete (YES in step S526), ​​the control unit 21 interpolates the lumen intersections 771 located on the inclined surface 47 being processed to create a line indicating the lumen boundary 751 on the inclined surface 47 (step S527).

[0099] The control unit 21 creates the lumen contour line 755 by projecting the line created in step S527 onto the reference plane 46 (step S528). The control unit 21 temporarily records the created lumen contour line 755 in the auxiliary storage device 23 (step S529).

[0100] The control unit 21 determines whether or not it has finished processing all the inclined surfaces 47 whose angles were determined in step S522 (step S530). If it determines that it has not finished (NO in step S530), the control unit 21 returns to step S523.

[0101] If the control unit determines that the process is complete (YES in step S530), it superimposes the luminal contour line 755 recorded in step S529 with the longitudinal section of the vascular tissue region created at the angle received in step S521 and displays it on the display unit 25 (step S531). As mentioned above, the method for creating the longitudinal section of the vascular tissue region is well known, so a detailed explanation is omitted. The control unit 21 then terminates the process.

[0102] According to this embodiment, an information processing system 10 can be provided that displays a smooth lumen contour line 755 by creating lines indicating the lumen boundary 751 on each inclined surface 47.

[0103] [Differentiation 2] In the loop from step S523 to step S530, as described using Figure 7, the control unit 21 processes the inclined surface 47 without limiting it to the half-section behind the reference surface 46. The control unit 21 stores the line indicating the lumen boundary 751 created in step S527 in the auxiliary storage device 23. In step S531, the control unit 21 selects and displays only the lumen contour line 755 corresponding to the area behind the reference surface 46.

[0104] Subsequently, the control unit 21 receives a user instruction to change the longitudinal section angle within a range corresponding to one of the inclined surface angles determined in step S522. The control unit 21 can quickly create a luminal contour diagram 81 based on the modified reference surface 46 by projecting the line created in step S527 onto the new reference surface 46.

[0105] [Embodiment 3] This embodiment relates to a configuration in which an information processing system 10 is realized by operating a general-purpose computer 90 in combination with a program 97. Parts common to Embodiment 1 will not be described.

[0106] Figure 8 is an explanatory diagram illustrating the configuration of the information processing system 10 of Embodiment 3. The computer 90 includes the control unit 21, main memory 22, auxiliary memory 23, communication unit 24, display unit 25, input unit 26, and bus mentioned above, as well as a reading unit 29.

[0107] Program 97 is recorded on a portable recording medium 96. The control unit 21 reads Program 97 via the reading unit 29 and saves it to the auxiliary storage device 23. The control unit 21 may also read Program 97 stored in a semiconductor memory 98, such as flash memory, implemented in the computer 90. Furthermore, the control unit 21 may download Program 97 from another server computer (not shown) connected via the communication unit 24 and a network (not shown) and save it to the auxiliary storage device 23.

[0108] Program 97 is installed as a control program for the computer 90, loaded into the main memory 22, and executed. Thus, the information processing system 10 described in Embodiment 1 is realized. Program 97 in this embodiment is an example of a program product.

[0109] The program may be provided on a recording medium or distributed from an external computer. Computer programs can be deployed to run on a single computer, at a single site, or distributed across multiple sites and interconnected by a communication network.

[0110] The technical features (constituent elements) described in each embodiment are combinable with each other, and by combining them, new technical features can be formed. The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims, not in the sense described above, and all modifications within the sense and scope equivalent to the claims are intended to be included.

[0111] The independent and dependent claims described in the claims can be combined with each other in any combination, regardless of the form of reference. Furthermore, while the claims use a multi-claim format in which claims refer to two or more other claims (multi-claim format), this is not the only option. Claims may also be described using a multi-claim format in which at least one multi-claim is referenced (multi-multi-claim format). [Explanation of Symbols]

[0112] 10 Information Processing Systems 20 Information Processing Devices 21 Control Unit 22 Main storage 23 Auxiliary storage device 24 Communications Department 25 Display section 26 Input section 29 Reading section 30 Catheter Systems 31 Catheter control device 32. Catheter for image acquisition 322 sensors 323 Shaft 324 Sheath 33 MDU 41. Reference Line 42. Sloping lines 46 Reference plane 47 Slope 61. Reference line cursor 62 Cross-sectional position cursor 71 Cross section image 75 Horizontal Classification Images 751 Luminal boundary 752 EEM 753 Blood vessel wall 755 Luminal contour line 771 Lumen intersection 772 Lumen projection point 81. Lumen contour diagram 90 Computer 96 Portable recording media 97 Programs 98 Semiconductor memory

Claims

1. The system reads vascular data, including multiple transverse images, taken from inside the blood vessel using an imaging catheter. A reference line is obtained for the aforementioned multiple transverse layer images, Determine a number of inclined lines that are tilted relative to the aforementioned reference line, The luminal projection points are determined by projecting the intersections of each of the plurality of inclined lines and the luminal boundary of the blood vessel in the transverse layer image onto the reference line. The luminal projection points in each of the aforementioned multiple transverse images are displayed aligned along the longitudinal direction of the blood vessel. A program that instructs a computer to perform a process.

2. The aforementioned multiple transverse layer images were acquired by three-dimensional scanning, which involves moving the scanning plane in the longitudinal direction of the blood vessel. The program according to claim 1.

3. The vascular data includes information regarding the luminal boundary of the blood vessel in each of the transverse images. The program according to claim 1.

4. The aforementioned reference line passes through the central axis of the image acquisition catheter. The program according to claim 1.

5. The aforementioned inclined line passes through the central axis of the image acquisition catheter. The program according to claim 1.

6. The aforementioned luminal projection points are represented by lines interpolated between adjacent luminal projection points. The program according to claim 1.

7. The luminal projection point is displayed along with a longitudinal section obtained by cutting the blood vessel with a plane passing through the reference line in each of the transverse images. The program according to any one of claims 1 to 6.

8. The system reads vascular data, including multiple transverse images, taken from inside the blood vessel using an imaging catheter. Based on the aforementioned vascular data, a reference plane is obtained for cutting the blood vessel in the longitudinal direction. Lines indicating the luminal boundaries of the blood vessel on multiple inclined surfaces that intersect the reference plane at the central axis of the blood vessel and are inclined relative to the reference plane are projected onto the reference plane to display the luminal boundaries. A program that instructs a computer to perform a process.

9. The aforementioned multiple transverse layer images were acquired by three-dimensional scanning, which involves moving the scanning plane in the longitudinal direction of the blood vessel. The program according to claim 8.

10. The vascular data includes information about the vascular tissue region in each of the transverse layers, The vascular tissue region in multiple transverse layers is shown along with a longitudinal section of the vascular tissue region obtained by cutting the vascular tissue region at the reference plane, along with the luminal boundary. The program according to claim 8 or claim 9.

11. The system reads vascular data, including multiple transverse images, taken from inside the blood vessel using an imaging catheter. A reference line is obtained for the aforementioned multiple transverse layer images, Determine a number of inclined lines that are tilted relative to the aforementioned reference line, The luminal projection points are determined by projecting the intersections of each of the plurality of inclined lines and the luminal boundary of the blood vessel in the transverse layer image onto the reference line. The luminal projection points in each of the aforementioned multiple transverse images are displayed aligned along the longitudinal direction of the blood vessel. An information processing method in which a computer performs the processing.

12. The system reads vascular data, including multiple transverse images, taken from inside the blood vessel using an imaging catheter. Based on the aforementioned vascular data, a reference plane is obtained for cutting the blood vessel in the longitudinal direction. Lines indicating the luminal boundaries of the blood vessel on multiple inclined surfaces that intersect the reference plane at the central axis of the blood vessel and are inclined relative to the reference plane are projected onto the reference plane to display the luminal boundaries. An information processing method in which a computer performs the processing.

13. An information processing device comprising a control unit, The control unit, The system reads vascular data, including multiple transverse images, taken from inside the blood vessel using an imaging catheter. A reference line is obtained for the aforementioned multiple transverse layer images, Determine a number of inclined lines that are tilted relative to the aforementioned reference line, The luminal projection points are determined by projecting the intersections of each of the plurality of inclined lines and the luminal boundary of the blood vessel in the transverse layer image onto the reference line. The luminal projection points in each of the aforementioned multiple transverse images are displayed aligned along the longitudinal direction of the blood vessel. An information processing device that performs processing.

14. An information processing device comprising a control unit, The control unit, The system reads vascular data, including multiple transverse images, taken from inside the blood vessel using an imaging catheter. Based on the aforementioned vascular data, a reference plane is obtained for cutting the blood vessel in the longitudinal direction. The lumen contour lines are projected onto the reference plane, representing the lines indicating the luminal boundaries of the blood vessel on multiple inclined planes that intersect the reference plane at the central axis of the blood vessel and are inclined relative to the reference plane. An information processing device that performs processing.

15. An information processing device comprising a control unit, The control unit, Based on multiple transverse images taken from inside the blood vessel using an imaging catheter, a longitudinal section of the blood vessel is created, and the luminal boundary of the blood vessel is projected onto this longitudinal section by lines cut by multiple inclined planes intersecting the longitudinal section. Information processing device.

Images