Medical image processing apparatus, medical image processing method, and medical image processing program

Abstract

To easily discriminate a displayed valve lobe.SOLUTION: A medical image processing device according to an embodiment comprises an acquisition unit, an extraction unit, a specification unit, a display control unit, and a reception unit. The acquisition unit acquires volume data including at least a heart valve. The extraction unit extracts a region corresponding to the heart valve included in the volume data. The specification unit specifies each of a plurality of valve lobes included in the heart valve. The display control unit displays the plurality of valve lobes in different display modes. The reception unit receives setting of a display cross section related to the heart valve. The display control unit sets information about the display cross section in the display mode associated with the display mode of the valve lobe corresponding to a position of the display cross section set by the reception unit in the plurality of valve lobes.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The embodiments disclosed in this specification and the drawings relate to a medical image processing apparatus, Medical image processing a method, and Medical image processing a program.

Background Art

[0002] Conventionally, when treating or planning treatment for a heart valve, various morphological information regarding the heart valve or the heart has been confirmed. The heart valve usually has two to three valve leaflets, and it is necessary to confirm each morphological information individually or comparatively. As a technique for confirming such morphological information of the heart valve, a technique for specifying and displaying an arbitrary cross-section based on the valve shape is known.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to facilitate the identification of the displayed valve leaflets. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problems. The problems corresponding to the respective effects of each configuration shown in the embodiments described later can also be positioned as other problems.

Means for Solving the Problems

[0005] The medical image processing apparatus according to the embodiment includes an acquisition unit, an extraction unit, a specification unit, a display control unit, and a reception unit. The acquisition unit acquires volume data including at least a heart valve. The extraction unit extracts a region corresponding to the heart valve included in the volume data. The specification unit specifies each of a plurality of valve leaflets included in the heart valve. The display control unit causes each of the plurality of valve leaflets to be displayed in a different display form. The reception unit receives a setting of a display cross section related to the heart valve. The display control unit sets the information related to the display cross section as a display form associated with the display form of the valve leaflet corresponding to the position of the display cross section set by the reception unit among the plurality of valve leaflets.

Brief Description of Drawings

[0006]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 4A

Figure 4B

Figure 4C

Figure 4D

Figure 4E

Figure 5

Figure 6A

Figure 6B

Figure 7A

Figure 7B

Figure 7C

Figure 8

Figure 9

Figure 10A

Figure 10B

Figure 11A

Figure 11B

Figure 11C

Figure 11D

Figure 12

Figure 13A

Figure 13B

Figure 14

Figure 15A

Figure 15B

Figure 16A

Figure 16B

[0007] Hereinafter, embodiments of a medical image processing apparatus, method, and program will be described in detail with reference to the drawings. Note that the medical image processing apparatus, method, and program according to the present application are not limited to the embodiments shown below. In the following description, the same components are denoted by the same reference numerals, and redundant descriptions are omitted.

[0008] (First Embodiment) FIG. 1 is a diagram showing a configuration example of a medical image processing apparatus according to the first embodiment. For example, as shown in FIG. 1, a medical image processing apparatus 3 according to the present embodiment is communicably connected to a medical image diagnostic apparatus 1 and a medical image storage apparatus 2 via a network. Note that various other devices and systems may be connected to the network shown in FIG. 1.

[0009] The medical image diagnostic apparatus 1 images a subject to generate a medical image. Then, the medical image diagnostic apparatus 1 transmits the generated medical image to various apparatuses on the network. For example, the medical image diagnostic apparatus 1 is an X-ray diagnostic apparatus, an X-ray CT (Computed Tomography) apparatus, an MRI (Magnetic Resonance Imaging) apparatus, an ultrasonic diagnostic apparatus, a SPECT (Single Photon Emission Computed Tomography) apparatus, a PET (Positron Emission computed Tomography) apparatus, or the like.

[0010] The medical image storage apparatus 2 stores various medical images related to a subject. Specifically, the medical image storage apparatus 2 receives a medical image from the medical image diagnostic apparatus 1 via a network, and stores the medical image in a storage circuit in the apparatus itself. For example, the medical image storage apparatus 2 is realized by a computer device such as a server or a workstation. Also, for example, the medical image storage apparatus 2 is realized by a PACS (Picture Archiving and Communication System) or the like, and stores medical images in a format compliant with DICOM (Digital Imaging and Communications in Medicine).

[0011] The medical image processing apparatus 3 performs various information processes related to a subject. Specifically, the medical image processing apparatus 3 receives a medical image from the medical image diagnostic apparatus 1 or the medical image storage apparatus 2 via a network, and performs various information processes using the medical image. For example, the medical image processing apparatus 3 is realized by a computer device such as a server or a workstation.

[0012] For example, the medical image processing apparatus 3 includes a communication interface 31, an input interface 32, a display 33, a storage circuit 34, and a processing circuit 35.

[0013] The communication interface 31 controls the transmission and communication of various data transmitted and received between the medical image processing device 3 and other devices connected via a network. Specifically, the communication interface 31 is connected to the processing circuit 35, and transmits the data received from other devices to the processing circuit 35, or transmits the data transmitted from the processing circuit 35 to other devices. For example, the communication interface 31 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

[0014] The input interface 32 receives input operations of various instructions and various information from the user. Specifically, the input interface 32 is connected to the processing circuit 35, and converts the input operation received from the user into an electrical signal and transmits it to the processing circuit 35. For example, the input interface 32 is realized by a trackball, a switch button, a mouse, a keyboard, a touch pad that performs an input operation by touching the operation surface, a touch screen in which a display screen and a touch pad are integrated, a non-contact input interface using an optical sensor, a voice input interface, and the like. Note that in this specification, the input interface 32 is not limited to only those having physical operation components such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and transmits this electrical signal to the control circuit is also included in the example of the input interface 32.

[0015] The display 33 displays various information and various data. Specifically, the display 33 is connected to the processing circuit 35, and displays various information and various data received from the processing circuit 35. For example, the display 33 is realized by a liquid crystal display, a CRT (Cathode Ray Tube) display, a touch panel, or the like.

[0016] The memory circuit 34 stores various data and various programs. Specifically, the memory circuit 34 is connected to the processing circuit 35, stores the data received from the processing circuit 35, or reads out the stored data and transmits it to the processing circuit 35. For example, the memory circuit 34 is realized by a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, or the like.

[0017] The processing circuit 35 controls the entire medical image processing apparatus 3. For example, the processing circuit 35 performs various processes according to an input operation received from a user via the input interface 32. For example, the processing circuit 35 receives data transmitted from another device via the communication interface 31 and stores the received data in the memory circuit 34. Further, for example, the processing circuit 35 transmits the data received from the memory circuit 34 to the communication interface 31 to transmit the data to another device. Further, for example, the processing circuit 35 displays the data received from the memory circuit 34 on the display 33.

[0018] The configuration example of the medical image processing apparatus 3 according to the present embodiment has been described above. For example, the medical image processing apparatus 3 according to the present embodiment is installed in a medical facility such as a hospital or a clinic and supports various diagnoses and formulation of treatment plans performed by users such as doctors. For example, the medical image processing apparatus 3 executes various processes for facilitating the identification of the displayed valve leaf in the display of the morphological information of the heart valve.

[0019] As described above, in the display of the morphological information of the heart valve, a technique for specifying and displaying an arbitrary cross section based on the valve shape is known. However, since the structures of the respective valve leafs of the heart valve are very similar, it may be difficult to recognize which valve leaf the displayed valve leaf is when observing each valve leaf, and in such a case, there is a risk of misidentifying the valve leaf.

[0020] Therefore, the medical image processing apparatus 3 according to the present embodiment is configured to easily identify the valve leaflets in the displayed display section by associating the display information related to the display section of the heart valve with the valve leaflets included in the display section. Specifically, the medical image processing apparatus 3 displays the information related to the display section in a display form associated with the display form of the valve leaflets corresponding to the position of the display section. Hereinafter, the medical image processing apparatus 3 having such a configuration will be described in detail.

[0021] For example, as shown in FIG. 1, in the present embodiment, the processing circuit 35 of the medical image processing apparatus 3 executes a control function 351, an image acquisition function 352, an extraction function 353, a specification function 354, and a determination function 355. Here, the control function 351 is an example of a display control unit and a reception unit. The image acquisition function 352 is an example of an acquisition unit. Further, the extraction function 353 is an example of an extraction unit. Further, the specification function 354 is an example of a specification unit. Further, the determination function 355 is an example of a determination unit.

[0022] The control function 351 controls to generate various GUIs (Graphical User Interfaces) and various display information in response to an operation via the input interface 32 and display them on the display 33. For example, the control function 351 displays a GUI for displaying the morphological information of the heart valve and various analysis information related to the heart valve on the display 33. Further, the control function 351 generates various display images related to the heart valve based on the medical images acquired by the image acquisition function 352 and displays them on the display 33.

[0023] For example, the control function 351 displays each of the plurality of valve leaflets in a different display form. Further, the control function 351 receives a setting of a display section related to the heart valve and displays the information related to the display section in a display form associated with the display form of the valve leaflet corresponding to the position of the set display section among the plurality of valve leaflets. Note that the processing by the control function 351 will be described in detail later.

[0024] The image acquisition function 352 acquires medical images of a subject from the medical image diagnostic apparatus 1 or the medical image storage apparatus 2 via the communication interface 31. Specifically, the image acquisition function 352 acquires volume data including at least a heart valve. Note that the image acquisition function 352 can also acquire a plurality of volume data obtained by imaging in three dimensions in the time direction. For example, the image acquisition function 352 acquires CT images, ultrasonic images, MRI images, X-ray images, Angio images, PET images, SPECT images, etc. as the above-described volume data. The processing circuit 35 receives medical images of a subject from the medical image diagnostic apparatus 1 or the medical image storage apparatus 2 by executing the above-described image acquisition function 352, and stores the received medical images in the storage circuit 34.

[0025] The extraction function 353 extracts a region (hereinafter referred to as the target region) indicating a target living organ in the volume data acquired by the image acquisition function 352. For example, the extraction function 353 extracts, as the target region, a region corresponding to the heart valve included in the volume data. The processing by the extraction function 353 will be described in detail later.

[0026] The identification function 354 identifies each of a plurality of valve leaflets included in the heart valve in the volume data acquired by the image acquisition function 352. The identification function 354 also identifies the position of the display cross-section where each valve leaflet is appropriately displayed. The processing by the identification function 354 will be described in detail later.

[0027] The determination function 355 determines the type of the valve leaflet included in the display cross-section identified by the identification function 354. The processing by the determination function 355 will be described in detail later.

[0028] The above-described processing circuit 35 is realized by, for example, a processor. In that case, each of the above-described processing functions is stored in the storage circuit 34 in the form of a program executable by a computer. Then, the processing circuit 35 reads and executes each program stored in the storage circuit 34 to realize the functions corresponding to the respective programs. In other words, when the processing circuit 35 reads each program, it has each processing function shown in FIG. 1.

[0029] Note that the processing circuit 35 may be configured by combining a plurality of independent processors, and each processor may execute a program to realize each processing function. Also, each processing function of the processing circuit 35 may be appropriately distributed or integrated in a single or a plurality of processing circuits. Further, each processing function of the processing circuit 35 may be realized by a combination of hardware such as a circuit and software. Here, an example in which a program corresponding to each processing function is stored in a single storage circuit 34 has been described, but the embodiment is not limited to this. For example, the programs corresponding to each processing function may be stored in a distributed manner in a plurality of storage circuits, and the processing circuit 35 may be configured to read and execute each program from each storage circuit.

[0030] Next, after explaining the processing procedure by the medical image processing apparatus 3 with reference to FIG. 2, the details of each process will be described. FIG. 2 is a flowchart showing the processing procedure of the processes performed by each processing function of the processing circuit 35 of the medical image processing apparatus 3 according to the first embodiment.

[0031] For example, as shown in FIG. 2, in the present embodiment, the image acquisition function 352 acquires a medical image (volume data) of a subject from the medical image diagnostic apparatus 1 or the medical image storage apparatus 2 (step S101). For example, the image acquisition function 352 acquires volume data including morphological information of the anatomical structure of the heart valve in response to an acquisition operation of volume data via the input interface 32. This process is realized, for example, by the processing circuit 35 calling and executing a program corresponding to the image acquisition function 352 from the storage circuit 34.

[0032] Subsequently, the extraction function 353 extracts a region of interest (heart valve) included in the medical image from the acquired volume data (step S102). This process is realized, for example, by the processing circuit 35 calling and executing a program corresponding to the extraction function 353 from the storage circuit 34.

[0033] Then, the identification function 354 identifies each valve leaf based on the extraction result of the heart valve, and identifies an initial cross-sectional position that is a position of a cross-section where the identified valve leaf is easy to observe (step S103). For example, this process is realized by the processing circuit 35 calling and executing a program corresponding to the identification function 354 from the storage circuit 34.

[0034] Subsequently, the determination function 355 determines the identified cross-sectional position (step S104). Specifically, the determination function 355 determines a valve leaf that is easy to observe at the cross-sectional position. This process is realized, for example, by the processing circuit 35 calling and executing a program corresponding to the determination function 355 from the storage circuit 34.

[0035] Then, the control function 351 sets the display form (step S105), and causes the cross-sectional image to be displayed on the display 33 in the set display form (step S106). Specifically, the control function 351 sets the display form of the valve leaf and the display form of the information regarding the cross-sectional image, and causes them to be displayed on the display 33. Here, the control function 351 performs display control in which the display form of the valve leaf is associated with the display form of the information regarding the cross-sectional image. This process is realized, for example, by the processing circuit 35 calling and executing a program corresponding to the control function 351 from the storage circuit 34.

[0036] Thereafter, the control function 351 determines whether the cross-sectional position has been changed (step S107). Here, if the cross-sectional position has been changed (step S107, Yes), the process returns to step S104, and the determination process of the cross-sectional position is executed. On the other hand, if the cross-sectional position has not been changed (step S107, No), the control function 351 determines whether the imaging has ended (step S108). In the determination of step S108, if the imaging has not ended (step S108, No), the determination process of step S107 is continued. On the other hand, in the determination of step S108, if the imaging has ended (step S108, Yes), the medical image processing apparatus 3 ends the process. This process is realized, for example, by the processing circuit 35 calling and executing a program corresponding to the control function 351 from the storage circuit 34.

[0037] Hereinafter, the details of each process executed by the medical image processing apparatus 3 will be described. In the following, the process in the case where the aortic valve is the observation target will be described as an example. Note that the target of the process described in this embodiment is not limited to this, and all heart valves can be targeted.

[0038] (Medical image acquisition process) As described in step S101 of FIG. 2, the image acquisition function 352 acquires volume data including three-dimensional morphological information of the heart valve (aortic valve) to be observed in response to an acquisition operation of volume data via the input interface 32. For example, the image acquisition function 352 acquires a CT image obtained by imaging the aortic valve in three dimensions.

[0039] Note that the medical image acquisition process in step S101 may be started by a user's instruction via the input interface 32 as described above, or may be automatically started. In such a case, for example, the image acquisition function 352 monitors the medical image storage device 2 and automatically acquires volume data every time new volume data is stored.

[0040] Here, the image acquisition function 352 may determine newly stored volume data based on preset acquisition conditions, and execute an acquisition process when the volume data meets the acquisition conditions. For example, acquisition conditions for determining the state of volume data are stored in the storage circuit 34, and the image acquisition function 352 determines newly stored volume data based on the acquisition conditions stored in the storage circuit 34.

[0041] For example, the storage circuit 34 stores, as acquisition conditions, "acquire volume data imaged by an imaging protocol targeting a heart valve", "acquire a magnified and reconstructed medical image", or a combination thereof. The image acquisition function 352 acquires volume data that satisfies the above-described acquisition conditions.

[0042] As described above, after volume data is acquired by the image acquisition function 352, a display image based on the volume data may be displayed. Here, an example of a display screen displayed by the display 33 will be described. FIG. 3A is a diagram showing an example of a display screen according to the first embodiment. As shown in FIG. 3A, the display screen according to the present embodiment includes, for example, a region 201 for displaying thumbnail images, a region 202 for displaying images, a region 203 for displaying a menu bar, and a region 204 for displaying analysis results.

[0043] (Thumbnail display) In the region 201, thumbnail images based on volume data acquired by the image acquisition function 352 in response to a user instruction are listed. Here, the thumbnail images listed are thumbnail images of volume data that satisfy the conditions specified by the user using an interface (not shown) for specifying image conditions.

[0044] For example, the user uses an interface (not shown) to specify information about the subject, such as the subject's name, subject ID, date of birth, weight, etc., and information about the image, such as the type of image modality, imaging device name, imaging date, imaging conditions, reconstruction conditions, etc. The image acquisition function 352 acquires volume data that satisfies the above conditions specified by the user from the medical imaging diagnostic apparatus 1 or the medical image storage apparatus 2. For example, the image acquisition function 352 acquires information related to the specified conditions from the DICOM header of the image, PACS, electronic medical record, RIS, HIS, etc., compares the acquired conditions with the conditions specified by the user, and acquires volume data that satisfies the conditions specified by the user.

[0045] The control function 351 generates a thumbnail image from the volume data acquired by the image acquisition function 352, and causes the generated thumbnail image to be displayed in the area 201. For example, the control function 351 generates a thumbnail image obtained by reducing a two-dimensional image of a representative cross section in the volume data to the size of the area 201.

[0046] Here, in addition to the above-described thumbnail image, the control function 351 can cause various icons to be displayed in the area 201. For example, the control function 351 causes a character string or symbol indicating the acquired volume data, or various figures, images, schema images, etc. prepared in advance and stored in the storage circuit 34 to be displayed in the area 201. Further, the control function 351 can also display the basic information (imaging date, number of slices, reconstruction function, etc.) of the volume data side by side with the above-described thumbnail image and icons. In such a case, for example, the control function 351 acquires this information from the DICOM header of the image, PACS, electronic medical record, RIS, HIS, etc., and causes it to be displayed in association with the thumbnail image and icons. Note that the basic information to be displayed may be determined in advance or may be made specifiable by the user.

[0047] (Image Display) In area 202, various images are displayed according to the user's instructions. For example, the user selects a thumbnail image displayed in area 201 and drags and drops it into area 202. In response to this operation, the control function 351 generates an image to be displayed from the volume data corresponding to the selected thumbnail image, and causes the generated image to be displayed in area 202. Here, if an image is already displayed in area 202 when dragging and dropping, the control function 351 displays a warning (not shown) to the user (for example, a warning prompting image saving, etc.). Then, after the user accepts the operation for the warning, the control function 351 removes the already displayed image from area 202 and displays the image corresponding to the dragged and dropped icon.

[0048] Note that when the control function 351 displays an image in area 202, it causes the image to be displayed based on predetermined display conditions. Here, the display conditions refer to the assignment of images to be displayed in a plurality of display areas included in area 202 (for example, which image to display in which of the areas 202a to 202d shown in FIG. 3A), the cross-sectional position when displaying a cross-sectional image, the magnification, the window level, the window width, and the like. That is, when the control function 351 causes an image to be displayed in area 202, it acquires the above-described display conditions, generates an image to be displayed in area 202 based on the acquired display conditions, and causes the generated image to be displayed in area 202.

[0049] Note that the above-described display conditions are merely examples, and any conditions may be set. Also, the display conditions may be arbitrarily changed by the user. In such a case, for example, the control function 351 displays a GUI for setting the display conditions and accepts the user's specification of the display conditions.

[0050] For example, in the initial layout of the display screen, as shown in FIG. 3A, four regions 202a to 202d are set for region 202. In region 202a, a VR (Volume Rendering) image of the aortic valve generated based on the aortic valve region identified by the method described later is displayed. In regions 202b to 202d, each MPR (Multi Planar Reconstruction) cross-section set based on the aortic valve axis (an example of the calculation method will be described later) identified based on the region of the aortic valve is set to be displayed.

[0051] Note that the images displayed in regions 202a to 202d are not limited to the above-described images, and can be set to display an arbitrary cross-sectional direction or an arbitrary type of image specified by the user under arbitrary conditions. Also, it may be set to reconstruct and display known types of images such as VR images, SR images, MIP images, and MinIP images. Here, the displayed image can be changed and displayed by changing the observation cross-section, slice feed (browsing), magnification ratio, center position (translation), window level, window width, etc. based on the user's instruction.

[0052] Also, the sizes of regions 202a to 202d can be arbitrarily changed according to the user's instruction. For example, the user performs an operation (such as drag & drop) on the frame (the dividing line that divides the display area) of each region, or a specific operation (such as double-clicking, clicking while holding down the Ctrl key) on each region. The control function 351 changes the sizes of regions 202a to 202d according to the operation input by the user.

[0053] In addition, the control function 351 can display information specified in advance or by the user on each area, superimposed on a specific position of the area. For example, as shown in area 202e of FIG. 3A, the control function 351 superimposes and displays information at the positions of the ends of each area. Here, the information can specify information related to the patient such as the name of the subject, subject ID, date of birth, weight, etc., and information related to the image such as the type of image modality, imaging device name, imaging date, imaging conditions, reconstruction conditions, etc. That is, the control function 351 acquires the specified information from the DICOM header of the image, PACS, electronic medical record, RIS, HIS, etc., and causes it to be displayed in areas 202b to 202d.

[0054] (Menu bar) Area 203 is a menu bar where icons and buttons corresponding to various functions are arranged. The user can activate the function by selecting the icon arranged in area 203 using an input interface such as a mouse.

[0055] Icon 203a is a button for switching the display and non-display of area 201. When the icon is selected, the control function 351 switches the display and non-display of area 201 where the thumbnail image is displayed. For example, when icon 203a is pressed while area 201 is being displayed, the control function 351 makes area 201 non-displayed as shown in FIG. 3B. Here, the control function 351 enlarges area 202 and / or area 204 according to the size of the non-displayed area 201. Note that FIG. 3B is a diagram showing an example of a display screen according to the first embodiment.

[0056] Icon 203b is a button for changing the number of divisions in area 202. In Fig. 3A, four areas (202a to 202d) in 2 rows and 2 columns are set, but it is also possible to change the number of rows or columns in the display area. Further, it is also possible to change the size of each display area. For example, several sets of the number of divisions and sizes of the display area in advance are registered as presets. When icon 203b is pressed, control function 351 displays an interface for selecting a preset set and receives a selection operation for the interface, thereby setting the display form of area 202. Note that control function 351 can also display an interface for receiving registration of a new preset from the user.

[0057] Icons 203c to 203g are a group of buttons for functions for assigning an operation system of a mouse. For example, when each icon is selected, control function 351 controls to assign the operation systems of left click and drag of the mouse to the operation systems corresponding to the selected icon. Specifically, icon 203c is a button for assigning a browsing operation system for continuously displaying an image in the slicing direction to the operation systems of left click and drag of the mouse. Icon 203d is a button for assigning an operation system for changing the tone of an image (for example, window level and window width in CT) to the operation systems of left click and drag of the mouse. Icon 203e is a button for assigning an operation system for moving an image parallel to the operation systems of left click and drag of the mouse. Icon 203f is a button for assigning an operation system for changing the magnification of an image to the operation systems of left click and drag of the mouse. Icon 203g is a button for assigning an operation system for rotating an image or the like to the operation systems of left click and drag of the mouse.

[0058] Note that the operation for assigning the above-described functions is not limited to the operation systems of left click and drag of the mouse, and the above-described functions may be assigned to the operation systems of right click and drag, the operation systems of mouse wheel click and drag, and the operation systems of simultaneous click and drag of right and left.

[0059] In addition, it may be possible to set the speed or amount of slice feed, the amount of change in magnification, the amount of translation, the amount of tone change, or the amount of rotation during the browsing function with respect to the amount of mouse movement (the amount of drag operation). Also, the assignment may be changed according to the mouse operation when selecting the icon. For example, when the icon is selected by a left click, the operation system corresponding to the icon is assigned to the left click operation system, when the icon is selected by a right click, the operation system corresponding to the icon is assigned to the right click operation system, when the icon is selected by a simultaneous click of the right and left buttons, the operation system corresponding to the icon is assigned to the simultaneous click operation system of the right and left buttons, and when the icon is selected by a mouse wheel click, it may be controlled to assign the operation system corresponding to the icon to the mouse wheel click operation system.

[0060] Icons 203h to 203n are icons for the drawing and measurement functions of various figures. When the icon is selected, the control function 351 controls to make the drawing and measurement functions of various figures executable.

[0061] When icon 203h is selected, a function of drawing a straight line on the image and measuring and displaying the length of the straight line becomes executable. The display forms such as the positions, colors, thicknesses of the start and end points of the straight line, and the font of the measured value can be adjusted by user operations.

[0062] When icon 203i is selected, a function of drawing two straight lines on the image and measuring and displaying the acute angle formed by the two straight lines becomes executable. The display forms such as the positions, colors, thicknesses of the start and end points of the two straight lines, and the font of the measured value can be adjusted by user operations.

[0063] When the icon 203j is selected, a function is executable to draw an ellipse on the image, calculate the perimeter, the internal area, and statistical quantities (such as the average value, the maximum value, the minimum value, etc.) of the pixel values inside the ellipse, and display them. Note that the display forms such as the center position, the major axis, the minor axis, the color, the thickness, and the font of the measured values of the ellipse can be adjusted by user operations.

[0064] When the icon 203k is selected, a function is executable to draw an arrow icon on the image. Note that the display forms such as the positions of the start point and the end point, the color, the thickness, and the form of the tip of the arrow icon can be adjusted by user operations.

[0065] When the icon 203l is selected, a function is executable to display an arbitrary character string on the image. The character string to be displayed is specified by the user using a keyboard or the like. Note that the display forms such as the position where the character string is displayed, the font of the character string, and the background color can be adjusted by user operations.

[0066] When the icon 203m is selected, a function is executable to draw a closed curve of an arbitrary shape on the image, calculate the perimeter, the area inside the closed curve, and statistical quantities (such as the average value, the maximum value, the minimum value, etc.) of the pixel values inside the closed curve, and display them. Note that the display forms such as the center position, the color, the thickness, and the font of the measured values of the closed curve can be adjusted by user operations. Also, the closed curve may be set to a predetermined shape (circle, ellipse, rectangle, square, triangle, etc.), and the length of each side, the angle formed by two sides, the diameter, the major axis, the minor axis, etc. of the shape may be adjustable, or a free-form shape may be drawnable.

[0067] When the icon 203n is selected, a function is executable to draw an open curve of an arbitrary shape on the image, calculate the perimeter of the open curve, and display it. Note that the display forms such as the center position, the color, the thickness, and the font of the measured values of the open curve can be adjusted by user operations. In addition, three-dimensional figures (sphere, ellipsoid, rectangular parallelepiped, triangular pyramid, etc.) may be settable, and the surface area, the volume, etc. may be calculated and displayed.

[0068] The icon 203o is a checkbox that switches the display and non-display of a reference line indicating the cross-sectional position of another image on the image displayed in the area 202. When the checkbox is selected, the control function 351 switches the display and non-display of the reference line.

[0069] FIG. 4A is a diagram showing an example of a reference line according to the first embodiment. Here, FIG. 4A is an enlarged view of the area 202b in FIG. 3A. For example, the control function 351 causes the vertical reference line and the horizontal reference line shown in FIG. 4A to be displayed by selecting the icon 203o. The vertical reference line in FIG. 4A indicates the cross-sectional position of the image displayed in the area 202c. Also, the horizontal reference line in FIG. 4A indicates the cross-sectional position of the image displayed in the area 202d.

[0070] For example, the control function 351 identifies the position of another image on the image displayed in the area 202b based on the cross-sectional position of each image in the volume data, and arranges a straight line at the identified position, thereby displaying the vertical reference line and the horizontal reference line.

[0071] Here, the reference line according to the present embodiment can receive an operation from the user. For example, the control function 351 changes the display form of the image by receiving a selection operation and a drag-and-drop operation on each reference line, the intersection 301 of the reference lines, the circle mark 302, and the triangle mark 303.

[0072] For example, the user can move the intersection 301 of the reference lines by selecting and dragging the intersection 301 of the reference lines or the surrounding area by operating the mouse. Here, when the intersection 301 is moved, the cross-sectional position indicated by the reference line also changes, and accordingly, the cross-sectional images displayed in the respective areas also change.

[0073] Figure 4B is a diagram for explaining an example of an operation on a reference line according to the first embodiment. Here, Figure 4B is an example screen when the intersection of the reference lines shown in area 202b of Figure 3A is moved to the upper left. For example, when the user moves the intersection 301 of the reference lines to the upper left as shown in area 202b of Figure 4B, the control function 351 identifies the positions of the reference lines after the movement in the volume data based on the positions of the reference lines with respect to the image displayed in area 202b. Then, the control function 351 generates an image with the identified position of each reference line as the cross-sectional position, and displays the generated images in areas 202c and 202d, respectively.

[0074] Also, the user can translate the reference line by selecting the reference line by operating the mouse and dragging and dropping it. For example, the user selects a location other than the circular mark 302 on the reference line and drags and drops it to translate the reference line. Here, when the reference line is translated, the cross-sectional position indicated by the reference line changes, and accordingly, the cross-sectional images displayed in each display area also change.

[0075] Figure 4C is a diagram for explaining an example of an operation on a reference line according to the first embodiment. Here, Figure 4C is an example screen when the horizontal reference line shown in area 202b of Figure 3A is translated downward in area 202b. For example, when the user translates the horizontal reference line downward as shown in area 202b of Figure 4C, the control function 351 identifies the position of the horizontal reference line after the movement in the volume data based on the position of the horizontal reference line with respect to the image displayed in area 202b. Then, the control function 351 generates an image with the identified position of the horizontal reference line as the cross-sectional position, and displays the generated image in area 202d.

[0076] In addition, the user can rotate the reference line by selecting the reference line through operating the mouse and dragging and dropping it in a specific direction. For example, a rotation function is assigned to the circular mark 302 shown on the reference line, and when the user selects and drags and drops the circular mark 302 by mouse operation, the reference line is rotated. Here, when the reference line is rotated, the cross-sectional position indicated by the reference line changes, and accordingly, the cross-sectional images displayed in each display area also change.

[0077] FIG. 4D is a diagram for explaining an example of an operation on the reference line according to the first embodiment. Here, FIG. 4D is an example of a screen when the vertical reference line shown in the area 202b of FIG. 3A is rotated 45 degrees clockwise. When rotating, if there are multiple reference lines, they may be controlled so that the angles formed by them always remain constant, that is, other reference lines operate in conjunction with the operation on one reference line, or they may be made to move independently. When the angles formed by multiple reference lines always remain constant, for example, 180 degrees may be evenly divided based on the number of reference lines (if there are 2 references, they intersect vertically (at 90 degrees), if there are 3 reference lines, they intersect at 60 degrees). FIG. 4D shows the case where the angle formed by two reference lines remains constant (90 degrees).

[0078] For example, when the user rotates the vertical reference line 45 degrees clockwise as shown in the area 202b of FIG. 4D, the control function 351 specifies the positions of the rotated reference lines in the volume data based on the positions of the respective reference lines with respect to the image displayed in the area 202b. Then, the control function 351 generates images with the specified positions of the respective reference lines as cross-sectional positions, and displays the generated images in the areas 202c and 202d, respectively.

[0079] In FIGS. 4C and 4D, the case where translation is performed by selecting a location other than the circular mark 302 on the reference line and rotation is performed by selecting the circular mark 302 was described. However, the embodiment is not limited to this. For example, it may be the case where translation and rotation can be switched by an operation using a keyboard. For example, when an operation of the reference line by the mouse is executed while the Ctrl key is pressed, it may be controlled to be rotation, and when an operation of the reference line by the mouse is executed while the Ctrl key is not pressed, it may be controlled to be translation.

[0080] Also, the user can create a maximum value projection image or a minimum value projection image in a range based on the size of the width specified by using the reference line, and display the projection image in the display area corresponding to the reference line. For example, the user can specify the width by performing an operation of selecting and moving the triangular mark 303 by a mouse operation.

[0081] FIG. 4E is a diagram for explaining an example of an operation on the reference line according to the first embodiment. Here, FIG. 4E shows an example in which a range sandwiched between two triangular marks 303 is specified as the width by moving the triangular mark 303 arranged with respect to the vertical reference line to the left and right. Further, FIG. 4E shows an example in which a range sandwiched between two triangular marks 303 is specified as the width by moving the triangular mark 303 arranged with respect to the horizontal reference line up and down. Further, FIG. 4E shows an example of generating a Mip image of a range based on the size of the width specified by the triangular mark 303.

[0082] For example, as shown in the area 202b of FIG. 4E, when the user moves the triangular mark 303 arranged with respect to the vertical reference line left and right, the control function 351 identifies the positions in the volume data corresponding to the respective vertices on the reference line side of the left and right triangular marks 303 after the movement. Then, the control function 351 sets a plane parallel to the vertical reference line in the volume data passing through the position corresponding to the vertex of the left triangular mark 303. Similarly, the control function 351 sets a plane parallel to the vertical reference line in the volume data passing through the position corresponding to the vertex of the right triangular mark 303. Then, the control function 351 identifies the voxels included between the left plane and the right plane centered on the vertical reference line, and generates a Mip image based on the voxel values of the identified voxels. That is, the control function 351 generates a Mip image with the direction (left - right direction) orthogonal to the vertical reference line as the projection direction and displays it in the area 202c.

[0083] Similarly, when the user moves the triangular mark 303 arranged with respect to the horizontal reference line up and down, the control function 351 identifies the positions in the volume data corresponding to the respective vertices on the reference line side of the upper and lower triangular marks 303 after the movement. Then, the control function 351 sets a plane parallel to the horizontal reference line in the volume data passing through the position corresponding to the vertex of the upper triangular mark 303. Similarly, the control function 351 sets a plane parallel to the horizontal reference line in the volume data passing through the position corresponding to the vertex of the lower triangular mark 303. Then, the control function 351 identifies the voxels included between the upper plane and the lower plane centered on the horizontal reference line, and generates a Mip image based on the voxel values of the identified voxels. That is, the control function 351 generates a Mip image with the direction (up - down direction) orthogonal to the horizontal reference line as the projection direction and displays it in the area 202d.

[0084] Note that the display form of the reference line (color, thickness, type (solid line or dotted line, fineness of the dotted line), etc.) may be set in advance, or it may be made possible for the user to specify. Also, when moving the triangular mark 303 arranged with respect to the vertical reference line, it may be controlled so that the triangular mark 303 arranged with respect to the horizontal reference line also moves by the same width.

[0085] The icon 203p is a check box for switching whether to display an arbitrary 2D cross-sectional image superimposed on an image showing a three-dimensional area such as a VR image or an SR image. When the check box is selected, the control function 351 switches the display and non-display of the superimposition.

[0086] FIG. 5 is a diagram showing an example of the superimposed display of an image according to the first embodiment. For example, when the icon 203p is selected, the control function 351, as shown in FIG. 5, superimposes and displays the cross-sectional image displayed in the region 202b on the VR image occupying each valve leaf of the aortic valve displayed in the region 202a, associating the three-dimensional positions. That is, the control function 351 specifies the position of the cross-sectional image with respect to the VR image based on the positional relationship between the position of the VR image in the volume data and the position of the cross-sectional image in the volume data. Then, the control function 351 arranges the cross-sectional image at the specified position of the VR image to display the superimposed image shown in the region 202a of FIG. 5.

[0087] Note that when superimposing images, as shown in FIG. 5, the control function 351 displays the VR image located in front of the cross-sectional image with respect to the observation direction and does not display the VR image located behind the cross-sectional image.

[0088] In FIG. 5, an example in which a cross-sectional image of region 202b is superimposed on the VR image has been described. However, the embodiment is not limited to this, and the cross-sectional image to be superimposed may be specified by the user. In such a case, for example, it may be specified using a context menu displayed by right-clicking on each region where the cross-sectional image is displayed. Also, a region to be the cross-section to be superimposed may be determined in advance (for example, using region 202b as that region), and control may be performed so as to superimpose the cross-sectional image displayed in that region.

[0089] Here, when superimposing a cross-sectional image on the VR image, the control function 351 adjusts the cross-sectional position and size of the cross-sectional image according to the position and magnification of the VR image, but other display conditions (such as window conditions) in the cross-sectional image may be made to match the display conditions of the VR image. Also, the conditions to be made to match between the images may be fixed conditions determined in advance. Note that when the display conditions of the superimposed cross-sectional image are changed (such as slice feed) in a state where the superimposed display is set, the control function 351 also changes the display conditions of the cross-sectional image superimposed on the VR image in conjunction. For example, when a slice feed operation is performed on the cross-sectional image displayed in region 202b, the control function 351 sequentially switches the cross-sectional image superimposed and displayed on the VR image to the cross-sectional images sequentially switched by the slice feed operation.

[0090] The icon 203q is a button that can return the display states of region 202 and region 204 to a specific display state. When the button is pressed, the control function 351 returns the display states of region 202 and region 204 to a specific display state. Here, the specific state is, for example, the state at the time of app startup, the state when the image was first displayed in each region, or the state before a specific number of operations.

[0091] For example, the control function 351 records the display conditions and display forms in the specific state described above, and restores them in response to the pressing of the icon 203q. Alternatively, the control function 351 may record the display conditions and display forms in a certain period respectively, so that the display states after the previous or subsequent operation can be restored continuously (for example, forward and backward buttons).

[0092] The icon 203r is a button for displaying a setting screen for setting the display conditions of an area for overlapping a three-dimensional area such as a VR image or an SR image, or an area on a two-dimensional image. For example, when the user selects the icon 203r by a mouse operation, a setting screen for setting the display conditions of an area indicating each valve leaf in the VR image of the valve leaf of the aortic valve displayed in the area 202a of FIG. 3A, or an area indicating each valve leaf in the cross-sectional images displayed in the areas 202b to 202d is displayed. Note that the position information of the area of each valve leaf is specified in step S102.

[0093] FIGS. 6A and 6B are diagrams showing an example of a setting screen for display conditions according to the first embodiment. For example, as shown in FIG. 6A, the setting screen includes setting items related to "Priority", "Color", "Transparency", "VR", "MPR", and "Area Name".

[0094] "Priority" is set for the display priority of the specified area (specified from the combo box of "Area Name" on the right). For example, it indicates that the higher the area specified on the setting screen, the higher the display priority. When multiple areas correspond to the same coordinates on the image, the area with the higher priority is displayed.

[0095] "Color" is the color assigned for the superimposed display on the VR image or cross-sectional image of the corresponding area (specified from the combo box of "Area Name" on the right). For example, color samples are displayed for "Color". For example, when the user selects the area indicating the sample color, the control function 351 will display a color map and an RGB value input box as shown in FIG. 6B. The user can assign any color to the target area by selecting a color from the color map or inputting an RGB value.

[0096] Also, "Transparency" is the transparency of the superimposed display on the VR image or cross-sectional image of the corresponding area (specified from the combo box of "Area Name" on the right). For example, "Transparency" can be specified in 1% increments from 0 to 99% using a slider bar. When it is 0%, the superimposed display is made in a state where it does not transmit at all (that is, the background image cannot be seen). Although not shown in FIGS. 6A and 6B, it is also possible to set display conditions such as saturation and brightness, or it is also possible to set textures instead of colors. Also, by selecting the "Link" checkbox in the lower left of the figure, all transparencies can be set together. Here, when linking, it may be controlled to set all transparencies to the same value, or it may be controlled to increase or decrease the transparency as a whole while maintaining the relationship of the transparency values corresponding to each area when the "Link" checkbox is selected.

[0097] "VR" is a checkbox for specifying the area to be displayed on the VR image. Also, "MPR" is a checkbox for specifying the area to be displayed on the MPR image. Although not shown in FIGS. 6A and 6B, a button may be set that can simultaneously check or uncheck all checkboxes for "VR" or "MPR".

[0098] The "region name" is the region that is displayed according to the set priority and display conditions. For example, the user specifies the region through the combo box arranged in the column of the "region name". Note that it may be controlled so that the same region cannot be set in multiple combo boxes (for example, when a region already set in another combo box is specified in a certain combo box, control it so that it cannot be specified, or cancel the setting of the existing combo box), and it may be controlled so that the setting can be made and the setting with the higher priority is preferentially used. In FIG. 6A, the calcified region is set to be displayed in white, the LCC (Left Coronary Cusp) of the aortic valve in green, the RCC (Right Coronary Cusp) in blue, the NCC (Non Coronary Cusp) in yellow, on the VR image and the MPR image.

[0099] "Close" is a button for hiding this setting screen, and "Reset" is a button for returning the setting state to the initial state. Note that the timing for reflecting the display conditions set by this setting screen in each region may be to reflect the set conditions immediately after each condition is set, or may be reflected all at once after the "Close" button is selected.

[0100] (Analysis result display) Region 204 includes region 204a and region 204b, and the analysis result is displayed. For example, the control function 351 calculates a value (measurement value) indicating the characteristics (measurement items) of the target region based on each target region specified in step 102, and displays it in region 204. In region 204a, the analysis result is displayed as a graph, and in region 204b, the analysis result is displayed as a list showing the relationship between various measurement item names and measurement values.

[0101] Here, the measurement items include, for example, morphological features of each valve leaf (e.g., "area", "effective Height", "geometric Height", "Free Margin Length", "cusp insertion Length", "commissural Height", "valve orifice area", etc.), relational features of each valve leaf (e.g., "coaptation Height", "commissural Distance"), morphological features of the ascending aorta including the Valsalva sinus (e.g., features with respect to the contour of the cross-section of the ascending aorta such as "Annular ring", "Commissure ring", "ST junction ring", "Valsalva ring", "Basal ring", etc. ("Area", "Perimeter", "Circularity", "Aspect ratio", "major axis diameter", "minor axis diameter", etc.)), and relational features of the relationship with the inlet of the coronary artery (e.g., "coronary ostium Height"), etc.

[0102] For example, based on the area of each valve leaf of the aortic valve identified in step 102, the control function 351 specifies the coordinates of the "Nadir", which is the position closest to the LVOT (Left Ventricular Outflow Tract) side, for each valve leaf (RCC, LCC, NCC). Then, the control function 351 extracts the cross-section passing through the "Nadir" of each valve leaf (hereinafter, the Nadir cross-section) and calculates the "effective Height", which is the straight-line distance from the cross-section to the position of "Arantius". Note that "Arantius" is located at the center of the tip of each valve leaf.

[0103] Further, based on the regions of each valve leaf of the aortic valve identified in step 102, the control function 351 can calculate the "geometric Height", which is the distance along the surface of the valve leaf from "Nadir" to "Arantius", or extract the commissures of each valve leaf respectively, and calculate the "commissural Distance", which is the straight-line distance between each commissure.

[0104] For example, the control function 351 causes a graph of the calculated measurement values to be displayed in the region 204a. FIGS. 7A, 7B, and 7C are diagrams showing an example of a graph according to the first embodiment. Here, FIGS. 7A and 7B show a line graph representing the relationship between the measurement values and the cardiac phases, with the vertical axis representing the values of the measurement values and the horizontal axis representing the cardiac phases. FIG. 7C shows a radar chart representing the characteristics of the valve leaf at an arbitrary cardiac phase.

[0105] For example, the control function 351 calculates the "effective Height" and the "geometric Height" at each cardiac phase based on the regions of the valve leaf of the aortic valve identified in each volume data corresponding to each cardiac phase. Then, the control function 351 generates and displays each graph based on the calculated results.

[0106] Here, as shown in FIG. 7A, the control function 351 can generate and display a graph showing a plurality of measurement items for any one valve leaf (LCC in FIG. 7A). Further, the control function 351 can generate and display a plurality of graphs for graph display of all valve leaves (LCC, RCC, NCC).

[0107] In addition, as shown in FIG. 7B, the control function 351 can display the relationship with each valve leaf for a single measurement item (in FIG. 7B, "geometric Height") within the same graph. Note that the display of the line graph is not limited to the formats of FIGS. 7A and 7B, and it may also be the case where FIGS. 7A and 7B are combined and the values of a plurality of measurement items for each valve leaf are displayed on one graph. In such a case, the control function 351 can generate a graph in which the valve leaf or measurement item with the same broken line is represented by the same system color.

[0108] In addition, as shown in FIG. 7C, the control function 351 can generate and display a radar chart showing the characteristics of each valve leaf (LCC, RCC, NCC) at an arbitrary cardiac phase.

[0109] Note that the form of the graph may also be controlled so as to be a form suitable for each measurement item. In such a case, for example, the relationship between the measurement item and the graph form is preset and stored. The control function 351 displays a check box to the left of the list of measurement items displayed in the area 204b, and when a check is given to the check box, the measurement results of the measurement items with the check are displayed in a preset graph form.

[0110] Also, the display form such as the color and thickness of the line graph may be settable by the user, or may be changed in accordance with the display form of each valve leaf set on the setting screen shown in FIG. 6A.

[0111] In addition, as shown in FIG. 7A, the control function 351 can display the straight line 601 at the position on the graph corresponding to the cardiac phase of the image displayed in the area 202, and control to change the image displayed in the area 202 to the corresponding image as the straight line 601 moves left and right (in the cardiac phase direction) within the graph based on the user's operation. In such a case, the control function 351 generates a VR image or a cross-sectional image from the volume data corresponding to the cardiac phase after the movement of the straight line 601 and displays it in the area 202.

[0112] Further, when the button 204c is selected, the control function 351 can output a file in a format such as CSV to a storage area on a computer specified by the user, which shows the relationship between the measured values in various measurement items and the cardiac phase or slice.

[0113] The controller 205 is a controller for cine display. The controller 205 is set with a play button, a stop button, a speed increase button, a speed decrease button, a button to return to the start image, a button to advance to the final image, a button to advance to the image of the next cardiac phase, a button to advance to the image of the previous cardiac phase, etc. The controller controls so that the functions assigned to various buttons are executed when the user specifies them by an operation such as a mouse click. Note that the display order during cine display may be determined based on the selection order of thumbnails, or may be determined based on the imaging date and time order obtained from a DICOM header or the like, or the order of cardiac phases set based on the R-R interval. Further, when the user gives some instruction to the image during cine display (such as slice feed, translation, magnification change, rotation change, measurement by various measurement functions), the controller may be made non-displayable.

[0114] (Extraction process of the target structure) As described in step S102 of FIG. 2, the extraction function 353 extracts a target region from the volume data. Specifically, the extraction function 353 acquires the coordinate information of the pixels indicating the aortic valve in the CT image. Here, the extraction function 353 can extract the target region by various methods. For example, the extraction function 353 can extract the region specified on the CT image via the input interface 32 as the target region. That is, the extraction function 353 extracts the region manually specified by the user as the target region.

[0115] Further, for example, the extraction function 353 can extract a region of interest based on the anatomical structure depicted in the CT image by a known region extraction technique. For example, the extraction function 353 uses the Otsu binarization method, region expansion method, snake method, graph cut method, mean shift method, etc. based on CT values to extract the region of interest in the CT image.

[0116] In addition, the extraction function 353 can also extract the region of interest in the CT image using a pre-trained model constructed based on the training data prepared in advance using machine learning techniques (including deep learning).

[0117] Here, when processing such as the graph cut method is performed on the entire image, the computational cost may become excessively high. Therefore, the extraction function 353 can also target for extraction processing a region related to the region of interest and larger than the region of interest but smaller than the entire image (hereinafter referred to as the related region). For example, when the region of interest is the aortic valve, the extraction function 353 identifies, as the region of interest, the heart region, the left ventricle, and the regions around the left ventricle. Then, the extraction function 353 applies the above-described extraction processing only to the identified related region to extract the region of interest. Note that the related region may also be set manually using the input interface 32.

[0118] Also, the regions around the region of interest may be extracted by the same method. For example, the extraction function 353 may extract not only the aortic valve leaflets but also the region of the ascending aorta starting from the Valsalva sinus, regions indicating cardiac chambers such as the left atrium, left ventricle, right atrium, and right ventricle, and the LVOT region. Further, the extraction function 353 may be specified based on the region extracted for the characteristic points in the aortic valve or the surrounding regions. For example, the extraction function 353 may specify positions such as "Nadir", "Commissure", and "coronary artery inlet".

[0119] (Initial cross-section position identification process) As described in step S103 of FIG. 2, the specific function 354 identifies the regions of each valve leaf (LCC, RCC, NCC) based on the region of the aortic valve or the extraction result of the feature points, and identifies the initial cross-sectional positions where each of the identified valve leaves is easy to observe. Specifically, for each valve leaf, the specific function 354 sets a cross-section perpendicular to the Nadir cross-section (i.e., the cross-section passing through the three Nadirs), and identifies the set cross-section as the initial cross-sectional position.

[0120] FIG. 8 is a diagram for explaining an example of the specific process of the initial cross-sectional position according to the first embodiment. Note that FIG. 8 schematically shows the identification of the initial cross-sectional position for each valve leaf of the aortic valve. For example, as a method of setting a cross-section where the NCC is easy to observe, the specific function 354 first identifies the position 705 of the midpoint of the line segment 704 connecting the Commissure position 701 between the NCC and the RCC and the Commissure position 702 between the NCC and the LCC in FIG. 8. Then, the specific function 354 sets a cross-section perpendicular to the Nadir cross-section as the initial cross-section of the cross-section where the NCC is easy to observe through the straight line 706 connecting the Commissure position 703 between the RCC and the LCC and the midpoint position 705.

[0121] Similarly, as a method of setting a cross-section where the LCC is easy to observe, the specific function 354 first identifies the position 707 of the midpoint of the line segment 708 connecting the Commissure position 703 between the LCC and the RCC and the Commissure position 702 between the LCC and the NCC in FIG. 8. Then, the specific function 354 sets a cross-section perpendicular to the Nadir cross-section as the initial cross-section of the cross-section where the LCC is easy to observe through the straight line 709 connecting the Commissure position 701 between the NCC and the RCC and the midpoint position 707.

[0122] Similarly, as a method for setting an easily observable cross-section of the RCC, the specific function 354 first identifies the position 710 of the midpoint of the line segment 711 that connects the Commissure position 701 between the RCC and the NCC and the Commissure position 703 between the RCC and the LCC in FIG. 8. Then, the specific function 354 sets, as the initial cross-section of the easily observable cross-section of the RCC, a cross-section perpendicular to the Nadir cross-section passing through the straight line 712 that connects the Commissure position 702 between the NCC and the LCC and the midpoint position 710.

[0123] In the case of the above-described method, the three initial cross-section positions may not intersect at a single point. If they do not intersect at a single point, inconveniences may occur in subsequent steps. Therefore, as a method for setting the last cross-section (for example, an easily observable cross-section of the RCC), the position 710 of the midpoint of the line segment 711 that connects the Commissure position 701 between the RCC and the NCC and the Commissure position 703 between the RCC and the LCC is identified, and a straight line that connects the intersection point 713 of the previously identified straight lines 706 and 709 and the midpoint position 710 is set as the straight line 712. Then, a cross-section perpendicular to the Nadir cross-section passing through the straight line 712 may be set as the initial cross-section of the easily observable cross-section of the RCC. The above-described method is merely an example, and any method may be used to identify the cross-section position.

[0124] (Valve leaf determination process) As described in step S104 of FIG. 2, the determination function 355 determines the valve leaf that is easily observable at the set cross-section position. Specifically, the determination function 355 determines the type of valve leaf included in the set cross-section. For example, the determination function 355 determines the range to be determined for the type in the cross-section based on the structural information of a plurality of valve leaves, calculates an index using the information included in the determined range, and determines the type of valve leaf based on the calculated index.

[0125] FIG. 9 is a diagram for explaining an example of the determination process of the valve leaf according to the first embodiment. Here, FIG. 9 schematically shows the determination of the type of the valve leaf included in the cross section set in FIG. 8. For example, the determination function 355 determines the type of the valve leaf that is easy to observe for the cross section passing through the straight line 706 and perpendicular to the Nadir cross section, the cross section passing through the straight line 709 and perpendicular to the Nadir cross section, and the cross section passing through the straight line 712 and perpendicular to the Nadir cross section, respectively.

[0126] Here, the determination function 355 determines the range to be the determination target of the type for each cross section. For example, the determination function 355 determines the range 715 as the range to be the determination target of the type in the cross section passing through the straight line 706 and perpendicular to the Nadir cross section. The range 715 is the range on the side that does not include the Commissure position 703 with the intersection point 713 as the boundary in the cross section passing through the straight line 706 and perpendicular to the Nadir cross section (that is, the range perpendicular to the Nadir cross section passing through the range 715). Similarly, the determination function 355 determines the range 714 as the range to be the determination target of the type in the cross section passing through the straight line 709 and perpendicular to the Nadir cross section, and determines the range 716 as the range to be the determination target of the type in the cross section passing through the straight line 712 and perpendicular to the Nadir cross section.

[0127] In this way, the determination function 355 determines, for each of the three cross sections set as the initial cross sections, the range that does not include the Commissure position among the two ranges with the intersection point 713 as the boundary as the range to be the determination target of the type.

[0128] Then, the determination function 355 calculates an index for determining the valve leaf for each of the three cross sections with the determined range as the target. For example, the determination function 355 calculates the size (number of pixels) indicated by the area of each valve leaf in the determined range, and determines the type of the valve leaf based on the calculated value.

[0129] For example, for the region corresponding to the range 715 in the cross-sectional image indicated by the straight line 706, the determination function 355 calculates the number of pixels corresponding to the region of each valve leaf, and determines that the valve leaf indicated by the region with the largest number of pixels is the valve leaf that is easy to observe in the cross-sectional image indicated by the straight line 706. Here, at the initial cross-sectional position shown in FIG. 9, the valve leaf that is easy to observe in the cross-sectional image indicated by the straight line 706 is determined as the NCC.

[0130] Similarly, for the region corresponding to the range 714 in the cross-sectional image indicated by the straight line 709, the determination function 355 calculates the number of pixels corresponding to the region of each valve leaf and determines the valve leaf that is easy to observe. Further, for the region corresponding to the range 716 in the cross-sectional image indicated by the straight line 712, the determination function 355 calculates the number of pixels corresponding to the region of each valve leaf and determines the valve leaf that is easy to observe.

[0131] In the example described above, the case where the range for calculating the number of pixels is determined based on the Commissure position has been described. However, the embodiment is not limited to this, and the range for calculating the number of pixels may be determined based on other positions. In FIG. 9, in order to determine the range for the initial cross-sectional position, among the two ranges with the intersection point 713 as the boundary, one includes the Commissure position, but when the position of the cross-section is moved (for example, when three cross-sections are rotated), the Commissure position may not be included in the cross-section.

[0132] Therefore, the determination function 355 may determine the range using, for example, a line segment connecting the Commissure positions, the midpoint of the line segment, etc. As an example, the determination function 355 may determine the range based on the angle of the straight line indicating the cross-section with respect to the line segment connecting the Commissure positions, the distance between the midpoint of the line segment and the straight line indicating the cross-section, etc.

[0133] Figures 10A and 10B are diagrams for explaining an example of a determination process for a determination target range according to the first embodiment. Here, Figures 10A and 10B show states in which a cross-section perpendicular to the Nadir cross-section passing through the straight line 706 in Figure 9, a cross-section perpendicular to the Nadir cross-section passing through the straight line 709, and a cross-section perpendicular to the Nadir cross-section passing through the straight line 712 are each rotated clockwise about the intersection point 713. Further, Figure 10A shows a case where the type of valve leaf that is easy to observe is determined using the angle of the straight line indicating the cross-section with respect to the line segment connecting the Commissure positions. Further, Figure 10B shows a case where the type of valve leaf that is easy to observe is determined using the distance between the midpoint of the line segment connecting the Commissure positions and the straight line indicating the cross-section.

[0134] For example, for the cross-section perpendicular to the Nadir cross-section passing through the straight line 706 shown in Figure 10A, the determination function 355 extracts line segments (line segment 704 and line segment 711) connecting the Commissure positions that intersect the straight line 706. Then, the determination function 355 calculates the angle of the straight line 706 with respect to each of the extracted line segments, and determines the range on the side where the angle is close to 90 degrees out of the two ranges with the intersection point 713 as the boundary as the range for which the number of pixels is to be calculated. For example, the determination function 355 calculates the angles "θ1" and "θ2" shown in Figure 10A, respectively, and determines the range 717 on the "θ1" side where the angle is close to 90 degrees as the range to be the determination target for the type. The determination function 355 similarly determines the range to be the determination target for the type for the cross-section perpendicular to the Nadir cross-section passing through the straight line 709 and the cross-section perpendicular to the Nadir cross-section passing through the straight line 712.

[0135] Further, for example, the determination function 355 extracts line segments (line segment 708 and line segment 711) connecting Commissure positions that intersect the straight line 712 for a cross-section perpendicular to the Nadir cross-section passing through the straight line 712 shown in FIG. 10B. Then, the determination function 355 calculates the distance between the midpoint of each extracted line segment and the straight line 712, and determines, as the range to calculate the number of pixels, the range on the shorter-distance side of the two ranges with the intersection point 713 as the boundary. For example, the determination function 355 calculates the distances "D1" and "D2" shown in FIG. 10B, respectively, and determines the range 718 on the "D2" side with the shorter distance as the range to be the subject of type determination. The determination function 355 similarly determines, as the range to be the subject of type determination, for a cross-section perpendicular to the Nadir cross-section passing through the straight line 706 and for a cross-section perpendicular to the Nadir cross-section passing through the straight line 709.

[0136] (Display form setting process) As described in step S105 of FIG. 2, the control function 351 sets the display form regarding the valve leaf and the display form regarding the information of the display cross-section. Specifically, the control function 351 determines the display form regarding the display cross-section based on the display form of each of the plurality of valve leaves and the determination result of the type of valve leaf included in the cross-sectional image. For example, the control function 351 refers to the display form (such as color) of each valve leaf set on the setting screen shown in FIG. 6A, and determines to match the display form of the information regarding the cross-sectional image in which the corresponding valve leaf is easy to observe with the display form set on the setting screen. As an example, the control function 351 sets the display form so as to match the display form (such as color) of the LCC set on the setting screen shown in FIG. 6A and the display form of the information regarding the cross-sectional image in which the LCC is easy to observe.

[0137] Here, as information regarding the cross-sectional image, the control function 351 targets, for example, reference information indicating the position of the cross-section and the display area of the cross-sectional image. For example, the control function 351 sets the display form of the reference line indicating the position of the cross-section and the display area frame of the cross-sectional image so as to have the same display form as the display form of the valve leaf. Thereby, the relationship between the reference line, the display area, and the valve leaf becomes easy to understand. More specifically, for example, when it is set to display the area of the LCC in red, the color of the reference line indicating the cross-section determined as an easy-to-observe cross-section of the LCC and the color of the frame of the display area for displaying the cross-section are also set to red in the same manner.

[0138] In addition, when a plurality of cross-sections are determined to be cross-sections where the same valve leaf is easy to observe, the reference lines indicating those cross-sections, the frames of the display areas for displaying the cross-sections, etc. may be set to the same display form, but in order to distinguish them, by comparing the indexes (pixel count in this embodiment) used in the determination of step S104, different display forms may be set based on the magnitudes of the indexes. That is, by changing some system values such as brightness, transmittance, and RGB values based on the magnitudes of the indexes, it is possible to set different display forms within the same system. That is, when it is determined in the determination result of the type that a plurality of cross-sections include the same valve leaf, the control function 351 determines the display form of the information regarding the cross-section based on the determination result of the type and each index calculated from each cross-section.

[0139] In addition, any display form may be set based on the determination in step 104. For example, the indexes (pixel count in this embodiment) used in the determination in step 104 may be compared for each cross-section, and the size of the display area may be changed based on the magnitudes of the indexes.

[0140] (Display process of cross-sectional image) As described in step S106 of FIG. 2, the control function 351 displays the cross-sectional image based on the display form set in step S105. For example, the control function 351 displays the reference line and the display area frame of the cross-section in a display form associated with the display form of the valve leaf.

[0141] FIG. 11A is a diagram showing an example of display processing according to the first embodiment. For example, as shown in FIG. 11A, the control function 351 represents the color of the reference line 810a indicating a cross section that is easy for the NCC to observe and the color of the frame 811a of the region 801 for displaying the cross section in the same color (for example, green) as the color representing the NCC region 812a in the VR image. Similarly, the control function 351 represents the color of the reference line 810b indicating a cross section that is easy for the RCC to observe and the color of the frame 811b of the region 802 for displaying the cross section in the same color (for example, orange) as the color representing the RCC region 812b in the VR image. Similarly, the control function 351 represents the color of the reference line 810c indicating a cross section that is easy for the LCC to observe and the color of the frame 811c of the region 803 for displaying the cross section in the same color (for example, light blue) as the color representing the LCC region 812c in the VR image. Further, as shown in the region 804, the control function 351 can also display, by overlaying, a character string indicating a cross section that is easy to observe in each region. Also, the control function 351 can similarly display the color of the character string.

[0142] As described above, the reference line according to the present embodiment can receive various operations. Hereinafter, regarding the operations on the reference line in the display screen, differences from the content described in step S101 will be described. Since this is merely an explanation of the operation system, the explanation of the change in the display form (after step S107) due to the change in the cross section position by the operation of the reference line will be omitted here.

[0143] FIGS. 11B to 11D are diagrams showing an example of display processing according to the first embodiment. Here, FIG. 11B is an example of a screen when the intersection of the three reference lines (810a, 810b, 810c) is moved to the upper left of the screen. Thus, when the intersection of the reference lines (810a, 810b, 810c) is moved, as described in FIG. 4B, the cross-sectional images displayed in the regions 801 to 803 change.

[0144] Here, since this screen is for observing the region of interest (aortic valve), control may be performed to limit the movement range of the intersection. Specifically, the control function 351 controls the setting range of the display cross-section related to the heart valve based on the extraction result of the region corresponding to the heart valve. For example, the control function 351 determines the control range based on the valve leaflets and the region or feature points indicating the surrounding structure extracted in step S102. As an example, the control function 351 identifies the region indicating the Valsalva sinus shown by the curve 805 based on the extraction result in step S102, and controls so that the intersection cannot move outside the identified region.

[0145] FIG. 11C is an example when the reference line 810b showing a cross-section for easily observing the RCC is translated downward in parallel. Here, the control function 351 receives a setting for moving the position of at least one of the plurality of display cross-sections related to the heart valve, and in the display of the reference lines indicating the positions of the plurality of cross-sections, the reference line indicating the position before movement of the cross-section whose position has been moved and the reference line indicating the position after movement are each displayed in a similar display form.

[0146] For example, in order to maintain the display of the position of the intersection of the three reference lines, the control function 351 does not move the original reference line 810b, but displays a reference line 810d in a display form (same color, etc.) similar to the original reference line 810b at the moved position. The same control is performed when slicing and feeding (browsing) the region 802. That is, the control function 351 displays both the reference line 810b indicating rotation and the reference line 810d indicating the cross-section position.

[0147] FIG. 11D is an example of a screen when a reference line 810b, which shows a cross-section for easily observing the RCC from the state of FIG. 11C, is moved 45 degrees clockwise. Here, the control function 351 receives a rotation operation of the displayed cross-section whose position has been moved by the reference line 810b indicating the position before the movement, and in a state where the positional relationship between the reference line 810b indicating the position before the movement and the reference line 810d indicating the position after the movement is maintained, the reference line 810b indicating the position before the movement and the reference line 810d indicating the position after the movement are displayed at a position corresponding to the rotation operation. That is, when a rotation operation is added after a translation, the control function 351 rotates while maintaining the relationship between the two reference lines (while being parallel and maintaining the distance between the lines).

[0148] Note that, as shown in FIG. 11D, when a translation is added to the reference line 810b, both the reference line 810b indicating rotation and the reference line 810d indicating the cross-section position are displayed. However, the display forms of both of these reference lines may be adjusted to the display form set in step S105, or only one of them may be adjusted.

[0149] Here, supplementary explanation is given regarding the display conditions of each cross-sectional image in regions 801 to 803. The cross-sectional images in regions 801 to 803 should be displayed so that they are easy to compare. Therefore, the control function 351 adjusts the display positions of a plurality of cross-sections related to the heart valve based on the morphological information of the heart valve. For example, when displaying a plurality of cross-sectional images, the control function 351 applies a certain rotation to the cross-sectional images.

[0150] FIG. 12 is a diagram for explaining an example of the display process of the cross-sectional image according to the first embodiment. For example, the control function 351 specifies the position of the "Nadir" of each valve leaf based on the attention region extracted in step S102. Then, as shown by the straight line 900 in FIG. 12, the control function 351 controls the display so that the position of the "Nadir" is in the same direction and position for each region. Note that the control function 351 can also control so that the valve leaf determined to be easy to observe is displayed on the left side.

[0151] (Cross-section position change processing) As described in step S107 of FIG. 2, the control function 351 can receive the movement of the position of the cross-sectional image displayed in step S106. Here, when receiving the movement of the position of the cross-sectional image, the process returns to step S104 to determine the cross-section position.

[0152] (End determination processing) As described in step S108 of FIG. 2, the control function 351 determines whether the user has finished fluoroscopy. For example, the control function 351 determines whether the fluoroscopy has ended by the user designating a fluoroscopy end button (not shown), etc.

[0153] (Modification Example 1) In the above-described embodiment, in steps S104 and S105, each cross-section was determined based on the valve leaf region, and the display form such as the color of the reference line was determined. However, the embodiment is not limited to this, and the display form may be determined using other information as well. Specifically, the control function 351 determines the display form of the information regarding the cross-section based on the properties of the valve leaf in addition to the display form and the type determination result of each of the plurality of valve leaves.

[0154] For example, the control function 351 further changes the display form based on the properties of the easily observable valve leaf specified in step S104. For example, in the case of a cross-section where calcification exists in an easily observable valve leaf, the control function 351 may change the thickness of the reference line. Note that the control function 351 is not limited to the thickness, and can also be a display form that surrounds the reference line situation with another color, or can change the form of the reference line (solid line, dotted line, fineness of the dotted line, etc.). Thereby, the user can grasp the properties of the valve leaf such as the presence or absence of calcification in the cross-section by observing the reference line.

[0155] Here, an example of the specific process of calcification of the valve leaf by the control function 351 will be described with reference to FIGS. 13A, 13B, and 14. FIGS. 13A and 13B are diagrams showing an example of volume data according to Modification 1. FIG. 14 is a diagram for explaining an example of the specific process of calcification according to Modification 1.

[0156] As shown in FIGS. 13A and 13B, in this modification, for the sake of simplicity of explanation, it is assumed that the image acquisition function 352 has acquired an image data set of volume data including eight slice images S1 to S8 arranged in order in the cranio-caudal direction, and each slice image includes 10 pixels in the X direction and 10 pixels in the Y direction.

[0157] The control function 351 identifies the calcified region for the eight slice images S1 to S8. Here, the identification of the calcified region is appropriately performed by a known method. For example, as shown in FIG. 14, the control function 351 identifies the calcified regions (pixels marked in black in FIG. 14) for the eight slice images S1 to S8 respectively, thereby identifying the calcified region of the entire volume data.

[0158] Then, the control function 351 identifies the position of the cross-sectional image in the volume data and determines whether the cross-sectional image includes a calcified region. For example, as shown in FIG. 14, the control function 351 determines that the cross-section indicated by the reference line L1 in FIG. 14 includes calcification (pixels marked in black) at the corresponding positions of the slice image S2 and the slice image S8. In this case, the control function 351 changes the display form of the reference line L1. For example, as shown in FIG. 14, the control function 351 changes the thickness of the reference line L1 or surrounds the frame of the reference line with red.

[0159] On the other hand, since the cross-sections indicated by the reference line L2 and the reference line L3 in FIG. 14 do not include calcification, the control function 351 does not change the display form for any of the reference lines.

[0160] Regarding the additional display forms determined in this modification example, they may or may not be reflected and displayed in step S106. That is, even if only the color of the frame of the display area is reflected and the changes in the display form (thickness, frame color, solid line or dotted line, etc.) due to the presence or absence of calcification are not reflected. Also, the properties of the valve leaf are not limited to calcification, and the positions of abnormal forms such as holes or tears in the valve leaf may be detected, and the display form may be controlled to be changed when the abnormal form exists in each cross-section.

[0161] (Modification Example 2) In the above-described embodiment, the case of moving the reference line in the slice direction has been described. However, the embodiment is not limited to this, and the reference line may be moved in any direction. FIGS. 15A and 15B are diagrams showing an example of the movement of the reference line according to Modification Example 2.

[0162] The control function 351 accepts the movement of the cross-section to a position based on the position of the tip of the joint in the heart valve. For example, the control function 351 acquires the positions of the tips of the joints of each valve leaf based on the extraction result of the region of interest (heart valve) in step S102. By way of example, as shown in FIG. 15A, the control function 351 acquires the positions 1001 to 1005 of the tips of the joints of the valve leaf. Note that in FIG. 15A, for the sake of convenience of explanation, the case of acquiring five positions of the tips of the joints is shown, but the embodiment is not limited to this, and any number can be acquired. Also, in FIG. 15A, for the sake of convenience of explanation, the positions of the tips of the joints are shown on the plane in the figure, but actually, the positions of the tips of the joints are different positions in the depth direction of the figure.

[0163] As shown in FIG. 15A, when the position of the tip of the joint is acquired, the control function 351 identifies the line segment connecting each tip to the tip, and identifies the identified line segment or the line segment obtained by vertically projecting the line segment onto the observation cross-section (the cross-section shown in FIG. 15A). For example, the control function 351 identifies the line segment 1006 obtained by vertically projecting the line segment connecting the position 1001 and the position 1002 onto the observation cross-section. Similarly, the control function 351 identifies each line segment obtained by vertically projecting the line segment connecting each pair of positions onto the observation cross-section. Note that the line segment connecting the tips to the tips may be a straight line connecting between the two closest tips, or may be a curve connecting the positions of a plurality of tips using a known numerical analysis technique such as spline interpolation.

[0164] Then, the control function 351 moves the reference line in the direction orthogonal to each identified line segment. For example, the control function 351 moves the reference line L4 to the position of the line segment L5 orthogonal to the line segment 1006. Similarly, the control function 351 moves the reference line L4 in the direction orthogonal to each identified line segment.

[0165] In addition, the control function 351 accepts the movement of the cross-section to a position based on the position of the valve leaf included in the cross-section. For example, the control function 351 acquires the position of each valve leaf included in the cross-sectional image. As an example, as shown in FIG. 15B, the control function 351 acquires the curve 1007 indicating the position on the joint side of one valve leaf in the cross-sectional image. Then, the control function 351 moves the reference line L4 in the direction perpendicular to each position of the acquired curve 1007. For example, the control function 351 moves the reference line L4 to the positions of the line segments L6 and L7 orthogonal to each position along the curve 1007.

[0166] (Modification 3) The display area of the image described in the above-described embodiment may be set in size depending on the operation on the reference line or the display state of the VR image. FIGS. 16A and 16B are diagrams showing an example of the change of the display area according to Modification 3.

[0167] For example, the control function 351 sets the size of the display area of the cross-sectional image according to operations on the reference lines 810a to 810c shown in FIG. 16A. For example, the user performs operations such as rotation and translation on the reference line 810b indicating a cross-section where the RCC is easy to observe. In such a case, as shown in FIG. 16A, the control function 351 sets the area 802 for displaying the cross-sectional image where the RCC is easy to observe to a larger size than the other display areas (area 801 and area 803), and causes the cross-sectional image where the RCC is easy to observe to be displayed in the set area 802.

[0168] Also, for example, the control function 351 sets the size of the display area of the cross-sectional image according to the display state of the VR image displayed in the area 813 of FIG. 16B. For example, the control function 351 determines the area displayed closest to the screen in the VR image displayed in the area 813, and sets the display area for displaying the cross-section where the determined area is easy to observe to a larger size than the other display areas. For example, as shown in FIG. 16B, when the area displayed closest to the screen in the VR image of the area 813 is the RCC area 812b, the control function 351 sets the area 802 for displaying the cross-sectional image where the RCC is easy to observe to a larger size than the other display areas (area 801 and area 803), and causes the cross-sectional image where the RCC is easy to observe to be displayed in the set area 802.

[0169] Note that the display state of the VR image may be used not only on the side closest to the screen but also when the size of the displayed valve leaf area is used. In such a case, for example, the control function 351 calculates the sizes of the respective valve leaf areas (NCC area 812a, RCC area 812b, LCC area 812c) in the VR image displayed in the area 813. Then, the control function 351 sets the area for displaying the cross-sectional image of the valve leaf with the largest size among the calculated sizes to a larger size than the other display areas.

[0170] (Modification Example 4) In the above-described embodiment, the case where the aortic valve of a normal tricuspid valve is the target has been described. However, the embodiment is not limited thereto, and for example, the case where a quadricuspid aortic valve is the target may also be applicable. In such a case, the medical image processing apparatus 3 displays, for each of the four valves, in association with each other, the display form of the valve leaflets and the display form of the information regarding the display cross-section (reference line and display area frame).

[0171] As described above, according to the first embodiment, the image acquisition function 352 acquires volume data including at least a heart valve. The extraction function 353 extracts the region corresponding to the heart valve included in the volume data. The identification function 354 identifies each of the plurality of valve leaflets included in the heart valve. The control function 351 causes each of the plurality of valve leaflets to be displayed in a different display form. The control function 351 receives the setting of the display cross-section regarding the heart valve. The control function 351 sets the information regarding the display cross-section to be a display form associated with the display form of the valve leaflet corresponding to the position of the set display cross-section among the plurality of valve leaflets. Therefore, the medical image processing apparatus 3 according to the first embodiment can display, in association with each other, the display form of the valve leaflets and the information regarding the display cross-section that facilitates the observation of the valve leaflets, and can facilitate the identification of the displayed valve leaflets. As a result, the medical image processing apparatus 3 can suppress the occurrence of misidentification of the valve leaflets.

[0172] Further, according to the first embodiment, the determination function 355 determines the type of the valve leaflets included in the display cross-section. The control function 351 determines the display form of the information regarding the display cross-section based on the display form of each of the plurality of valve leaflets and the determination result of the type. Therefore, the medical image processing apparatus 3 according to the first embodiment can discriminate the valve leaflets that are easy to observe in the display cross-section, and can accurately associate the display form of the valve leaflets with the information regarding the display cross-section that facilitates the observation of the valve leaflets.

[0173] Also, according to the first embodiment, the determination function 355 determines the range to be determined for the type in the display cross-section based on the structural information of a plurality of valve leaflets, calculates an index using the information included in the determined range, and determines the type of the valve leaflet based on the calculated index. Therefore, the medical image processing apparatus 3 according to the first embodiment can accurately determine the valve leaflets that are easy to observe in the display cross-section.

[0174] Also, according to the first embodiment, the determination function 355 determines the ranges in a plurality of display cross-sections respectively based on the structural information of a plurality of valve leaflets, calculates an index for each of the determined ranges respectively, and determines the type of the valve leaflets included in the plurality of display cross-sections respectively based on the calculated indexes for each. When it is determined that the same valve leaflets are included in the plurality of display cross-sections in the determination result of the type, the control function 351 determines the display form of the information regarding the display cross-section based on the determination result of the type and each index calculated from each display cross-section. Therefore, the medical image processing apparatus 3 according to the first embodiment can more accurately determine the valve leaflets that are easy to observe.

[0175] Also, according to the first embodiment, the control function 351 causes a reference line indicating the position of the display cross-section and a display area frame of the display cross-section to be displayed in a display form associated with the display form of the valve leaflet corresponding to the position of the set display cross-section among the plurality of valve leaflets. Therefore, the medical image processing apparatus 3 according to the first embodiment can make it easy to understand the relationship between the reference line, the display area, and the valve leaflets.

[0176] Also, according to the first embodiment, the control function 351 controls the set range of the display cross-section regarding the heart valve based on the extraction result of the region corresponding to the heart valve. Therefore, the medical image processing apparatus 3 according to the first embodiment enables appropriate setting of the display cross-section.

[0177] Also, according to the first embodiment, the control function 351 receives a setting to move the position of at least one display cross-section among a plurality of display cross-sections related to the heart valve. Further, in the display of reference information indicating the positions of the plurality of display cross-sections, the control function 351 displays, in a similar display form, the reference information indicating the position before movement of the display cross-section whose position has been moved and the reference information indicating the position after movement. Therefore, the medical image processing apparatus 3 according to the first embodiment enables the realization of an easily operable reference line.

[0178] Also, according to the first embodiment, the control function 351 receives a rotation operation of the display cross-section whose position has been moved, based on the reference information indicating the position before movement. Further, the control function 351 displays the reference information indicating the position before movement and the reference information indicating the position after movement at positions corresponding to the rotation operation, while maintaining the positional relationship between the reference information indicating the position before movement and the reference information indicating the position after movement. Therefore, the medical image processing apparatus 3 according to the first embodiment enables accurate grasping of the positional relationship between the observation cross-section and the rotation position.

[0179] Also, according to the first embodiment, the control function 351 adjusts the display positions of a plurality of display cross-sections related to the heart valve, based on the morphological information of the heart valve. Therefore, the medical image processing apparatus 3 according to the first embodiment enables the display of an easily observable cross-sectional image.

[0180] Also, according to the first embodiment, in addition to the display form and the determination result of the type of each of the plurality of valve leaflets, the control function 351 determines the display form of the information related to the display cross-section, based on the properties of the valve leaflets. Therefore, the medical image processing apparatus 3 according to the first embodiment enables the immediate grasping of abnormalities related to the properties of the valve leaflets.

[0181] Also, according to the first embodiment, the control function 351 accepts the movement of the display cross-section to a position based on the position of the tip of the joint in the heart valve. Further, the control function 351 accepts the movement of the display cross-section to a position based on the position of the valve leaflet included in the display cross-section. Therefore, the medical image processing apparatus 3 according to the first embodiment enables various display cross-sections to be displayed.

[0182] (Other Embodiments) In the above-described embodiment, an example in which the image of the valve leaflet is displayed on the display 33 of the medical image processing apparatus 3 has been described, but the embodiment is not limited thereto. For example, the image of the valve leaflet may be displayed on the display of another device connected to the network.

[0183] In the above-described embodiment, an example in which the control unit, the image acquisition unit, the extraction unit, the specification unit, and the determination unit in this specification are realized by the control function, the image acquisition function, the extraction function, the specification function, and the determination function of the processing circuit, respectively, has been described, but the embodiment is not limited thereto. For example, the control unit, the image acquisition unit, the extraction unit, the specification unit, and the determination unit in this specification may realize the same functions not only by the control function, the image acquisition function, the extraction function, the specification function, and the determination function described in the embodiment, but also by only hardware, only software, or a combination of hardware and software.

[0184] Also, the term "processor" used in the description of the above-described embodiments means, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or a circuit such as an application specific integrated circuit (ASIC), a programmable logic device (for example, a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). Here, instead of storing a program in a storage circuit, the program may be directly incorporated into the circuit of the processor. In this case, the processor realizes its function by reading and executing the program incorporated in the circuit. Further, each processor of the present embodiment is not limited to being configured as a single circuit for each processor, and may be configured as one processor by combining a plurality of independent circuits so as to realize its function.

[0185] Here, the medical image processing program executed by the processor is provided by being pre-installed in a ROM (Read Only Memory), a memory circuit, or the like. Note that this medical image processing program may be provided by being recorded on a computer-readable non-transitory storage medium such as a CD (Compact Disk)-ROM, an FD (Flexible Disk), a CD-R (Recordable), or a DVD (Digital Versatile Disk) in a form installable or executable on these devices. Further, this medical image processing program may be stored on a computer connected to a network such as the Internet and provided or distributed by being downloaded via the network. For example, this medical image processing program is composed of modules including the above-described respective processing functions. As actual hardware, the CPU reads the medical image processing program from a storage medium such as a ROM and executes it, whereby each module is loaded onto the main storage device and generated on the main storage device.

[0186] Also, in the above-described embodiments and modified examples, each component of each illustrated device is conceptually functional and does not necessarily have to be physically configured as illustrated. That is, the specific form of the dispersion or integration of each device is not limited to that illustrated, and all or part of it can be functionally or physically dispersed or integrated in any unit according to various loads, usage situations, and the like. Further, each processing function performed by each device can be realized in whole or in any part by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware by wired logic.

[0187] In addition, among the processes described in the above-described embodiments and modifications, all or part of the processes described as being automatically performed can also be manually performed, or all or part of the processes described as being manually performed can be automatically performed by a known method. In addition, the processing procedures, control procedures, specific names, and information including various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified.

[0188] According to at least one of the embodiments described above, the identification of the displayed valve leaf can be facilitated.

[0189] Although several embodiments have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and its equivalent scope.

Explanation of Reference Numerals

[0190] 3 Medical image processing apparatus 35 Processing circuit 351 Control function 352 Image acquisition function 353 Extraction function 354 Identification function 355 Judgment function

Claims

1. An acquisition unit that acquires volume data including at least a heart valve; An extraction unit that extracts a region corresponding to the heart valve included in the volume data; An identification unit that identifies each of a plurality of valve leaflets included in the heart valve; A display control unit that causes each of the plurality of valve leaflets to be displayed in a different display form; A reception unit that receives a setting of a display cross-section related to the heart valve; A determination unit that determines the type of valve leaflet included in the display cross-section received by the reception unit; Comprising: The display control unit determines a display form of information related to the display cross-section based on the display form of each of the plurality of valve leaflets and the determination result of the type. Medical image processing apparatus.

2. The determination unit determines a range to be determined for the type in the display cross-section based on the structural information of the plurality of valve leaflets, calculates an index using information included in the determined range, and determines the type of the valve leaflet based on the calculated index. The medical image processing apparatus according to claim 1.

3. The determination unit determines each of the ranges in the plurality of display cross-sections based on the structural information of the plurality of valve leaflets, calculates each index for each of the determined ranges, and determines the type of valve leaflet included in each of the plurality of display cross-sections based on each of the calculated indexes. When it is determined that the same valve leaflet is included in the plurality of display cross-sections in the determination result of the type, the display control unit determines a display form of information related to the display cross-section based on the determination result of the type and each index calculated from each display cross-section. The medical image processing apparatus according to claim 2.

4. The display control unit displays reference information indicating the position of the display cross-section and the display area of the display cross-section in a display form associated with the display form of the valve leaflet corresponding to the position of the display cross-section set by the reception unit among the plurality of valve leaflets. The medical image processing apparatus according to any one of claims 1 to 3.

5. The reception unit controls a setting range of a display cross-section related to the heart valve based on an extraction result of a region corresponding to the heart valve. The medical image processing apparatus according to any one of claims 1 to 4.

6. The reception unit receives a setting for moving the position of at least one display cross-section among a plurality of display cross-sections related to the heart valve. In the display of reference information indicating the positions of the plurality of display cross-sections, the display control unit causes the reference information indicating the position before movement of the display cross-section whose position has been moved and the reference information indicating the position after movement to be displayed in similar display forms, respectively. The medical image processing apparatus according to any one of claims 1 to 5.

7. The reception unit receives a rotation operation of the display cross-section whose position has been moved based on the reference information indicating the position before movement. The display control unit displays the reference information indicating the position before movement and the reference information indicating the position after movement at positions corresponding to the rotation operation while maintaining the positional relationship between the reference information indicating the position before movement and the reference information indicating the position after movement. The medical image processing apparatus according to claim 6.

8. The display control unit adjusts the display positions of a plurality of display cross-sections related to the heart valve based on the morphological information of the heart valve. The medical image processing apparatus according to any one of claims 1 to 7.

9. The display control unit determines the display form of the information related to the display cross-section based on the properties of the valve leaf in addition to the display form of each of the plurality of valve leafs and the determination result of the type. The medical image processing apparatus according to any one of claims 1 to 8.

10. The reception unit receives the movement of the display cross-section to a position based on the position of the tip of the joint portion in the heart valve. The medical image processing apparatus according to any one of claims 1 to 9.

11. The reception unit receives the movement of the display cross-section to a position based on the position of the valve leaf included in the display cross-section. The medical image processing apparatus according to any one of claims 1 to 9.

12. A medical image processing method executed by a processor, comprising: obtaining volume data including at least a heart valve; extracting a region corresponding to the heart valve included in the volume data; identifying each of a plurality of valve leafs included in the heart valve; displaying each of the plurality of valve leafs in different display forms; receiving a setting of a display cross-section related to the heart valve; determining the type of the valve leaf included in the received display cross-section; determining the display form of the information related to the display cross-section based on the display form of each of the plurality of valve leafs and the determination result of the type; A medical image processing method including the above steps.

13. An acquisition function for acquiring volume data including at least a heart valve, An extraction function for extracting a region corresponding to the heart valve included in the volume data, An identification function for identifying each of a plurality of valve leaflets included in the heart valve, A display control function for displaying each of the plurality of valve leaflets in different display forms, A reception function for receiving a setting of a display cross section related to the heart valve, A determination function for determining the type of valve leaflet included in the display cross section received by the reception function, To be executed by a computer, The display control function determines a display form of information related to the display cross section based on the display form of each of the plurality of valve leaflets and the determination result of the type, a medical image processing program.

14. An acquisition unit that acquires volume data including at least a heart valve, An extraction unit that extracts a region corresponding to the heart valve included in the volume data, An identification unit that identifies each of a plurality of valve leaflets included in the heart valve, A display control unit that displays each of the plurality of valve leaflets in different display forms, A reception unit that receives a setting of a display cross section related to the heart valve, Comprising, The display control unit displays reference information indicating the position of the display cross section and the display area of the display cross section in a display form associated with the display form of the valve leaflet corresponding to the position of the display cross section set by the reception unit among the plurality of valve leaflets, A medical image processing apparatus.

15. An acquisition unit that acquires volume data including at least a heart valve, An extraction unit that extracts a region corresponding to the heart valve included in the volume data, An identification unit that identifies each of a plurality of valve leaflets included in the heart valve, A display control unit that displays each of the plurality of valve leaflets in different display forms, A reception unit that receives a setting for moving the position of at least one display cross section among a plurality of display cross sections related to the heart valve, Comprising, In the display of reference information indicating the positions of the plurality of display cross sections, the display control unit displays, in a similar display form, reference information indicating the position before movement and reference information indicating the position after movement of the display cross section whose position has been moved, A medical image processing apparatus.

16. An acquisition unit that acquires volume data including at least a heart valve, An extraction unit that extracts a region corresponding to the heart valve included in the volume data, An identification unit that identifies each of a plurality of valve leaflets included in the heart valve, A display control unit that displays each of the plurality of valve leaflets in different display forms, A reception unit that receives a setting of a display cross section related to the heart valve, Comprising, The display control unit adjusts the display positions of a plurality of display cross-sections related to the heart valve set by the reception unit based on the morphological information of the heart valve. Medical image processing apparatus. **Claim 17** A medical image processing method executed by a processor, comprising: acquiring volume data including at least a heart valve; extracting a region corresponding to the heart valve included in the volume data; identifying each of a plurality of valve leaflets included in the heart valve; displaying each of the plurality of valve leaflets in a different display form; receiving a setting of a display cross-section related to the heart valve; displaying reference information indicating the position of the display cross-section and a display region of the display cross-section in a display form associated with the display form of the valve leaflet corresponding to the position of the set display cross-section among the plurality of valve leaflets; A medical image processing method comprising the above steps. **Claim 18** A medical image processing method executed by a processor, comprising: acquiring volume data including at least a heart valve; extracting a region corresponding to the heart valve included in the volume data; identifying each of a plurality of valve leaflets included in the heart valve; displaying each of the plurality of valve leaflets in a different display form; receiving a setting for moving the position of at least one display cross-section among a plurality of display cross-sections related to the heart valve; in the display of reference information indicating the positions of the plurality of display cross-sections, displaying, in a similar display form, reference information indicating the position before movement and reference information indicating the position after movement of the display cross-section whose position has been moved; A medical image processing method comprising the above steps. **Claim 19** A medical image processing method executed by a processor, comprising: acquiring volume data including at least a heart valve; extracting a region corresponding to the heart valve included in the volume data; identifying each of a plurality of valve leaflets included in the heart valve; displaying each of the plurality of valve leaflets in a different display form; receiving a setting of a display cross-section related to the heart valve; adjusting the display positions of a plurality of display cross-sections related to the set heart valve based on the morphological information of the heart valve; A medical image processing method comprising the above steps. **Claim 20** An acquisition function for acquiring volume data including at least a heart valve An extraction function for extracting the region corresponding to the heart valve included in the volume data, A specification function for specifying each of a plurality of valve leaflets included in the heart valve, A display control function for displaying each of the plurality of valve leaflets in different display forms, A reception function for receiving a setting of a display cross section related to the heart valve, To be executed by a computer, The display control function displays reference information indicating the position of the display cross section and the display area of the display cross section in a display form associated with the display form of the valve leaflet corresponding to the position of the display cross section set by the reception function among the plurality of valve leaflets. A medical image processing program.

21. An acquisition function for acquiring volume data including at least a heart valve, An extraction function for extracting the region corresponding to the heart valve included in the volume data, A specification function for specifying each of a plurality of valve leaflets included in the heart valve, A display control function for displaying each of the plurality of valve leaflets in different display forms, A reception function for receiving a setting for moving the position of at least one display cross section among a plurality of display cross sections related to the heart valve, To be executed by a computer, In the display of reference information indicating the positions of the plurality of display cross sections, the display control function displays, in a similar display form, the reference information indicating the position before movement and the reference information indicating the position after movement of the display cross section whose position has been moved. A medical image processing program.

22. An acquisition function for acquiring volume data including at least a heart valve, An extraction function for extracting the region corresponding to the heart valve included in the volume data, A specification function for specifying each of a plurality of valve leaflets included in the heart valve, A display control function for displaying each of the plurality of valve leaflets in different display forms, A reception function for receiving a setting of a display cross section related to the heart valve, To be executed by a computer, The display control function adjusts the display positions of a plurality of display cross sections related to the heart valve set by the reception function based on the morphological information of the heart valve. A medical image processing program.

Images