Medical image diagnostic apparatus, ultrasound diagnostic apparatus, medical image display method, and medical image display program

Abstract

To assist in correction of a structure region.SOLUTION: A medical image diagnostic apparatus according to an embodiment includes a detection unit, a determination unit, and a display control unit. The detection unit detects, from volume data relating to at least one structure in a subject, respective regions corresponding to the at least one structure as structure regions. The determination unit determines a correction range with a position of a cursor as a reference on the basis of a distance between the position of the cursor in the volume data and one of the detected structure regions. The display control unit displays, in at least one medical image reconstructed from the volume data, the position of the cursor, the one structure region, and the determined correction range.SELECTED DRAWING: Figure 9

Description

Technical Field

[0001] The embodiments disclosed in this specification and the drawings relate to a medical imaging diagnostic apparatus, an ultrasonic diagnostic apparatus, a medical image display method, and a medical image display program.

Background Art

[0002] A medical imaging diagnostic apparatus acquires volume data regarding a structure (object) in a subject, and reconstructs and displays a medical image from the volume data. In particular, the medical imaging diagnostic apparatus can detect a region corresponding to a structure (structure region) from the volume data and measure a feature amount regarding the structure region. In order to accurately measure this feature amount, the medical imaging diagnostic apparatus can correct the structure region detected by itself according to an operation by an operator.

[0003] The operator may sometimes want to partially correct a part of the structure region detected by the medical imaging diagnostic apparatus. For example, in the medical image, the operator picks up and moves a part of the detected structure region with a cursor so as to match the contour of the actual structure region. Due to this movement, the structure region included in the correction range with reference to the cursor is deformed.

[0004] However, when the correction range is fixed, the operator may need to correct the detected structure region through multiple operations (see FIG. 13). In this case, the operator will take time to correct the detected structure region.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to assist in the modification of the structure area. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problems. The problems corresponding to the effects of each configuration shown in the embodiments described later can also be regarded as other problems.

Means for Solving the Problems

[0007] The medical image diagnostic apparatus according to the embodiment includes a detection unit, a determination unit, and a display control unit. The detection unit detects, as each structure area, each area corresponding to the at least one structure from the volume data regarding at least one structure in the subject. The determination unit determines a correction range with reference to the position of the cursor based on the distance between the position of the cursor in the volume data and one of the detected structure areas. The display control unit displays the position of the cursor, the one structure area, and the determined correction range in at least one medical image reconstructed from the volume data.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Mode for Carrying Out the Invention

[0009] Hereinafter, this embodiment will be described with reference to the drawings. In this embodiment, a plurality of parts with the same reference numerals are regarded as operating in the same manner, and overlapping descriptions will be omitted as appropriate. In particular, as a medical image diagnostic apparatus, an ultrasonic diagnostic apparatus will be described by way of example.

[0010] FIG. 1 is a block diagram showing a configuration example of an ultrasonic diagnostic apparatus 1 according to this embodiment. The ultrasonic diagnostic apparatus 1 is an apparatus for ultrasonic diagnosis. The ultrasonic diagnostic apparatus 1 includes an ultrasonic probe 2 and an apparatus main body 3.

[0011] The ultrasonic probe 2 is a probe that transmits and receives ultrasonic waves to and from the subject S. The ultrasonic probe 2 is provided with a plurality of vibrators (piezoelectric vibrators) at its tip. Each vibrator scans a scan area inside the subject S by transmitting ultrasonic waves toward the inside of the subject S. Each vibrator receives the reflected wave from the inside of the subject S as a reflection signal and outputs the received reflection signal to the apparatus main body 3.

[0012] The apparatus main body 3 is an apparatus that displays an ultrasonic image based on the reflection signal from the ultrasonic probe 2. The apparatus main body 3 includes a transmission circuit 31, a reception circuit 32, a storage circuit 33, an input circuit 34, a display circuit 35, a communication circuit 36, and a processing circuit 37 as each component. Each component is interconnected by an internal bus.

[0013] The transmission circuit 31 is a circuit that transmits a drive signal (drive pulse) to the ultrasonic probe 2. The transmission circuit 31 includes a reference pulse generation circuit, a delay control circuit, and a drive pulse generation circuit. The transmission circuit 31 generates a drive signal for generating ultrasonic waves to the ultrasonic probe 2 by each circuit performing a predetermined function, and outputs the generated drive signal to each vibrator of the ultrasonic probe 2.

[0014] The reception circuit 32 is a circuit that receives a reflected signal from the ultrasonic probe 2. The reception circuit 32 includes a preamplification circuit (preamp), an AD conversion circuit, a demodulation circuit, and an addition circuit. The reception circuit 32 performs coherent addition on the reflected signals from the ultrasonic probe 2 by each circuit performing a predetermined function, and outputs the received signal obtained by this coherent addition to the processing circuit 37.

[0015] The storage circuit 33 is a circuit that stores various types of data. The storage circuit 33 is composed of a magnetic disk, a semiconductor memory, etc. The storage circuit 33 stores various programs executed by the processing circuit 37. The storage circuit 33 stores various types of image data generated by the processing circuit 37.

[0016] The input circuit 34 is a circuit that receives an input operation by an operator. The input circuit 34 is composed of a mouse, a keyboard, buttons, switches, a trackball, a touch panel, etc. The input circuit 34 converts an input operation by an operator into an electrical signal, and outputs this electrical signal to the processing circuit 37.

[0017] The display circuit 35 is a circuit that displays various types of images. The display circuit 35 is composed of a liquid crystal display, an organic EL (Electro-luminescence) display, etc. The display circuit 35 displays an image based on the image data generated by the processing circuit 37. The display circuit 35 displays a GUI (Graphical User Interface) for receiving an input operation by an operator. That is, the display circuit 35 may have the function of the input circuit 34.

[0018] The communication circuit 36 is a circuit that communicates various types of data. The communication circuit 36 communicates medical image data based on the DICOM (Digital Imaging and Communication in Medicine) standard. The communication circuit 36 may be connected to an external device through a communication network.

[0019] The processing circuit 37 is a circuit that comprehensively controls each component of the ultrasonic diagnostic apparatus 1. The processing circuit 37 has at least one processor. The processor means a circuit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an application specific integrated circuit (ASIC), or a programmable logic device (PLD). The programmable logic device means a circuit such as a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), or a field programmable gate array (FPGA).

[0020] When the processor is a CPU, the CPU reads and executes each program stored in the storage circuit 33 to realize each function. When the processor is an ASIC, each function is incorporated as a logic circuit inside the ASIC. The processor may be configured as a single circuit or may be configured by combining a plurality of circuits. The processor realizes a signal processing function 371, an image generation function 372, a display control function 373, a detection function 374A, a measurement function 374B, a selection function 374C, a determination function 374D, a deformation function 374E, and a system control function 375.

[0021] The signal processing function 371 is a function that generates various types of data by processing the received signal from the receiving circuit 32. The signal processing function 371 has a B-mode processing function and a Doppler mode processing function. The B-mode processing function generates B-mode data that indicates this signal strength as a luminance value based on the signal strength (amplitude information) of the received signal. The Doppler mode processing function generates Doppler data that indicates motion information (e.g., average velocity, average variance value, average power value) based on the Doppler effect of the moving body by performing frequency analysis on the received signal.

[0022] The image generation function 372 is a function that generates various types of image data based on the data generated by the signal processing function 371. The image generation function 372 generates volume data regarding the scan region from the B-mode data or the Doppler data. The image generation function 372 generates two-dimensional ultrasonic image data by performing MPR (Multi-Planar Reconstruction) processing on the volume data. The image generation function 372 generates three-dimensional ultrasonic image data by performing volume rendering processing on the volume data. The image generation function 372 generates three-dimensional structure image data by performing surface rendering processing on the structure region detected from the volume data.

[0023] The display control function 373 is a function that displays various types of images on the display circuit 35 based on the data generated by the image generation function 372. The display control function 373 displays a two-dimensional ultrasonic image based on the two-dimensional ultrasonic image data. The display control function 373 displays a three-dimensional ultrasonic image based on the three-dimensional ultrasonic image data. The display control function 373 displays a three-dimensional structure image based on the three-dimensional structure image data. Examples of the ultrasonic images to be displayed include a B-mode image, a Doppler mode image, a color Doppler mode image, and an M-mode image.

[0024] The detection function 374A is a function that performs various types of detections. The detection function 374A detects each region corresponding to the at least one structure as each structure region from the volume data regarding at least one structure in the subject S.

[0025] The measurement function 374B is a function for performing various measurements. The measurement function 374B measures feature quantities (e.g., size, length) regarding each structure area detected by the detection function 374A.

[0026] The selection function 374C is a function for performing various selections. The selection function 374C selects one structure area out of the structure areas detected by the detection function 374A according to an operation by the operator.

[0027] The determination function 374D is a function for making various determinations. The determination function 374D determines a correction range with respect to the position of the cursor based on the distance between the position of the cursor in the volume data processed by the detection function 374A and one structure area detected from the volume data.

[0028] The deformation function 374E is a function for performing various deformations. The deformation function 374E deforms the structure areas included in the correction range determined by the determination function 374D according to an operation of the cursor in at least one medical image reconstructed from the volume data processed by the detection function 374A.

[0029] In particular, the display control function 373 may three-dimensionally display the position of the cursor, one structure area, and the correction range determined by the determination function 374D in at least one medical image reconstructed from the volume data processed by the detection function 374A. The display control function 373 may display the structure area selected by the selection function 374C in the at least one medical image. The display control function 373 does not necessarily have to display other structure areas different from the structure area selected by the selection function 374C in the at least one medical image. The display control function 373 may rotate and display the structure area deformed by the deformation function 374E.

[0030] The system control function 375 is a function for comprehensively controlling each component of the ultrasonic diagnostic apparatus 1. The system control function 375 controls the transmission circuit 31 and the reception circuit 32 so that an ultrasonic scan is executed based on predetermined transmission and reception conditions.

[0031] FIG. 2 is a flowchart showing an operation example of the ultrasonic diagnostic apparatus 1 according to the present embodiment. According to this operation example, the ultrasonic diagnostic apparatus 1 displays an ultrasonic image by photographing a subject S. The ultrasonic diagnostic apparatus 1 changes the display content in response to an operation by an operator on the displayed ultrasonic image.

[0032] (Step S1) First, the ultrasonic diagnostic apparatus 1 photographs the subject S through the signal processing function 371, the image generation function 372, and the system control function 375. By this photographing, volume data VD regarding at least one structure in the subject S is generated. Ultrasonic image data is generated from the volume data VD.

[0033] (Step S2) Next, the ultrasonic diagnostic apparatus 1 displays an ultrasonic image through the display control function 373. Specifically, the display control function 373 displays the ultrasonic image on the display circuit 35 based on the ultrasonic image data generated in Step S1.

[0034] The operator may select desired ultrasonic image data from the image list stored in the storage circuit 33. The image list has a plurality of ultrasonic image data obtained by previously photographing the subject S. The display control function 373 displays an ultrasonic image based on the ultrasonic image data selected by the operator. In this case, Step S1 does not necessarily need to be executed.

[0035] (Step S3) Subsequently, the ultrasonic diagnostic apparatus 1 detects the structure region through the detection function 374A. Specifically, the detection function 374A detects the boundary between the low echo region and the high echo region for the volume data VD generated in Step S1. The detection function 374A detects the structure region from the volume data VD based on the detected boundary (see FIG. 3).

[0036] The operator observes the ultrasonic image displayed in Step S2 and focuses on a desired structure (e.g., organ, tissue, cell) in this ultrasonic image. The operator may press a function button for detecting the focused structure. In response to this pressing, the detection function 374A may detect the structure region related to the structure on which the operator has focused from the volume data VD corresponding to the displayed ultrasonic image.

[0037] (Step S4) Subsequently, the ultrasonic diagnostic apparatus 1 measures the feature amount through the measurement function 374B. Specifically, the measurement function 374B measures the feature amount related to the structure region detected in Step S3. For example, the measurement function 374B measures the volume of this structure region by filling the inside of the structure region with a plurality of polyhedrons. The measurement function 374B may calculate the feature amount of the structure region using a known technique. The type of the calculated feature amount may be set in advance by the operator.

[0038] (Step S5) Subsequently, the ultrasonic diagnostic apparatus 1 displays the detection result and the measurement result through the display control function 373. Specifically, the display control function 373 displays the structure region detected in Step S3 and the feature amount measured in Step S4 on the display circuit 35. The display control function 373 superimposes on the ultrasonic image displayed in Step S2 and displays the detected structure region and the measured feature amount. The detected structure region may be displayed as a three-dimensional structure image by surface rendering processing. The measured feature amount may be displayed as a list (see FIG. 4).

[0039] (Step S6) Finally, the ultrasonic diagnostic apparatus 1 performs display change processing. Specifically, the ultrasonic diagnostic apparatus 1 performs display change processing according to an operation by the operator on the display screen displayed in Step S5 (see FIG. 5).

[0040] FIG. 3 is a diagram showing the detection processing of the structure region according to the present embodiment. FIG. 3 shows volume data VD regarding the scan region of the subject S as a cube. The volume data VD is composed of a plurality of voxels V. The volume data VD is defined in a three-dimensional space.

[0041] The position in this three-dimensional space is defined in a three-dimensional orthogonal coordinate system composed of the X-axis, Y-axis, and Z-axis. The plane (XY plane) spanned by the X-axis and Y-axis corresponds to the A cross-section. The plane (YZ plane) spanned by the Y-axis and Z-axis corresponds to the B cross-section. The plane (ZX plane) spanned by the Z-axis and X-axis corresponds to the C cross-section.

[0042] For example, the detection function 374A detects at least one structure region from the volume data VD by threshold processing. Specifically, for each voxel V constituting the volume data VD, the detection function 374A detects a plurality of voxels V that are adjacent to each other and have voxel values (luminance values) equal to or greater than or less than the threshold as a structure region. In this way, the detection function 374A detects two structure regions J1 and J2.

[0043] The detection function 374A may detect two structure regions J1 and J2 using a machine learning model trained by a method such as deep learning. The detection function 374A may detect two structure regions J1 and J2 using a known technique. The detection function 374A may detect three or more structure regions.

[0044] FIG. 4 is a diagram showing the display process of the detection result and the measurement result according to the present embodiment. FIG. 4 shows a display screen 500 displayed by a display circuit 35. The display screen 500 is divided into four equal display areas (upper left area, upper right area, lower left area, lower right area) in a cross shape. The upper left area displays an ultrasonic image 510A. The upper right area displays an ultrasonic image 510B. The lower left area displays an ultrasonic image 510C. The lower right area displays a structure image 510D.

[0045] The three ultrasonic images 510A, 510B, and 510C are three MPR images orthogonal to each other. The MPR image is a two-dimensional ultrasonic image reconstructed from volume data VD by MPR processing. The ultrasonic image 510A shows an A cross-section in the volume data VD. The ultrasonic image 510B shows a B cross-section in the volume data VD. The ultrasonic image 510C shows a C cross-section in the volume data VD.

[0046] The structure image 510D is a three-dimensional structure image that three-dimensionally shows each structure area detected from the volume data VD. The structure image 510D shows five structure areas 61, 62, 63, 64, and 65. Each structure area is patterned so as to be distinguishable from each other. Each structure area may be colored or numbered so as to be distinguishable from each other. Each structure area may be shaded so as to be three-dimensionally perceived.

[0047] The structure image 510D is displayed with the list L superimposed. The list L shows five measurement results corresponding to the five structure areas 61 to 65 respectively. Each measurement result is patterned in the same manner as the corresponding structure area. Each measurement result is arranged in descending order of the measured value. The measured value may be the axial length or the surface area in addition to the volume.

[0048] The three ultrasonic images 510A, 510B, and 510C display the structure area 61 and the contour 71. The ultrasonic image 510B displays the structure area 65 adjacent to the structure area 61. The ultrasonic image 510C displays the structure area 64 relatively far from the structure area 61.

[0049] The structure region 61 corresponds to the structure region J1 in the volume data VD. As shown in the list L, the volume of the structure region 61 is the largest among the five structure regions 61 to 65 (0.12 mL). The contour 71 is the actual contour of the structure region 61. The contour 71 is grasped by the operator observing the ultrasonic images 510A, 510B, and 510C.

[0050] The structure region 61 exists inside the contour 71. That is, the structure region 61 is detected as a region smaller than the actual one. Therefore, the volume of the structure region 61 is measured as a value smaller than the actual one. In order to accurately measure the volume of the structure region 61, the operator may want to correct the end of the structure region 61 to match the contour 71.

[0051] FIG. 5 is a flowchart showing the display change process according to the present embodiment. According to this process, the ultrasonic diagnostic apparatus 1 determines and displays the correction range G of the structure region in response to an operation by the operator on the display screen displayed in step S5. The ultrasonic diagnostic apparatus 1 deforms and displays the structure region included in the correction range G in response to an operation by the operator.

[0052] (Step S61) First, the ultrasonic diagnostic apparatus 1 determines whether one structure region has been selected through the selection function 374C. Specifically, the selection function 374C determines whether one structure region has been selected among at least one structure region displayed in step S5. If one structure region has been selected (step S61 - YES), the process proceeds to step S62. If one structure region has not been selected (step S61 - NO), the process proceeds to step S67.

[0053] The operator may operate the cursor U on the display screen 500 through the input circuit 34 (especially the mouse) (see FIG. 4). For example, the operator clicks the cursor U to align it with a desired structure area in any one of the three ultrasonic images 510A, 510B, and 510C and the structure image 510D. The selection function 374C may select the clicked structure area. Alternatively, the operator clicks on a desired measurement result in the list L. The selection function 374C may select the structure area corresponding to the clicked measurement result.

[0054] (Step S62) Next, the ultrasonic diagnostic apparatus 1 determines the correction range G through the determination function 374D. Specifically, the determination function 374D uses the distance d between the position P of the cursor U in the volume data VD generated in Step S1 and one structure area selected in Step S61 - YES. The determination function 374D determines the correction range G based on the distance d with the position P of the cursor U as a reference (see FIGS. 6 and 7).

[0055] (Step S63) Subsequently, the ultrasonic diagnostic apparatus 1 displays the selected structure area and the correction range G through the display control function 373. Specifically, the display control function 373 displays one structure area selected in Step S61 - YES and the correction range G determined in Step S62 on the display circuit 35. The display control function 373 updates the display screen displayed in Step S5 and displays the selected one structure area and the correction range G (see FIGS. 8, 9, 10, and 11).

[0056] (Step S64) Subsequently, the ultrasonic diagnostic apparatus 1 determines whether the selected structure area is deformed through the deformation function 374E. Specifically, the deformation function 374E determines whether one structure area displayed in Step S63 is deformed. If one structure area is deformed (Step S64 - YES), the process proceeds to Step S65. If one structure area is not deformed (Step S64 - NO), the process proceeds to Step S67.

[0057] The operator may operate the cursor U on the display screen 500 through the input circuit 34 (see FIG. 9). For example, the operator clicks the cursor U to align it with a desired position in the ultrasonic image 510A. In response to this click, the cursor U moves to the center point of the correction range G, and the portion of the structure region 61 included in the correction range G enters a deformable state. In this state, the operator deforms the portion of the structure region 61 into an arbitrary shape by moving the cursor U in the ultrasonic image 510A. The operator clicks the cursor U to align it with a desired position (for example, the position on the contour 71) to confirm the deformation.

[0058] (Step S65) Subsequently, the ultrasonic diagnostic apparatus 1 re-measures the feature amount through the measurement function 374B. Specifically, the measurement function 374B re-measures the feature amount for the structure region deformed in Step S64-YES. The method for measuring the feature amount is the same as in Step S4.

[0059] (Step S66) Subsequently, the ultrasonic diagnostic apparatus 1 displays the deformed structure region and the re-measurement result through the display control function 373. Specifically, the display control function 373 displays the structure region deformed in Step S64-YES and the feature amount re-measured in Step S65 on the display circuit 35. The display control function 373 updates the display screen displayed in Step S63 and displays the deformed structure region and the re-measurement result (see FIG. 12).

[0060] (Step S67) Subsequently, the ultrasonic diagnostic apparatus 1 determines whether to end the display through the display control function 373. Specifically, the display control function 373 determines whether to end the display of the currently displayed display screen. If the display is to be ended (Step S67-YES), the ultrasonic diagnostic apparatus 1 ends the series of processes. If the display is not to be ended (Step S67-NO), the process returns to Step S61.

[0061] FIG. 6 is a diagram showing the determination process of the correction range G according to the present embodiment. FIG. 6(A) shows the volume data VD in the three-dimensional space, similar to FIG. 3. FIG. 6(B) shows the correction range G in the structure region J1.

[0062] As shown in FIG. 6(A), among the two structure regions J1 and J2 in the volume data VD, the structure region J1 is selected. The coordinates of the position P of the cursor U in the volume data VD are defined as P(x p , y p , z p ). In the structure region J1, the coordinates of the position Q closest to the position P of the cursor U are defined as Q(x q , y q , z q ). The distance d between the position P and the position Q is defined by the following formula (1).

[0063]

Equation

[0064] As shown in FIG. 6(B), the position Q in the structure region J1 corresponds to the center of the correction range G. The correction range G is a circle or a sphere centered on the position Q. For example, the determination function 374D determines the correction range G such that the longer the distance d shown in the formula (1), the larger the correction range G. In this case, the radius r of the correction range G may be defined by the following formula (2).

[0065]

Equation

[0066] In the formula (2), k is a coefficient (where k≠0). As shown in the formula (2), the radius r of the correction range G may be proportional to the distance d. The radius r of the correction range G may be proportional to the power (e.g., square, cube) of the distance d.

[0067] Conversely, the determination function 374D may determine the correction range G such that the longer the distance d, the smaller the correction range G. In this case, the radius r of the correction range G may be inversely proportional to the distance d. The radius r of the correction range G may be inversely proportional to the power (e.g., square, cube) of the distance d. The relationship between the radius r and the distance d may be a linear relationship or a non-linear relationship.

[0068] FIG. 7 is a diagram showing the change in the size of the correction range G according to the present embodiment. In FIG. 7, the size of the correction range G increases in proportion to the distance d. FIG. 7(A) shows the correction range G1 when the distance d is d1. FIG. 7(B) shows the correction range G2 when the distance d is d2. FIG. 7(C) shows the correction range G3 when the distance d is d3. The lengths of the three distances d1, d2, and d3 are in the relationship of d1 < d2 < d3.

[0069] As shown in FIG. 7(A), the cursor U is located near the end of the structure area J1. The operator moves the cursor U so as to be separated from the end of the structure area J1 (see FIGS. 7(B) and 7(C)). By this movement, the correction ranges G increase in the order of G1, G2, and G3. The sizes of the three correction ranges G1, G2, and G3 are in the relationship of G1 < G2 < G3.

[0070] FIGS. 8 and 9 are diagrams showing a first example of the display process of the correction range according to the present embodiment. FIGS. 8 and 9 show the display screen 500 as in FIG. 4. Different from FIG. 4, the display screen 500 displays the structure area 61 selected by the operator and does not display the other structure areas 62 to 65. By this selective display, the operator can easily focus on the desired structure area without being disturbed by other structure areas. In the list L, the measurement result of the feature amount related to the structure area 61 is highlighted as shown by the arrow W. When another measurement result is selected, another structure area corresponding to the selected measurement result may be displayed instead of the structure area 61.

[0071] As shown in FIG. 8, in the ultrasonic image 510A, the cursor U is located near the end of the structure region 61. The ultrasonic image 510A displays the position of the cursor U in the A cross-section and the correction range G. The ultrasonic image 510B displays the correction range G in the B cross-section. Since the correction range G does not exist in the C cross-section, the ultrasonic image 510C does not display the correction range G. The structure image 510D displays the correction range G three-dimensionally as viewed from a predetermined line-of-sight direction.

[0072] By observing the display screen 500, the operator can grasp the structure region 61 and the correction range G in the structure region 61 three-dimensionally. In particular, the operator can grasp the structure region 61 and the correction range G three-dimensionally by observing at least two of the three ultrasonic images 510A, 510B, and 510C simultaneously. Alternatively, the operator can grasp the structure region 61 and the correction range G three-dimensionally by observing the structure image 510D.

[0073] The operator moves the cursor U in the ultrasonic image 510A so as to be separated from the end of the structure region 61 (see FIG. 9). At this time, the position of the cursor U changes in the A cross-section of the volume data VD. Due to the movement of the cursor U, the correction range G in FIG. 9 increases as compared with the correction range G in FIG. 8.

[0074] In this way, the correction range G changes flexibly according to the distance d between the position of the cursor U and the structure region. The operator can intuitively change the correction range G by approaching or separating the position of the cursor U from the structure region. Therefore, the operator can easily correct the structure region without excessive effort.

[0075] FIG. 10 is a diagram showing a second example of the display process of the correction range G according to the present embodiment. FIG. 10 shows the display screen 500 displayed by the display circuit 35. The display screen 500 is divided into a grid of 16 equal display areas. The leftmost upper display area is blank. The remaining 15 display areas respectively display 15 ultrasonic images 550A to 550P.

[0076] The ultrasonic images 550A to 550P are a plurality of slice images parallel to each other. For example, the ultrasonic images 550A to 550P show the A cross-section in the volume data VD. The slice direction of the ultrasonic images 550A to 550P is the Z-axis direction in the volume data VD. The slice interval of the ultrasonic images 550A to 550P is 1 mm. That is, the ultrasonic images 550A to 550P are cross-sectional images obtained by slicing the structure region 61 at intervals of 1 mm in the Z-axis direction.

[0077] The ultrasonic images 550A to 550P simultaneously display the structure region 61 and the correction range G at a plurality of slice positions. The slice positions of the ultrasonic images 550A to 550P change in alphabetical order. That is, the ultrasonic image 550A is the first slice image, the ultrasonic images 550B to 550N are the intermediate slice images, and the ultrasonic image 550P is the last slice image.

[0078] By observing the display screen 500, the operator can three-dimensionally grasp the structure region 61 and the correction range G in the structure region 61. In particular, the operator can three-dimensionally grasp the structure region 61 and the correction range G by observing at least two of the ultrasonic images 550A to 550P simultaneously.

[0079] The operator may operate the cursor U on the display screen 500 through the input circuit 34. For example, the operator moves the cursor U away from the end of the structure region 61 in the ultrasonic image 550H. By this movement, the correction range G in the ultrasonic image 550H increases. At the same time, the correction range G in the other ultrasonic images 550A to 550P except the ultrasonic image 550H increases. At this time, the change in the size of the correction range G is displayed in a manner similar to FIGS. 8 and 9.

[0080] FIG. 11 is a diagram showing a third example of the display process of the correction range according to the present embodiment. FIG. 11 shows a display screen 500 displayed by the display circuit 35. The display screen 500 is divided crosswise into four equal display areas (upper left area, upper right area, lower left area, lower right area). The upper left area displays the ultrasonic image 560A. The upper right area displays the ultrasonic image 560B. The lower left area displays the ultrasonic image 560C. The lower right area displays the composite image 560D.

[0081] The three ultrasonic images 560A, 560B, and 560C are three MPR images orthogonal to each other. The three ultrasonic images 560A, 560B, and 560C show a plurality of follicles as structures of the subject S. One of the plurality of follicles is detected as the structure area 61. The detected structure area 61 exists inside the contour 71.

[0082] The ultrasonic image 560A displays the structure area 61, the contour 71, and the correction range G in the A cross-section. The ultrasonic image 560B displays the structure area 61, the contour 71, and the correction range G in the B cross-section. The ultrasonic image 560C does not display the structure area 61, the contour 71, or the correction range G in the C cross-section, but displays other follicles.

[0083] The composite image 560D is a three-dimensional image obtained by synthesizing the volume data VD and the ultrasonic image 561D. In the composite image 560D, a cube indicating the volume data VD is displayed three-dimensionally from a predetermined viewing direction. Inside the volume data VD, the ultrasonic image 561D viewed from this viewing direction is displayed. The ultrasonic image 561D displays the structure area 61, the contour 71, and the correction range G.

[0084] The operator may change the line-of-sight direction of the cube showing the volume data VD by operating the cursor U in the composite image 560D. For example, after the operator clicks the cube with the cursor U, the operator drags the cursor U. At this time, the cube rotates following the drag of the cursor U. Due to the rotation of the cube, the line-of-sight direction of this cube is changed, and the ultrasonic image 561D viewed from the changed line-of-sight direction is displayed.

[0085] By observing the display screen 500, the operator can three-dimensionally grasp the structure region 61 and the correction range G in the structure region 61. In particular, the operator can three-dimensionally grasp the structure region 61 and the correction range G by observing at least two of the three ultrasonic images 560A, 560B, and 560C simultaneously. The operator can three-dimensionally grasp the structure region 61 and the correction range G by observing the composite image 560D.

[0086] FIG. 12 is a diagram showing the display process of the deformed structure region according to the present embodiment. FIG. 12 shows the display screen 500 displayed by the display circuit 35. The display screen 500 is divided into two equal display regions (left region, right region). The left region displays the ultrasonic image 570. The right region displays the rendering image 580.

[0087] The ultrasonic image 570 is a three-dimensional ultrasonic image. The ultrasonic image 570 three-dimensionally displays a plurality of follicles. One of the plurality of follicles is detected as the structure region 61. The structure region 61 changes to the deformed structure region 61T according to the deformation operation by the operator. That is, the operator deforms the structure region 61 to match the contour 71.

[0088] The ultrasonic image 570 displays the structure region 61T and the contour 71 viewed from the line-of-sight direction perpendicular to the A cross-section. The center point (e.g., the center of gravity) of the structure region 61T passes through the rotation axis AX. For example, the rotation axis AX extends in the Y-axis direction in the A cross-section. The rotation axis AX may extend in the X-axis direction or the Z-axis direction.

[0089] The ultrasonic image 570 is displayed while rotating around the rotation axis AX. The ultrasonic image 570 rotates by a predetermined rotation angle at predetermined time intervals. The rotation speed and rotation direction of the ultrasonic image 570 may be set by the operator. The operator can three-dimensionally confirm whether the structure region 61T is deformed to match the contour 71 by observing the rotating ultrasonic image 570. That is, the operator can confirm the accuracy of the correction to the structure region.

[0090] The rendering image 580 is an image that displays a plurality of follicles detected from the volume data VD. The rendering image 580 renders and displays other follicles in addition to the follicles related to the structure region 61T. Each follicle in the rendering image 580 is subjected to shading processing and is three-dimensionally displayed as a cluster 581. The line-of-sight direction of the rendering image 580 is the same as the line-of-sight direction of the ultrasonic image 570.

[0091] The rendering image 580 is displayed while rotating around the rotation axis AX. Preferably, the rotation speed and rotation direction of the rendering image 580 are the same as the rotation speed and rotation direction of the ultrasonic image 570. The operator can compare and observe the two rotating ultrasonic image 570 and the rendering image 580.

[0092] According to the present embodiment described above, the ultrasonic diagnostic apparatus 1 can reduce the labor and time required for the operator to correct the end portion of the three-dimensional structure. That is, the ultrasonic diagnostic apparatus 1 can improve the usability of the operator in the correction function of the structure.

[0093] (Comparative Example) FIG. 13 is a diagram showing the deformation process of the structure region according to the prior art and the present embodiment. FIG. 13(A) shows the preconditions for deforming the structure region. FIGS. 13(B1), (B2), and (B3) show the deformation process of the structure region according to the prior art step by step. FIG. 13(C) shows the deformation process of the structure region according to the present embodiment.

[0094] As shown in FIG. 13(A), the cursor U is located near the structure area J1. The distance between the cursor U and the structure area J1 corresponds to the distance d. Based on the distance d, the correction range G is determined. The operator operates the cursor U to correct the end of the structure area J1 so as to match the target contour M. The target contour M is a downward parabola that spreads so as to surround the correction range G. At this time, the portion of the structure area J1 included in the correction range G is deformed.

[0095] As shown in FIGS. 13(B1), (B2) and (B3), according to the prior art, the correction range G is fixed regardless of the distance d. In this case, the operator needs to correct the end of the structure area J1 so as to match the target contour M through three deformation operations.

[0096] In the first operation, the operator picks up and moves the central portion of the structure area J1 with the cursor U to project this central portion as the area T1 (see FIG. 13(B1)). In the second operation, the operator picks up and moves the right portion of the structure area J1 with the cursor U to project this right portion as the area T2 (see FIG. 13(B2)). In the third operation, the operator picks up and moves the left portion of the structure area J1 with the cursor U to project this left portion as the area T3 (see FIG. 13(B3)). The three projected areas T1, T2 and T3 form a substantially conical shape.

[0097] As shown in FIG. 13(C), according to the present embodiment, the correction range G changes flexibly according to the distance d. In this case, the operator can correct the end of the structure area J1 so as to match the target contour M through one deformation operation.

[0098] By separating the cursor U from the structure area J1, the operator expands the correction range G according to the target contour M. With the correction range G expanded, the operator pinches and moves the central part of the structure area J1 with the cursor U to project this central part as the area T5. The projected area T5 forms a substantially conical shape. That is, according to this embodiment, two deformation operations can be omitted compared to the prior art.

[0099] This embodiment is applicable not only to ultrasonic diagnostic devices but also to other medical image diagnostic devices. Examples of other medical image diagnostic devices include X-ray CT (Computed Tomography) devices and MRI (Magnetic Resonance Imaging) devices.

[0100] According to at least one of the embodiments described above, the correction of the structure area can be assisted.

[0101] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, changes, and combinations of the embodiments can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and its equivalent scope.

Explanation of Reference Numerals

[0102] 1 Ultrasonic diagnostic device 2 Ultrasonic probe 3 Device main body 31 Transmission circuit 32 Reception circuit 33 Memory circuit 34 Input circuit 35 Display circuit 36 Communication circuit 37 Processing circuit 61~65,61T,J1,J2 Structure area 71, M contour 371 Signal processing function 372 Image generation function 373 Display control function 374A Detection function 374B Measurement function 374C Selection function 374D Decision function 374E Deformation function 375 System control function 500 Display screen 510A~510C, 550A~550P, 560A~560C, 561D, 570 Ultrasonic image 510D Structure image 560D Composite image 580 Rendering image 581 Cluster d, d1, d2, d3 Distance G, G1, G2, G3 Correction range P, Q Position S Subject U Cursor VD Volume data

Claims

1. A detection unit that detects, as each structure region, each region corresponding to the at least one structure from volume data regarding at least one structure in a subject; A determination unit that determines a correction range with reference to the position of the cursor based on the distance between the position of the cursor in the volume data and one of the detected structure regions; A display control unit that displays the position of the cursor, the one structure region, and the determined correction range in at least one medical image reconstructed from the volume data; A medical image diagnostic apparatus comprising the above.

2. The determination unit determines the correction range such that the correction range becomes larger as the distance becomes longer. The medical image diagnostic apparatus according to Claim 1.

3. The determination unit determines the correction range based on the distance between the position of the cursor and the position closest to the position of the cursor in the one structure region. The medical image diagnostic apparatus according to Claim 1.

4. The determination unit determines the position closest to the position of the cursor in the one structure region as the center of the correction range. The medical image diagnostic apparatus according to Claim 1.

5. The at least one medical image is a plurality of two-dimensional medical images, and the display control unit displays the position of the cursor, the one structure region, and the determined correction range in the plurality of two-dimensional medical images. The medical image diagnostic apparatus according to Claim 1.

6. The plurality of two-dimensional medical images are a plurality of MPR images orthogonal to each other. The medical image diagnostic apparatus according to Claim 5.

7. The plurality of two-dimensional medical images are a plurality of slice images parallel to each other. The medical image diagnostic apparatus according to Claim 5.

8. The at least one medical image is a three-dimensional medical image, and the display control unit displays the position of the cursor, the one structure region, and the determined correction range in the three-dimensional medical image. The medical image diagnostic apparatus according to Claim 1.

9. The apparatus further includes a selection unit that selects the one structure region from among the detected structure regions according to an operation by an operator. The display control unit displays the selected structure region in the at least one medical image, and does not display other structure regions different from the selected structure region among the detected structure regions. The medical image diagnostic apparatus according to claim 1.

10. The apparatus further includes a deforming unit that deforms the one structure region included in the determined correction range in response to an operation of the cursor in the at least one medical image. The display control unit rotates and displays the deformed structure region. The medical image diagnostic apparatus according to claim 1.

11. A detection unit that detects each region corresponding to the at least one structure as each structure region from volume data regarding at least one structure in a subject; A determination unit that determines a correction range based on the position of the cursor in the volume data and the distance between the position of the cursor and one of the detected structure regions; A display control unit that displays the position of the cursor, the one structure region, and the determined correction range in at least one medical image reconstructed from the volume data. An ultrasonic diagnostic apparatus comprising the above.

12. Detecting, as each structure region, each region corresponding to the at least one structure from volume data regarding at least one structure in a subject; Determining a correction range based on the position of the cursor in the volume data and the distance between the position of the cursor and one of the detected structure regions; Displaying the position of the cursor, the one structure region, and the determined correction range in at least one medical image reconstructed from the volume data. A medical image display method.

13. On a computer, A detection function for detecting, as each structure region, each region corresponding to the at least one structure from volume data regarding at least one structure in a subject; A determination function for determining a correction range based on the position of the cursor in the volume data and the distance between the position of the cursor and one of the detected structure regions; In at least one medical image reconstructed from the volume data, a display control function for displaying the position of the cursor, the one structure region, and the determined correction range; A medical image display program for realizing the above.

Images