Medical image processing device, ultrasound diagnostic device, and program
The medical image processing apparatus simplifies contour setting in myocardial function analysis by automating contour estimation and providing adjustable correction modes through a touch panel interface, enhancing user experience and accuracy.
Patent Information
- Application Number
- JP2021078947
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-05-07
- Publication Date
- 2025-12-05
- Estimated Expiration
- 2041-05-07
AI Technical Summary
Conventional methods for setting desired contours in myocardial function analysis using artificial intelligence are complicated due to varying adjustments based on cross-sections, requiring manual intervention with devices like trackballs.
A medical image processing apparatus with a contour estimation unit that automatically estimates contours and a correction unit that adjusts the contours based on user-selected modes, simplifying the process through a touch panel interface.
Facilitates easier and more consistent contour setting by allowing users to select correction modes, reducing operational complexity and improving accuracy in myocardial function analysis.
Smart Images

Figure 0007780875000001 
Figure 0007780875000002 
Figure 0007780875000003
Abstract
Description
[Technical Field]
[0001] The embodiments disclosed in the present specification and drawings relate to a medical image processing apparatus, an ultrasound diagnostic apparatus, and a program. [Background technology]
[0002] When obtaining left ventricular ejection fraction (EF) in myocardial function analysis, a tracing contour is set to trace the myocardium. Conventional technology exists that automatically estimates this using artificial intelligence (AI).
[0003] Although conventional technology can automatically estimate contours, some users make further adjustments using a trackball or other device. In this case, the amount and location of contour adjustments vary depending on the cross-section of the structure. As a result, the operations required to set the desired contour can become complicated. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-22463 Summary of the Invention [Problem to be solved by the invention]
[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to facilitate the operation until the user sets the desired contour. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]
[0006] A medical image processing apparatus according to an embodiment includes a contour estimation unit, an acquisition unit, and a contour correction unit. The contour estimation unit estimates a contour of a desired structure based on a medical image. The acquisition unit accepts a desired correction mode from among a plurality of correction modes for correcting the estimated contour. The contour correction unit corrects the estimated contour in accordance with the desired correction mode. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of an ultrasonic diagnostic apparatus according to the first embodiment. [Figure 2] FIG. 2 is a perspective view showing the appearance of the main body of the ultrasonic diagnostic apparatus according to the first embodiment. [Figure 3] FIG. 3 is a top view showing the appearance of an input device connected to the ultrasound diagnostic apparatus according to the first embodiment. [Figure 4] FIG. 4 is a flowchart for explaining the operation of the processing circuit that executes the contour setting process in the first embodiment. [Figure 5] FIG. 5 is a diagram illustrating a display screen before the automatic contour estimation process is performed in the first embodiment. [Figure 6] FIG. 6 is a diagram for explaining parameter settings for the automatic contour estimation process in the first embodiment. [Figure 7] FIG. 7 is a diagram for explaining parameter settings for the automatic contour estimation process in the first embodiment. [Figure 8] FIG. 8 is a diagram for explaining parameter settings for the automatic contour estimation process in the first embodiment. [Figure 9] FIG. 9 is a diagram for explaining parameter settings for the automatic contour estimation process in the first embodiment. [Figure 10] FIG. 10 is a diagram illustrating a display screen after the automatic contour estimation process is performed in the first embodiment. [Figure 11] FIG. 11 is a diagram for explaining transitions between a plurality of correction modes in the first embodiment. [Figure 12] FIG. 12 is a diagram for explaining a method of switching the correction mode in the first embodiment. [Figure 13] FIG. 13 is a diagram for explaining a plurality of points that define the contour in the first embodiment. [Figure 14] FIG. 14 is a diagram illustrating a table in which correction modes, directions, and correction amounts are associated with each other in the first embodiment. [Figure 15] FIG. 15 is a diagram illustrating a table in which directions, points, and correction amounts are associated with each other for correction mode M1 in the table of FIG. [Figure 16] FIG. 16 is a diagram illustrating a table in which directions, points, and correction amounts are associated with each other for correction mode M2 in the table of FIG. [Figure 17] FIG. 17 is a diagram for explaining the transition of a plurality of corrected contours corresponding to a plurality of correction modes in the first embodiment. [Figure 18] FIG. 18 is a diagram showing another example of the table of FIG. [Figure 19] FIG. 19 is a diagram showing another example of the table of FIG. [Figure 20] FIG. 20 is a diagram showing another example of the table of FIG. [Figure 21] FIG. 21 is a diagram illustrating a display screen after execution of the contour correction process in the first embodiment. [Figure 22] FIG. 22 is a diagram illustrating a table in which cross sections and correction modes are associated with each other in the first embodiment. [Figure 23] FIG. 23 is a diagram illustrating a display screen before execution of the contour correction process in the first application example of the first embodiment. [Figure 24] FIG. 24 is a diagram illustrating a display screen after execution of the contour correction process in the first application example of the first embodiment. [Figure 25]FIG. 25 is a diagram illustrating a table associating correction modes, directions, and correction amounts in the second application example of the first embodiment. [Figure 26] FIG. 26 is a block diagram showing an example of the configuration of an ultrasonic diagnostic apparatus according to the second embodiment. [Figure 27] FIG. 27 is a flowchart for explaining the operation of a processing circuit that executes the contour setting process in the second embodiment. [Figure 28] FIG. 28 is a diagram showing another example of the table of FIG. 14 in which the correction amount has been changed by the correction amount calculation process in the second embodiment. [Figure 29] FIG. 29 is a diagram showing another example of the table of FIG. [Figure 30] FIG. 30 is a block diagram showing an example of the configuration of a medical image processing apparatus according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0008] Hereinafter, embodiments of an ultrasound diagnostic apparatus and a medical image processing apparatus will be described in detail with reference to the drawings.
[0009] (First embodiment) Fig. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to the first embodiment. The ultrasound diagnostic apparatus 1 in Fig. 1 includes an apparatus main body 100 and an ultrasound probe 101. The apparatus main body 100 is connected to an input device 102 and an output device 103. The apparatus main body 100 is also connected to an external device 104 via a network NW. The external device 104 is, for example, a server equipped with PACS (Picture Archiving and Communication Systems).
[0010] The ultrasonic probe 101 performs an ultrasonic scan of a scan region in a living body P, which is a subject, under the control of, for example, the device main body 100. The ultrasonic probe 101 has, for example, a plurality of piezoelectric transducers, a matching layer provided between the plurality of piezoelectric transducers and a case, and a backing material that prevents ultrasonic waves from propagating backward in the radiation direction from the plurality of piezoelectric transducers. The ultrasonic probe 101 is, for example, a two-dimensional array probe in which a plurality of ultrasonic transducers are arranged along a first element array direction (elevation direction) and a second element array direction (azimuth direction). The ultrasonic probe 101 is detachably connected to the device main body 100. The ultrasonic probe 101 may be provided with buttons that are pressed for offset processing, operations to freeze an ultrasound image (freeze operation), and the like.
[0011] The multiple piezoelectric transducers generate ultrasonic waves based on a drive signal supplied from an ultrasonic transmission circuit 110 (described later) included in the device main body 100. This causes ultrasonic waves to be transmitted from the ultrasonic probe 101 to the living body P. When ultrasonic waves are transmitted from the ultrasonic probe 101 to the living body P, the transmitted ultrasonic waves are reflected successively by discontinuous surfaces of acoustic impedance in the body tissue of the living body P and received as reflected wave signals by the multiple piezoelectric transducers. The amplitude of the received reflected wave signals depends on the difference in acoustic impedance at the discontinuous surfaces from which the ultrasonic waves are reflected. Furthermore, when a transmitted ultrasonic pulse is reflected by a moving blood flow or the surface of a heart wall, etc., the reflected wave signal undergoes a frequency shift due to the Doppler effect, depending on the velocity component of the moving object in the direction of ultrasonic transmission. The ultrasonic probe 101 receives the reflected wave signal from the living body P and converts it into an electrical signal.
[0012] 1 illustrates an example of the connection relationship between one ultrasonic probe 101 and the device main body 100. However, it is possible to connect multiple ultrasonic probes to the device main body 100. Which of the multiple connected ultrasonic probes is to be used for ultrasonic scanning can be arbitrarily selected, for example, by using a software button on a touch panel, which will be described later.
[0013] The device main body 100 is a device that generates an ultrasound image based on a reflected wave signal received by an ultrasound probe 101. The device main body 100 has an ultrasound transmission circuit 110, an ultrasound reception circuit 120, an internal storage circuit 130, an image memory 140, an input interface 150, an output interface 160, a communication interface 170, and a processing circuit 180.
[0014] The ultrasonic transmission circuit 110 is a processor that supplies a drive signal to the ultrasonic probe 101. The ultrasonic transmission circuit 110 is realized by, for example, a trigger generation circuit, a delay circuit, and a pulser circuit. The trigger generation circuit repeatedly generates rate pulses for forming transmitted ultrasonic waves at a predetermined rate frequency. The delay circuit provides each rate pulse generated by the trigger generation circuit with a delay time for each of the multiple piezoelectric transducers required to focus the ultrasonic waves generated from the ultrasonic probe into a beam and determine the transmission directivity. The pulser circuit applies drive signals (drive pulses) to the multiple ultrasonic transducers provided in the ultrasonic probe 101 at a timing based on the rate pulse. By changing the delay time provided to each rate pulse using the delay circuit, the transmission direction from the surfaces of the multiple piezoelectric transducers can be freely adjusted.
[0015] Furthermore, the ultrasound transmission circuit 110 can arbitrarily change the output intensity of the ultrasound waves using the drive signal. In the ultrasound diagnostic device, increasing the output intensity can reduce the influence of ultrasound attenuation within the living body P. By reducing the influence of ultrasound attenuation, the ultrasound diagnostic device can acquire a reflected wave signal with a high S / N ratio during reception.
[0016] Generally, when ultrasound propagates through a living body P, the strength of the ultrasound vibration (also called acoustic power), which corresponds to the output intensity, attenuates. The attenuation of acoustic power occurs due to absorption, scattering, reflection, and the like. The degree of reduction in acoustic power depends on the frequency of the ultrasound and the distance in the direction of ultrasound radiation. For example, the degree of attenuation increases as the frequency of the ultrasound increases. Furthermore, the longer the distance in the direction of ultrasound radiation, the greater the degree of attenuation.
[0017] The ultrasonic receiving circuit 120 is a processor that performs various processes on the reflected wave signals received by the ultrasonic probe 101 to generate received signals. The ultrasonic receiving circuit 120 generates received signals based on the reflected wave signals of ultrasound acquired by the ultrasonic probe 101. Specifically, the ultrasonic receiving circuit 120 is realized by, for example, a preamplifier, an A / D converter, a demodulator, and a beamformer. The preamplifier amplifies the reflected wave signals received by the ultrasonic probe 101 for each channel and performs gain correction processing. The A / D converter converts the gain-corrected reflected wave signals into digital signals. The demodulator demodulates the digital signals. For example, the beamformer applies a delay time required to determine the reception directivity to the demodulated digital signals and adds together the multiple digital signals with the applied delay time. The addition processing of the beamformer generates a received signal in which the reflection components from the direction corresponding to the reception directivity are emphasized.
[0018] The internal storage circuitry 130 includes a processor-readable storage medium, such as a magnetic storage medium, an optical storage medium, or a semiconductor memory. The internal storage circuitry 130 stores a program for transmitting and receiving ultrasound waves, a program related to myocardial function analysis (described later), and various data. The various data include, for example, parameters and a look-up table (LUT) used during program execution. The program and various data may be pre-stored in the internal storage circuitry 130. Alternatively, the program and various data may be stored in a non-transitory storage medium, distributed, read from the non-transitory storage medium, and installed in the internal storage circuitry 130. The internal storage circuitry 130 also stores B-mode image data, contrast image data, and image data related to blood flow images generated by the processing circuitry 180 in accordance with operations input via the input interface 150. The internal storage circuitry 130 can also transfer the stored image data to an external device 104 or the like via the communication interface 170.
[0019] The internal storage circuit 130 may be a drive device that reads and writes various information from and to a portable storage medium such as a CD drive, a DVD drive, or a flash memory. The internal storage circuit 130 can also write stored data to the portable storage medium and store the data in the external device 104 via the portable storage medium.
[0020] The image memory 140 has a processor-readable storage medium, such as a magnetic storage medium, an optical storage medium, or a semiconductor memory. The image memory 140 stores image data corresponding to a plurality of frames immediately before a freeze operation, which are input via the input interface 150. The image data stored in the image memory 140 is, for example, continuously displayed (cine display).
[0021] The internal storage circuit 130 and the image memory 140 do not necessarily have to be realized by independent storage devices. The internal storage circuit 130 and the image memory 140 may be realized by a single storage device. Furthermore, the internal storage circuit 130 and the image memory 140 may each be realized by multiple storage devices.
[0022] The input interface 150 accepts various instructions from an operator via the input device 102 (input unit). Examples of the input device 102 include a mouse, a keyboard, a panel switch, a slider switch, a trackball, a rotary encoder, an operation panel, and a touch panel. The input interface 150 is connected to the processing circuit 180 via a bus, for example, and converts operation instructions input by the operator into electrical signals and outputs the electrical signals to the processing circuit 180. Note that the input interface 150 is not limited to those connected to physical operation components such as a mouse and a keyboard. For example, a circuit that receives electrical signals corresponding to operation instructions input from an external input device provided separately from the ultrasound diagnostic apparatus 1 and outputs the electrical signals to the processing circuit 180 is also included as an example of an input interface.
[0023] The output interface 160 is an interface for outputting, for example, an electrical signal from the processing circuit 180 to the output device 103. The output device 103 is any display such as a liquid crystal display, an organic EL display, an LED display, a plasma display, or a CRT display. The output device 103 may be a touch panel display that also serves as the input device 102. In addition to the display, the output device 103 may further include a speaker that outputs audio. The output interface 160 is connected to the processing circuit 180 via, for example, a bus, and outputs the electrical signal from the processing circuit 180 to the output device 103.
[0024] Fig. 2 is a perspective view showing the appearance of the main body of the ultrasound diagnostic apparatus according to the first embodiment. An input device 102 and an output device 103 are connected to the main body 100 of Fig. 2. A user operates the input device 102 and visually checks the output device 103 to obtain desired clinical information.
[0025] 3 is a top view showing the appearance of an input device connected to the ultrasound diagnostic apparatus in the first embodiment. The input device 102 in FIG. 3 includes a touch panel 1021, a first operation unit 1022, and a second operation unit 1023.
[0026] For example, a setting screen of the ultrasound diagnostic apparatus is displayed on the touch panel 1021. The setting screen includes a software button for switching the connected ultrasound probe, a software button for starting a predetermined application, and setting items that can be changed in response to operations on the first operation unit 1022.
[0027] Specifically, an instruction to execute an application related to myocardial function analysis (myocardial function analysis application) is associated with the software button SB1 shown in Fig. 3. When the user selects the software button SB1, the ultrasound diagnostic apparatus 1 executes the myocardial function analysis application.
[0028] The first operation unit 1022 is configured with, for example, a dial-type knob, a switch that moves up and down, a switch that moves left and right, etc. The first operation unit 1022 is used, for example, when changing setting items displayed on the screen of the touch panel 1021.
[0029] The second operation unit 1023 is configured with, for example, a dial ring, a hardware button, a wheel, a trackball, etc. The second operation unit 1023 is used, for example, in a myocardial function analysis application, when setting parameters for a process of setting the contour of a structure (contour setting process).
[0030] Specifically, the second operation unit 1023 has a left button LB and a right button RB, which correspond to hardware buttons, a wheel H, and a trackball TB. For example, the user uses the trackball TB to move a pointer displayed on the display. The user also uses the left button LB, the right button RB, and the wheel H to perform various operations on the application.
[0031] The communication interface 170 is connected to the external device 104 via, for example, a network NW, and performs data communication with the external device 104 .
[0032] The processing circuitry 180 is, for example, a processor that functions as the core of the ultrasound diagnostic apparatus 1. The processing circuitry 180 executes a program stored in the internal storage circuitry 130 (storage unit) to realize a function corresponding to the program. The processing circuitry 180 has, for example, a B-mode processing function 181, a Doppler processing function 182, an image generation function 183, an acquisition function 184 (acquisition unit), a contour estimation function 185 (contour estimation unit), a contour correction function 186 (contour correction unit), a display control function 187 (display control unit), and a system control function 188 (control unit).
[0033] The B-mode processing function 181 is a function that generates B-mode data based on the received signal (echo signal) received from the ultrasound receiving circuit 120. In the B-mode processing function 181, the processing circuit 180 performs, for example, envelope detection processing and logarithmic compression processing on the received signal received from the ultrasound receiving circuit 120, and generates data (B-mode data) that expresses the signal strength (echo reflection strength) of the received signal as a brightness value (luminance value). The generated B-mode data is stored in a RAW data memory (not shown) as B-mode RAW data on a two-dimensional ultrasound scan line (raster).
[0034] Furthermore, the processing circuitry 180 can perform harmonic imaging using the B-mode processing function 181. Harmonic imaging is an imaging method that utilizes not only fundamental wave components contained in reflected ultrasonic wave signals but also harmonic components (harmonic components). Harmonic imaging includes, for example, tissue harmonic imaging (THI), which does not use a contrast agent, and contrast harmonic imaging (CHI), which uses a contrast agent.
[0035] THI can extract harmonic components using an imaging method called the Amplitude Modulation (AM) method, the Phase Modulation (PM) method, or the AMPM method, which is a combination of the AM and PM methods.
[0036] In the AM, PM, and AMPM methods, ultrasonic waves with different amplitudes and phases are transmitted multiple times along the same scan line. This allows the ultrasonic receiving circuit 120 to generate multiple pieces of reflected wave data for each scan line and output the generated reflected wave data. The processing circuit 180 extracts harmonic components by performing addition and subtraction processing of the multiple pieces of reflected wave data for each scan line using the B-mode processing function 181 in accordance with the modulation method. The processing circuit 180 then performs envelope detection processing and the like on the reflected wave data of the harmonic components to generate B-mode data.
[0037] Furthermore, in CHI, for example, harmonic components are extracted using a frequency filter. The processing circuitry 180 can separate reflected wave data (harmonic components) whose reflection source is the contrast agent from reflected wave data (fundamental wave components) whose reflection source is tissue within the living body P using a B-mode processing function 181. As a result, the processing circuitry 180 can select harmonic components from the contrast agent using a filter and generate B-mode data for generating contrast image data.
[0038] The B-mode data for generating contrast image data is data that represents the echo reflection intensity from the contrast agent as a reflection source, expressed as a brightness value. The processing circuitry 180 can also extract the fundamental wave component from the reflected wave data of the living body P to generate B-mode data for generating tissue image data.
[0039] The Doppler processing function 182 is a function that generates data (Doppler information) that extracts motion information based on the Doppler effect of a moving object within a ROI (Region Of Interest) set in a scan area by performing frequency analysis on the received signal received from the ultrasound receiving circuit 120. The generated Doppler information is stored in a RAW data memory (not shown) as Doppler RAW data (also referred to as Doppler data) on a two-dimensional ultrasound scan line.
[0040] Specifically, the processing circuitry 180 uses the Doppler processing function 182 to estimate, for example, the average velocity, average variance, average power, etc., as motion information of a moving object at each of a plurality of sample points, and generates Doppler data indicating the estimated motion information. The moving object is, for example, blood flow, tissue such as a heart wall, or a contrast agent. The processing circuitry 180 according to this embodiment uses the Doppler processing function 182 to estimate, for each of a plurality of sample points, the average velocity of blood flow, the variance of blood flow velocity, the power value of blood flow signals, etc., as motion information of blood flow (blood flow information), and generates Doppler data indicating the estimated blood flow information.
[0041] The image generation function 183 is a function that generates B-mode image data based on data generated by the B-mode processing function 181. For example, in the image generation function 183, the processing circuitry 180 converts (scan converts) a scan line signal sequence of an ultrasound scan into a scan line signal sequence of a video format typified by a television or the like, and generates image data for display (display image data). Specifically, the processing circuitry 180 performs RAW-to-pixel conversion on the B-mode RAW data stored in the RAW data memory, for example, by performing coordinate conversion according to the ultrasound scanning form of the ultrasound probe 101, thereby generating two-dimensional B-mode image data (also referred to as ultrasound image data) composed of pixels. In other words, the processing circuitry 180 generates a plurality of ultrasound images (medical images) corresponding to a plurality of consecutive frames by transmitting and receiving ultrasound waves using the image generation function 183.
[0042] Furthermore, the processing circuitry 180 generates Doppler image data in which blood flow information is visualized, for example, by performing RAW-to-pixel conversion on the Doppler RAW data stored in the RAW data memory. The Doppler image data is mean velocity image data, variance image data, power image data, or image data combining these. The processing circuitry 180 generates, as the Doppler image data, color Doppler image data in which blood flow information is displayed in color, and Doppler image data in which one piece of blood flow information is displayed in a grayscale waveform.
[0043] The acquisition function 184 is a function that acquires instruction information input by the user. The instruction information includes, for example, an instruction to execute an application or function and an instruction to select an arbitrary item. For example, in the acquisition function 184, the processing circuitry 180 accepts a desired correction mode from among multiple correction modes for contour correction input by the user. The processing circuitry 180 also accepts information on the cross section of a structure input by the user.
[0044] The contour estimation function 185 is a function that estimates the contour of a structure. For example, in the contour estimation function 185, the processing circuitry 180 estimates the contour of a desired structure based on a medical image. Specifically, the processing circuitry 180 estimates the contour of a structure included in medical image data by applying a trained model to the medical image data. The trained model is, for example, a machine learning model that has been prepared in advance and trained by machine learning based on ultrasound image data including the structure.
[0045] Furthermore, the processing circuitry 180 may estimate the contour of the structure further based on information about the cross section of the structure. The information about the cross section of the structure is, for example, data in a one-hot vector format, in which the presence or absence of an element corresponding to the type of cross section of the structure is represented by "0" or "1." The trained model may be prepared according to the information about the cross section of the structure, or one model may be prepared regardless of the information about the cross section of the structure.
[0046] In this embodiment, the medical image is an ultrasound image acquired by the ultrasound probe 101. The structure is, for example, myocardium. When the structure is myocardium, the information on the cross section of the structure is information on a reference cross-sectional image of the heart. The reference cross-sectional image is, for example, an apical two-chamber view (Apical-2Ch: A2C), an apical three-chamber view (Apical-3Ch: A3C), and an apical four-chamber view (Apical-4Ch: A4C). Note that in the ultrasound images, the apex is positioned at the top of each of the A2C, A3C, and A4C images.
[0047] In this embodiment, the contour of the structure corresponds to the myocardium of the left ventricle. The contour of the myocardium includes a first contour line corresponding to the endocardium of the left ventricle and a second contour line set outside the first contour line. In this embodiment, the first contour line and the second contour line are each an open curve with a convex shape on the apex side, for example.
[0048] The machine learning model according to this embodiment is typically a deep neural network (DNN), which is a multi-layer network model that mimics the neural circuits of a biological brain. A DNN includes a composite function with parameters that is defined by a combination of multiple adjustable functions and parameters.
[0049] Although the trained model of this embodiment correctly estimates contours based on ultrasound images, it is not necessarily optimized as a contour for myocardial evaluation. For example, because the apex of the heart in an ultrasound image is closest to the body surface, artifacts due to multiple reflections of the ultrasound beam are likely to occur, and the position of the apex of the heart may be depicted at a deeper position than it actually is. Furthermore, for example, the free wall of the myocardium in an ultrasound image is often located at a point where the deflection angle of the ultrasound beam is large, i.e., a point far from the center. This makes it easy for the ultrasound beam to drift laterally, and the position of the free wall may be depicted closer to the inner cavity than it actually is. Furthermore, for example, if a structure within the cardiac cavity is included within the thickness of the ultrasound beam in the slice direction, the position of the endocardium may be depicted further inward than it actually is.
[0050] The contour correction function 186 is a function that corrects an estimated contour. For example, in the contour correction function 186, the processing circuit 180 corrects the estimated contour in accordance with a desired correction mode. In this embodiment, the correction mode is a mode for correcting in a direction that widens the contour that serves as a reference. The reference contour is, for example, a contour estimated by the contour estimation function 185. Hereinafter, a state in which no contour correction is performed will be referred to as "correction mode M0."
[0051] For example, when four correction modes 1 to 4 are set, a plurality of correction amounts and a plurality of correction modes are respectively associated and stored in advance in the internal storage circuit 130. The plurality of correction modes may be set so that the correction amount increases as the number assigned to each mode increases. Note that an increase in the correction amount corresponds to the area of the region included in the contour in the Nth correction mode (e.g., N>3≧0) being larger than the area of the region included in the contour in the N+1th correction mode.
[0052] The display control function 187 is a function that causes an image based on various ultrasound image data generated by the image generation function 183 to be displayed on a display serving as the output device 103. Specifically, for example, the processing circuitry 180 uses the display control function 187 to control the display of an image based on B-mode image data, Doppler image data, or image data including both generated by the image generation function 183. The processing circuitry 180 may also cause the contour of a structure to be displayed on the ultrasound image.
[0053] More specifically, the processing circuitry 180 uses the display control function 187 to convert (scan convert) a scan line signal sequence of an ultrasound scan into a scan line signal sequence of a video format typified by a television or the like, and generates display image data. The processing circuitry 180 may also perform various processes on the display image data, such as dynamic range, brightness, contrast, and gamma curve correction, and RGB conversion. The processing circuitry 180 may also add supplementary information, such as text information of various parameters, scales, and body marks, to the display image data. The processing circuitry 180 may also generate a user interface (GUI: Graphical User Interface) for an operator to input various instructions via an input device, and display the GUI on a display.
[0054] The system control function 188 is a function that controls the overall operation of the ultrasound diagnostic apparatus 1. For example, in the system control function 188, the processing circuitry 180 controls the ultrasound transmission circuitry 110 and the ultrasound reception circuitry 120 based on parameters related to the transmission and reception of ultrasound.
[0055] Furthermore, the processing circuitry 180 may use the system control function 188 to store, for example, parameters that have been set or changed during execution of the program in the internal storage circuitry 130. Specifically, the processing circuitry 180 stores, in the internal storage circuitry 130, information on the cross section received by the acquisition function 184 in association with the correction mode.
[0056] The configuration of the ultrasound diagnostic apparatus according to the first embodiment has been described above. Next, the operation of the contour setting process according to the first embodiment will be described. The contour setting process according to the first embodiment includes a process of automatically estimating a contour (automatic contour estimation process) and a process of correcting the automatically estimated contour (contour correction process).
[0057] Fig. 4 is a flowchart for explaining the operation of a processing circuit that executes contour setting processing in the first embodiment. The contour setting processing in Fig. 4 is started, for example, by a user executing a myocardial function analysis application.
[0058] (Step ST110) When the myocardial function analysis application is executed, the processing circuitry 180 executes the acquisition function 184. When the acquisition function 184 is executed, the processing circuitry 180 accepts the selection of a cross section. At this time, the user selects a cross section that matches the ultrasound image displayed on the display.
[0059] (Step ST120) After accepting the selection of the cross section, the processing circuitry 180 accepts the execution of automatic tracing by the acquisition function 184. At this time, the user selects a software button associated with the execution of automatic tracing (automatic contour estimation processing).
[0060] Specific examples of user operations in steps ST110 and ST120 will be described below with reference to FIGS.
[0061] FIG. 5 is a diagram illustrating an example of a display screen before execution of the automatic contour estimation process in the first embodiment. The display screen 200 in FIG. 5 includes a parameter setting area 210 and an image display area 220. A drop-down menu DD and a software button SB2 are displayed in the parameter setting area 210. An ultrasound image 221 is displayed in the image display area 220. The ultrasound image 221 shows, for example, an apical four-chamber view. The user can move a pointer P displayed on the display screen 200 by, for example, operating a trackball TB. The user can also select a software button pointed to by the pointer P by, for example, operating a left button LB, a right button RB, and a wheel H.
[0062] 6 to 9 are diagrams for explaining parameter settings for the automatic contour estimation process in the first embodiment. FIGS. 6 to 9 show a portion of the display screen 200. The user moves the pointer P and clicks on the drop-down DD to display a drop-down list displaying multiple items. The drop-down list displays, for example, Apical-2Ch, Apical-3Ch, and Apical-3Ch, which are items for the reference cross section. The user selects the item "Apical-4Ch" corresponding to the apical four-chamber view shown in the ultrasound image 221. With the item "Apical-4Ch" selected, the user selects the software button SB2. This operation executes the automatic contour estimation process.
[0063] When the automatic contour estimation process is executed, the software button SB2 is highlighted as shown in Fig. 9. The value displayed within the software button SB2 corresponds to the correction mode. In Fig. 9, the value "0" is displayed, indicating the correction mode M0.
[0064] (Step ST130) After receiving a command to execute automatic tracing, the processing circuitry 180 executes the contour estimation function 185. When the contour estimation function 185 is executed, the processing circuitry 180 estimates the contour of the structure based on the ultrasound image. At this time, the processing circuitry 180 may estimate the contour of the structure based on information on the selected cross section.
[0065] (Step ST140) After the contour of the structure is estimated, the processing circuitry 180 causes the display control function 187 to display the estimated contour on the ultrasound image.
[0066] FIG. 10 is a diagram illustrating a display screen after the automatic contour estimation process in the first embodiment is performed. In FIG. 10, the item "Apical-4Ch" is selected and the automatic contour estimation process is performed, whereby a first contour line OL10 and a second contour line OL20, which are estimated contours, are displayed on the ultrasound image 221. The first contour line OL10 corresponds to the endocardium of the left ventricle of the heart. The second contour line OL20 is set outward from the first contour line OL10 at a predetermined interval. The first contour line OL10 and the second contour line OL20 are open curves that are convex toward the apex of the heart. Therefore, the area surrounded by the first contour line OL10 and the second contour line OL20 corresponds to the myocardium related to the left ventricle.
[0067] (Step ST150) After displaying the estimated contour on the ultrasound image, the processing circuitry 180 receives a selection of a correction mode via the acquisition function 184. At this time, the user selects a desired correction mode from among a plurality of correction modes by performing an arbitrary operation on the highlighted software button SB2.
[0068] FIG. 11 is a diagram for explaining transitions among a plurality of correction modes in the first embodiment. FIG. 11 shows a list of five correction modes M0 to M4, sorted by the numerical values displayed within the software button SB2. These five correction modes M0 to M4 can be transitioned among the correction modes by a user operation. Transitions among the correction modes can be made in either ascending order (e.g., 0 → 1 → 2 → 3 → 4 → 0 → 1...) or descending order (e.g., 4 → 3 → 2 → 1 → 0 → 4 →...). Hereinafter, an operation for transitioning in ascending order will be referred to as an ascending operation, and an operation for transitioning in descending order will be referred to as a descending operation.
[0069] 12 is a diagram for explaining a method for switching the correction mode in the first embodiment. In step ST210, the user moves the pointer P onto a software button in the correction mode M1. Next, the user performs step ST220a in the case of an ascending operation, and performs step ST220b in the case of a descending operation.
[0070] In step ST220a, the user clicks the left button LB (left button click) or scrolls up (upward scroll) the wheel H. By operating this step ST220a, the state becomes correction mode M2 in step ST230a, and at the same time, contour correction processing is executed.
[0071] On the other hand, in step ST220b, the user clicks the right button RB (right button click) or scrolls down (down scroll) the wheel H. By operating this step ST220b, the state becomes correction mode M0 in step ST230b, and at the same time, contour correction processing is executed.
[0072] (Step ST160) After receiving the selection of the correction mode, the processing circuitry 180 executes the contour correction function 186. When the contour correction function 186 is executed, the processing circuitry 180 corrects the contour according to the selected correction mode. Specifically, for example, the processing circuitry 180 uses a table that associates the correction mode with the direction and the amount of correction, and corrects the contour according to the correction mode. In this embodiment, it is assumed that at least a portion of the contour changes each time the correction mode is switched. Note that the following description focuses on widening the contour by ascending order operation.
[0073] FIG. 13 is a diagram illustrating multiple points that define a contour in the first embodiment. The first contour line OL10 in FIG. 13 is, for example, seven points Po1 to Po7 that are seamlessly connected. In other words, movement of any of these points corresponds to a change in the shape of the contour line. Hereinafter, contour correction will be described in association with the movement of these seven points Po1 to Po7. Note that the second contour line OL20 can be treated in the same way as the first contour line OL10, and therefore a description thereof will be omitted.
[0074] FIG. 14 is a diagram illustrating a table associating correction modes, directions, and correction amounts in the first embodiment. Table 300 in FIG. 14 associates correction modes, directions, and correction amounts when A4C is set as the cross section. For example, correction mode M1 associates the direction "up" with a correction amount "3," and is a process of expanding the contour in the upward direction in correction mode M0 by the correction amount "3." Correction mode M2 associates the direction "right" with a correction amount "3," and is a process of expanding the contour in the right direction in correction mode M1 by the correction amount "3." Correction mode M3 associates the direction "up" with a correction amount "3," and is a process of expanding the contour in the upward direction in correction mode M2 by the correction amount "3." Correction mode M4 associates the direction "right" with a correction amount "3," and is a process of expanding the contour in the right direction in correction mode M3 by the correction amount "3."
[0075] For example, the "direction" of the table 300 corresponds to one of the seven points Po1 to Po7 in FIG. 13. For example, the direction "up" corresponds to point Po4, the direction "right" corresponds to the three points Po1 to Po3, and the direction "left" corresponds to the three points Po5 to Po7. These directions may also be associated with clinical sites. For example, since the table 300 sets the A4C cross section, the direction "up" may correspond to the apex side, the direction "right" may correspond to the free wall (or lateral wall) side, and the direction "left" may correspond to the septum side.
[0076] Furthermore, when A2C is set as the cross section, the direction "up" may be associated with the apex side, the direction "right" with the anterior wall side, and the direction "left" with the inferior wall side. Furthermore, when A3C is set as the cross section, the direction "up" may be associated with the apex side, the direction "right" with the septal side, and the direction "left" with the inferior wall side.
[0077] Fig. 15 is a diagram illustrating an example of a table associating directions, points, and correction amounts for correction mode M1 in the table of Fig. 14. Table 310 in Fig. 15 associates directions, points, and correction amounts for correction mode M1. Since correction mode M1 associates the direction "up" with a correction amount of "3," this is a process of widening point Po4 corresponding to the upward direction by the correction amount of "3."
[0078] Fig. 16 is a diagram illustrating an example of a table associating directions, points, and correction amounts for correction mode M2 in the table of Fig. 14. Table 320 in Fig. 16 associates directions, points, and correction amounts for correction mode M2. Since correction mode M2 associates the direction "right" with a correction amount of "3," the process widens each of the three points Po1 to Po3 corresponding to the right direction by the correction amount of "3."
[0079] 17 is a diagram for explaining the transition of a plurality of corrected contours corresponding to a plurality of correction modes in the first embodiment. Five ultrasound images 222A to 222E are shown in FIG. 17, which correspond to the five correction modes M0 to M4, respectively. The directions of the arrows on the ultrasound images correspond to the directions of the table 300 in FIG. 14.
[0080] Specifically, correction mode M1 corrects the contour of correction mode M0 in the upward direction, correction mode M2 corrects the contour of correction mode M1 in the right direction, correction mode M3 corrects the contour of correction mode M2 in the upward direction, and correction mode M4 corrects the contour of correction mode M3 in the right direction. Note that the first contour line and the second contour line are corrected by the same amount of correction. That is, the distance between the first contour line and the second contour line is the same in all five correction modes M0 to M4.
[0081] In the above, regarding the correction mode, mainly the direction and the correction amount are consistent. For example, in table 320 of FIG. 16, the direction and the correction amount are consistent. However, regarding the correction mode, the direction and the correction amount do not necessarily have to be consistent. This will be explained below with reference to FIG. 18.
[0082] Fig. 18 is a diagram showing another example of the table of Fig. 16. Table 320A of Fig. 18 associates directions, points, and correction amounts in correction mode M2. Correction mode M2 corresponds to the direction "right" and the correction amount "3" in table 300 of Fig. 14, but in table 320A, point Po1 is set to the correction amount "1," and points Po2 and Po3 are set to the correction amount "3."
[0083] In summary, the correction amounts for the multiple correction modes are set according to cross-sectional information (e.g., cardiac reference cross-sectional image). The correction amounts for the multiple correction modes are set in a direction that widens the estimated contour. The correction amounts for the multiple correction modes are set so that the larger the assigned number, the larger the correction amount. The correction amounts for the multiple correction modes are the same regardless of the direction. The correction amounts for the first contour line and the second contour line are the same for the multiple correction modes.
[0084] Note that the multiple correction modes may vary the amount of correction depending on the direction. For example, table 300A shown in FIG. 19 is a diagram showing another example of the table in FIG. 14. Table 300 in FIG. 14 sets the amount of correction to "3" regardless of the direction, but table 300A sets the amount of correction to "5" for the direction "up" and the amount of correction to "3" for the direction "right." For example, if the direction "up" is associated with the apex side, the multiple correction modes will be set so that the amount of correction for the apex side of the left ventricle is larger than the other amounts of correction.
[0085] Furthermore, the correction amounts for the first and second contour lines may differ among the multiple correction modes. For example, table 300B shown in Fig. 20 associates correction modes with directions, amounts of correction for the inside (first contour line), and amounts of correction for the outside (second contour line). Table 300B sets the amount of correction for the inside to "3" and the amount of correction for the outside to "4" for each correction mode.
[0086] (Step ST170) After correcting the contour, the processing circuitry 180 causes the display control function 187 to display the corrected contour on the ultrasound image.
[0087] 21 is a diagram illustrating a display screen after execution of the contour correction process in the first embodiment. In FIG. 21, correction mode M2 is set, and therefore a first contour line OL11 and a second contour line OL21 corresponding to correction mode M2 are displayed on the ultrasound image 221. The first contour line OL11 and the second contour line OL21 are obtained by correcting the first contour line OL10 and the second contour line OL20, for example, based on the table 300 in FIG. 14.
[0088] (Step ST180) After displaying the corrected contour on the ultrasound image, the processing circuitry 180 causes the system control function 188 to associate the selected cross section with the selected correction mode and store them in the internal storage circuitry 130. After step ST180, the contour setting process ends.
[0089] 22 is a diagram illustrating a table associating cross sections with correction modes in the first embodiment. Table 400 in FIG. 22 associates cross sections with correction modes. Table 400 stores cross sections and correction modes selected by a user. For example, processing circuitry 180 may estimate a contour by automatic tracing, and then select a correction mode stored in association with the set cross section by referring to table 400, and display the corrected contour on an ultrasound image.
[0090] As described above, the ultrasound diagnostic apparatus according to the first embodiment acquires an ultrasound image using a probe, estimates the contour of a desired structure based on the ultrasound image, accepts a desired correction mode from among a plurality of correction modes for correcting the estimated contour, and corrects the estimated contour in accordance with the desired correction mode.
[0091] Therefore, the ultrasound diagnostic apparatus according to the first embodiment does not require the user to manually set the estimated contour from scratch, and therefore can facilitate the operation up to setting the contour as desired by the user.
[0092] (First application example of the first embodiment) In the first embodiment, the contour setting process is performed by displaying one ultrasound image in the image display area. However, the present invention is not limited to this. In a first application example of the first embodiment, a plurality of ultrasound images may be displayed in the image display area and the contour setting process may be performed.
[0093] 23 is a diagram illustrating a display screen before execution of contour correction processing in a first application example of the first embodiment. The image display area 220 in FIG. 23 displays a first ultrasonic image 221A, a second ultrasonic image 221B, and a third ultrasonic image 221C. The first ultrasonic image 221A is a cross-sectional image of A2C, the second ultrasonic image 221B is a cross-sectional image of A3C, and the third ultrasonic image is a cross-sectional image of A4C. The first ultrasonic image 221A, the second ultrasonic image 221B, and the third ultrasonic image 221C are cross-sectional images generated from, for example, the same volume data.
[0094] In Fig. 23, the item "Apical-2Ch" is selected and the automatic contour estimation process is performed, so that the automatically estimated contour is displayed on each ultrasound image, and the characters "AUTO 0" indicating that the contour has been automatically estimated are displayed. After the state in Fig. 23, i.e., the state of correction mode M0, the user sets the correction mode to M2 by executing the contour correction process.
[0095] FIG. 24 is a diagram illustrating a display screen after execution of contour correction processing in the first application example of the first embodiment. In FIG. 24, by setting correction mode M2 for the item "Apical-2Ch," the characters "AUTO 2" indicating correction mode M2 are displayed on the first ultrasonic image 221A. At this time, the ultrasonic diagnostic device 1 similarly applies correction mode M2 to the contours displayed in the second ultrasonic image 221B and the third ultrasonic image 221C. This allows the user to easily set the contour desired by the user when displaying multiple ultrasonic images and executing contour correction processing, since the user only needs to set the contour for one ultrasonic image. In other words, when correcting the contours of multiple cross-sectional images, the correction mode for the contours of the other cross-sectional images may be set according to the correction mode accepted for one cross-sectional image.
[0096] Here, when the correction mode M2 is selected on the first ultrasonic image 221A, the correction amount of the correction mode applied to the contours displayed on the second ultrasonic image 221B and the third ultrasonic image 221C may be set according to the correction amount of the correction mode selected on the first ultrasonic image 221A. That is, when contours of a plurality of cross-sectional images are corrected, the correction amount of one cross-sectional image may be set according to the correction amount of the other cross-sectional image.
[0097] (Second application example of the first embodiment) In the first embodiment, the correction amount is set in a direction that widens the estimated contour, but this is not limiting. In a second application example of the first embodiment, the correction amount may be set in a direction that narrows the estimated contour. For example, in the field of obstetrics and gynecology, when automatically estimating the contour of a fetus, there are cases where the placenta located outside the actual contour of the fetus is erroneously recognized and the contour of the fetus is estimated. In this case, it is conceivable to correct the automatically estimated contour in a direction that narrows it.
[0098] FIG. 25 is a diagram illustrating a table associating correction modes, directions, and correction amounts in a second application example of the first embodiment. Table 300C in FIG. 25 associates correction modes, directions, and correction amounts when extracting the contour of a fetus. For example, correction mode M1 is associated with the direction "inside" and a correction amount of "-3," and is a process of narrowing the contour of correction mode M0 inward by the correction amount of "-3." The same applies to the other correction modes M2 to M4. That is, the multiple correction modes are set so that the correction amount decreases as the assigned number increases. A smaller correction amount corresponds to the area of the area included in the contour in the Nth correction mode being smaller than the area of the area included in the contour in the N+1th correction mode. Therefore, the same effects as those of the first embodiment can be expected.
[0099] (Third application example of the first embodiment) In the first embodiment, the contour of the myocardium is estimated and corrected as a specific example, but this is not limiting. For example, the ultrasound diagnostic apparatus 1 according to the first embodiment may estimate and correct the contour of another region, such as the prostate. Furthermore, information on the corrected contour may be used for alignment by another medical imaging apparatus. Examples of other medical imaging apparatuses include an X-ray computed tomography (CT) apparatus and a magnetic resonance imaging (MRI) apparatus.
[0100] (Second embodiment) In the first embodiment, the correction amount for correcting the automatically estimated contour is determined in advance and associated with the correction mode. On the other hand, in the second embodiment, the correction amount is calculated and associated with the correction mode.
[0101] Fig. 26 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to the second embodiment. The ultrasound diagnostic apparatus 1A in Fig. 26 includes an apparatus main body 100A and an ultrasound probe 101. The apparatus main body 100A is connected to an input device 102 and an output device 103. The apparatus main body 100A is also connected to an external device 104 via a network NW. The external device 104 is, for example, a server equipped with a PACS.
[0102] The device main body 100A is a device that generates an ultrasound image based on a reflected wave signal received by the ultrasound probe 101. The device main body 100A has an ultrasound transmission circuit 110, an ultrasound reception circuit 120, an internal storage circuit 130, an image memory 140, an input interface 150, an output interface 160, a communication interface 170, and a processing circuit 180A.
[0103] The processing circuitry 180A is, for example, a processor that functions as the core of the ultrasound diagnostic apparatus 1A. The processing circuitry 180A executes a program stored in the internal storage circuitry 130 to realize a function corresponding to the program. The processing circuitry 180A has, for example, a B-mode processing function 181, a Doppler processing function 182, an image generation function 183, an acquisition function 184 (acquisition unit), a contour estimation function 185 (contour estimation unit), a contour correction function 186 (contour correction unit), a display control function 187 (display control unit), a system control function 188 (control unit), and a correction amount calculation function 189 (correction amount calculation unit).
[0104] The correction amount calculation function 189 is a function that calculates a correction amount. For example, in the correction amount calculation function 189, the processing circuitry 180A calculates a correction amount for correcting an estimated contour based on a medical image. Specifically, the processing circuitry 180A calculates a plurality of correction amounts by comparing the acquired medical image with a reference image.
[0105] In the system control function 188 in the second embodiment, the processing circuit 180A stores a plurality of calculated correction amounts and a plurality of correction modes in association with each other. At this time, the processing circuit 180A may update the correction amount that has already been set with the calculated correction amount, or may store the calculated correction amount in association with the correction amount that has already been set (default correction amount) while keeping it stored.
[0106] The configuration of the ultrasound diagnostic apparatus according to the second embodiment has been described above. Next, the operation of the contour setting process according to the second embodiment will be described. The contour setting process according to the second embodiment includes an automatic contour estimation process, a contour correction process, and further a process of calculating a correction amount based on an ultrasound image (correction amount calculation process).
[0107] Fig. 27 is a flowchart for explaining the operation of a processing circuit that executes contour setting processing in the second embodiment. The contour setting processing in Fig. 27 is started, for example, by a user executing a myocardial function analysis application.
[0108] 27, the following steps ST210 and ST220 are added between steps ST140 and ST150 in the flowchart of Fig. 4. Therefore, the description of steps ST110 to ST180 will be omitted.
[0109] (Step ST210) After displaying the estimated contour on the ultrasound image in step ST140, the processing circuitry 180A executes the correction amount calculation function 189. When the correction amount calculation function 189 is executed, the processing circuitry 180A calculates the correction amount based on the ultrasound image.
[0110] (Step ST220) After the correction amount is calculated, the processing circuit 180A causes the system control function 188 to associate the calculated correction amount with the correction mode and store them in the internal storage circuit 130. After step ST220, the contour setting process proceeds to step ST150.
[0111] Fig. 28 is a diagram showing another example of the table of Fig. 14 in which the correction amount has been changed by the correction amount calculation process in the second embodiment. Table 300D in Fig. 28 shows that the correction amount has been changed from the default correction amount of "3" to the calculated correction amount of "2" by the correction amount calculation process. Note that the default correction amount may be managed in a separate table.
[0112] Fig. 29 is a diagram showing another example of the table of Fig. 28. Table 300E of Fig. 29 shows that a default correction amount of "3" is stored, and a calculated correction amount of "2" is also stored.
[0113] As described above, by storing the default correction value, even if user A changes the correction value through the correction amount calculation process, the correction value can be restored to the default when used by another user B. Also, the correction value may be reset to the default by turning off the power to the device.
[0114] As described above, the ultrasound diagnostic apparatus according to the second embodiment acquires an ultrasound image using a probe, estimates the contour of a desired structure based on the ultrasound image, calculates a plurality of correction amounts based on a medical image, stores the plurality of correction amounts in association with a plurality of correction modes for correcting the estimated contour, accepts a desired correction mode from the plurality of correction modes, and corrects the estimated contour in accordance with the desired correction mode.
[0115] Therefore, the ultrasonic diagnostic apparatus according to the second embodiment can facilitate the operation up to setting the contour desired by the user, similar to the ultrasonic diagnostic apparatus according to the first embodiment.
[0116] (Third embodiment) In the first and second embodiments, an ultrasound diagnostic apparatus having multiple functions related to contour setting processing has been described, whereas in the third embodiment, a medical image processing apparatus having these multiple functions will be described.
[0117] Fig. 30 is a block diagram showing an example of the configuration of a medical image processing apparatus according to the third embodiment. The medical image processing apparatus 500 in Fig. 30 is connected to an input device 501 and an output device 502. The medical image processing apparatus 500 is also connected to a medical imaging apparatus 503 via a network NW. The medical imaging apparatus 503 corresponds to, for example, an ultrasound diagnostic apparatus. The input device 501 is substantially the same as the input device 102 in Fig. 1, and typically corresponds to a mouse and keyboard. The output device 502 is substantially the same as the output device 103 in Fig. 1.
[0118] The medical image processing device 500 is, for example, a computer capable of executing a myocardial function analysis application. The medical image processing device 500 includes a memory circuitry 510, an input interface 520, an output interface 530, a communication interface 540, and a processing circuitry 550.
[0119] The memory circuitry 510 includes a processor-readable storage medium, such as a magnetic storage medium, an optical storage medium, or a semiconductor memory. The memory circuitry 510 stores a program related to myocardial function analysis and various data. The program and various data may be pre-stored in the memory circuitry 510. The program and various data may be stored in a non-transitory storage medium, distributed, read from the non-transitory storage medium, and installed in the memory circuitry 510. The internal memory circuitry 130 also stores medical image data generated by the medical imaging device 503 or the like in accordance with operations input via the input interface 150. The memory circuitry 510 can also transfer the stored medical image data to an external device or the like via the communication interface 540.
[0120] The storage circuitry 510 may be a drive device that reads and writes various information from and to a portable storage medium such as a CD drive, a DVD drive, or a flash memory. The storage circuitry 510 can also write stored data to the portable storage medium and store the data in an external device via the portable storage medium.
[0121] The input interface 520 receives various instructions from an operator via the input device 501. The input interface 520 is connected to the processing circuitry 550 via, for example, a bus, converts the operation instructions input by the operator into electrical signals, and outputs the electrical signals to the processing circuitry 550. Note that the input interface 520 is not limited to being connected to physical operation components such as a mouse and a keyboard. For example, a circuit that receives electrical signals corresponding to operation instructions input from an external input device provided separately from the medical image processing apparatus 500 and outputs the electrical signals to the processing circuitry 550 is also included as an example of the input interface.
[0122] The output interface 530 is an interface for outputting, for example, an electrical signal from the processing circuit 550 to the output device 502. The output interface 530 is connected to the processing circuit 550 via, for example, a bus, and outputs the electrical signal from the processing circuit 550 to the output device 502.
[0123] The communication interface 540 is connected to the medical imaging device 503 and an external device via, for example, a network NW, and performs data communication between the devices.
[0124] The processing circuitry 550 is, for example, a processor that functions as the core of the medical image processing apparatus 500. The processing circuitry 550 executes a program stored in the storage circuitry 510 to realize functions corresponding to the program. The processing circuitry 550 has an acquisition function 184 (acquisition unit), a contour estimation function 185 (contour estimation unit), a contour correction function 186 (contour correction unit), a display control function 187 (display control unit), and a system control function 188 (system control unit) in the first embodiment. The processing circuitry 550 may further have a correction amount calculation function 189 (correction amount calculation unit) in the second embodiment. These various functions are substantially the same as those in the first and second embodiments, and therefore description thereof will be omitted.
[0125] As described above, the medical image processing apparatus according to the third embodiment estimates the contour of a desired structure based on a medical image, accepts a desired correction mode from among a plurality of correction modes for correcting the estimated contour, and corrects the estimated contour according to the desired correction mode.
[0126] Therefore, the medical image processing apparatus according to the third embodiment is expected to have the same effects as the first and second embodiments.
[0127] (Application example of the third embodiment) The medical imaging device 503 is not limited to an ultrasound diagnostic device. For example, the medical imaging device 503 may be an X-ray diagnostic device, a CT, or an MRI. Furthermore, the medical image is not limited to an ultrasound image. For example, the medical image may be an X-ray image, a CT image, or a magnetic resonance (MR) image.
[0128] According to at least one of the embodiments described above, the operation up to setting the contour desired by the user can be facilitated.
[0129] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]
[0130] 1,1A Ultrasound diagnostic equipment 100,100A device body 101 Ultrasound probe 102 Input Device 1021 Touch Panel 1022 First operating unit 1023 Second operating unit 103 Output Device 104 External device 110 Ultrasonic transmission circuit 120 Ultrasonic receiving circuit 130 Internal memory circuit 140 image memory 150 Input Interface 160 output interface 170 Communication Interface 180,180A processing circuit 181 B-mode processing function 182 Doppler processing function 183 Image generation function 184 Acquisition Function 185 Contour estimation function 186 Contour correction function 187 Display control function 188 System Control Functions 189 Correction amount calculation function 200 display screen 210 Parameter setting area 220 Image display area 221 Ultrasound Images 221A First ultrasound image 221B Second ultrasound image 221C Third ultrasound image 222A~222E Ultrasound image 300, 300A~300E, 310, 320, 320A, 400 Table 500 Medical image processing equipment 501 Input Device 502 Output Device 503 Medical Imaging Equipment 510 Memory circuit 520 input interface 530 output interface 540 Communication Interface 550 Processing Circuit DD Dropdown H Wheel LB Left button M0~M4 Correction mode NW Network OL10, OL11 First contour line OL20,OL21 Second contour line P pointer Po1~Po7 points RB Right button SB1, SB2 software buttons TB Trackball
Claims
1. a contour estimation unit that estimates the contour of a structure included in a medical image; an acquisition unit that sequentially switches one correction mode displayed on a selection screen of a display device by repeated operations and accepts selection of the one correction mode from among a plurality of correction modes; a contour correction unit that corrects the contour estimated by the contour estimation unit in accordance with correction information associated with the selected one correction mode; a display control unit that displays the contour corrected by the contour correction unit on the medical image; Equipped with the correction information includes a correction direction and a correction amount; a medical image processing apparatus, wherein the correction information associated with a first correction mode among the plurality of correction modes differs from the correction information associated with a second correction mode among the plurality of correction modes that is different from the first correction mode in at least one of the correction direction and the correction amount.
2. the contour correction unit corrects the contour estimated by the contour estimation unit in accordance with the correction information including a correction position associated with the one selected correction mode; The medical image processing device according to claim 1 .
3. the one correction mode displayed on the selection screen of the display device is represented by information including a number, the contour correction unit corrects the contour in accordance with the correction amount determined in accordance with the magnitude of the number represented by the selected one of the correction modes; The medical image processing device according to claim 1 .
4. When a plurality of medical images are used, the acquisition unit selects the one correction mode for another medical image among the plurality of medical images in response to the selection of the one correction mode for one medical image among the plurality of medical images. The medical image processing device according to claim 1 .
5. The contour estimation unit estimates a contour of the structure included in the medical image by applying a trained model to the medical image. The medical image processing device according to claim 1 .
6. In the plurality of correction modes, a correction amount is set in a direction that widens the estimated contour. The medical image processing device according to any one of claims 1 to 5.
7. the structure is cardiac muscle; In the plurality of correction modes, a correction amount is set according to a reference cross-sectional image of the heart. The medical image processing device according to any one of claims 1 to 6.
8. the reference cross-sectional image of the heart is an apical two-chamber image, the contour corresponds to myocardium associated with a left ventricle of the heart; In the plurality of correction modes, a correction amount on a free wall side of the left ventricle is set to be larger than a correction amount on an inferior wall side. The medical image processing device according to claim 7 .
9. the reference cross-sectional image of the heart is an apical three-chamber image or an apical four-chamber image, the contour corresponds to myocardium associated with a left ventricle of the heart; In the plurality of correction modes, a correction amount on a free wall side of the left ventricle is set to be larger than a correction amount on a septal side. The medical image processing device according to claim 7 .
10. In the plurality of correction modes, a correction amount on the apex side of the left ventricle is set to be larger than other correction amounts.
10. The medical image processing device according to claim 8 or 9.
11. the contours include a first contour line corresponding to the endocardium and a second contour line set outside the first contour line; the first contour line and the second contour line are open curves having a convex shape on the apex side; The medical image processing device according to any one of claims 7 to 10.
12. the plurality of correction modes each have an equal amount of correction for the first contour line and an equal amount of correction for the second contour line; The medical image processing device according to claim 11 .
13. the plurality of correction modes each have a different correction amount for the first contour line and a different correction amount for the second contour line; The medical image processing device according to claim 11 .
14. an input unit for selecting the correction mode from the plurality of correction modes; Further comprising: the input unit switches between the plurality of correction modes in response to a scroll operation of a wheel. The medical image processing device according to any one of claims 1 to 13.
15. the medical image is an ultrasound image; a probe for acquiring the ultrasound image; The medical image processing apparatus according to any one of claims 1 to 14, An ultrasound diagnostic device comprising:
16. Computer a contour estimation unit that estimates the contour of a structure included in a medical image; an acquisition unit that sequentially switches one correction mode displayed on a selection screen of the display device by repeated operations and accepts selection of the one correction mode from among a plurality of correction modes; a contour correction unit that corrects the contour estimated by the contour estimation unit in accordance with correction information associated with the selected one correction mode; a display control unit that displays the contour corrected by the contour correction unit on the medical image, the correction information includes a correction direction and a correction amount; the correction information associated with a first correction mode among the plurality of correction modes differs from the correction information associated with a second correction mode among the plurality of correction modes that is different from the first correction mode in at least one of the correction direction and the correction amount.
Citation Information
Patent Citations
Medical image processor, ultrasonic diagnostic apparatus, and medical image diagnostic apparatus
JP2010259656A
Medical image diagnostic apparatus
JP2013005983A
Moving object contour extraction apparatus, left ventricle image separation apparatus, moving object contour extraction method and left ventricle image separation method
JP2013022463A
Image processor, ultrasonic diagnostic apparatus and image processing program
JP2013111434A
Image processor and method for the same
JP2018051001A