Ultrasonic diagnostic apparatus

Abstract

The present application provides a technique for automatically setting an optimal ROI regardless of the kind of a mode to be converted. An ultrasonic diagnostic apparatus according to an embodiment includes an acquisition unit, an estimation unit, a calculation unit, and a display control unit. The acquisition unit acquires first ultrasonic image data of a first mode. The estimation unit estimates a position of an object of examination included in the first ultrasonic image data by applying a learned model to the first ultrasonic image data, and outputs an estimation result. The calculation unit calculates coordinates of a region of interest corresponding to a second mode different from the first mode, based on the estimation result and information of the second mode. The display control unit displays the region of interest in second ultrasonic image data of the second mode based on the coordinates.

Description

[0001] Cross-reference to related applications

[0002] This application is based on and asserts the priority interests of Japanese Patent Application No. 2021-064204, filed April 5, 2021, and Japanese Patent Application No. 2022-048858, filed March 24, 2022, the entire contents of which are incorporated herein by reference. Technical Field

[0003] Embodiments of the present invention relate to an ultrasonic diagnostic device. Background Technology

[0004] In recent years, ultrasound diagnostic devices have sometimes been equipped with multiple display modes. These modes include, for example, B-mode, which modulates the brightness of the reflected echo signal of ultrasound waves and displays it on the screen; blood flow imaging mode, which displays blood flow in a two-dimensional image; and shear wave elastography (SWE) model, which measures the stiffness of biological tissues. In these display modes, the size of the region of interest (ROI) containing the object being examined (e.g., tumor, lesion) varies.

[0005] For example, in blood flow imaging mode, it is preferable to set the ROI size to include both the object being examined and a surrounding region with an area larger than the object being examined. On the other hand, in SWE mode, it is preferable to set the ROI size to include only the object being examined.

[0006] As mentioned above, since the optimal ROI size varies depending on the display mode, users need to set the ROI every time there is a change (transition) in the display mode. This is not only a burden for users, but may also prevent the optimal ROI from being set.

[0007] Existing technical documents

[0008] Patent Document 1: Japanese Patent Application Publication No. 2020-68797 Summary of the Invention

[0009] The technical problem to be solved by the present invention is to automatically set the optimal ROI regardless of the type of mode to be transformed.

[0010] The ultrasound diagnostic apparatus of this embodiment includes an acquisition unit, an estimation unit, a calculation unit, and a display control unit. The acquisition unit acquires first ultrasound image data of a first mode. The estimation unit estimates the position of the object to be examined contained in the first ultrasound image data by applying a learned model to the first ultrasound image data and outputs the estimation result. The calculation unit calculates the coordinates of the region of interest corresponding to the second mode based on the estimation result and information of a second mode different from the first mode. The display control unit displays the region of interest in the second ultrasound image data of the second mode based on the coordinates.

[0011] The purpose of the invention is to automatically set the optimal ROI regardless of the type of pattern to be transformed. Attached Figure Description

[0012] Figure 1 This is a block diagram illustrating a structural example of the ultrasonic diagnostic apparatus according to the first embodiment.

[0013] Figure 2 This diagram illustrates an example of screen display and internal processing related to the automatic setting of the area of ​​interest in the first embodiment.

[0014] Figure 3 This is a flowchart illustrating an example of the operation of the processing circuit that performs the automatic setting of the region of interest in the first embodiment.

[0015] Figure 4 It means Figure 3 This is an example of a flowchart for calculating and processing the ROI coordinates.

[0016] Figure 5 This is a diagram illustrating the determination of a testing area from a single testing unit.

[0017] Figure 6 This diagram illustrates how a testing area is determined from multiple testing units.

[0018] Figure 7 This diagram illustrates how multiple testing areas are determined from multiple testing units.

[0019] Figure 8 This is a diagram illustrating an example of the likelihood of detection units contained in multiple detection areas.

[0020] Figure 9 This is a diagram illustrating the calculation of ROI coordinates based on the detection area.

[0021] Figure 10 This diagram illustrates an example of screen display and internal processing related to the automatic setting of the area of ​​interest in the second embodiment.

[0022] Figure 11This is a flowchart illustrating an example of the operation of the processing circuit that performs the automatic setting of the region of interest in the second embodiment.

[0023] Figure 12 This is a diagram illustrating the display screen after the automatic setting of the area of ​​interest in the first and second embodiments has been performed.

[0024] Figure 13 This is a diagram used to illustrate a first example related to the automatic setting of the region of interest in other embodiments.

[0025] Figure 14 This is a second example used to illustrate the automatic setting of the region of interest process in other embodiments.

[0026] Figure 15 This is a diagram used to illustrate a third example related to the automatic setting of the region of interest in other embodiments.

[0027] Figure 16 This is a block diagram illustrating a structural example of the ultrasonic diagnostic apparatus according to the third embodiment.

[0028] Figure 17 This is a flowchart illustrating a first specific example of the operation of the processing circuit that performs the region of interest resetting process in the third embodiment.

[0029] Figure 18 This is a flowchart illustrating a second specific example of the operation of the processing circuit that performs the region of interest resetting process in the third embodiment.

[0030] Explanation of reference numerals in the attached figures

[0031] 1, 1A…Ultrasound diagnostic device; 100, 100A…Device body; 101…Ultrasound probe; 102…Input device; 103…Output device; 104…External device; 110…Ultrasound transmitting circuit; 120…Ultrasound receiving circuit; 130…Internal storage circuit; 140…Image memory; 150…Input interface; 160…Output interface; 170…Communication interface; 180, 180A…Processing circuit; 1 81…B-mode processing function, 182…Doppler processing function, 183…Image generation function, 184…Acquisition function, 185…Estimation function, 186…Calculation function, 187…Display control function, 188…System control function, 211, 212, 510, 520, 610, 620, 710, 720, 1011, 1012, 1210, 1310, 1330, 1410, 1430, 1 510, 1530… Ultrasonic images; 221, 1021… Model learned; 222… ROI coordinate calculation and processing; 511, 611, 612, 613, 711, 712, 713, 714, 715, 716, 717, 718… Detection units; 521, 621, 721, 722, 723, 910… Detection regions; 920… Rectangle; 930… Region of interest; 1200… Display image. Face, 1212… string, 1320, 1420, 1520… segment image, 1321, 1322, 1323, 1324, 1325, 1421, 1521… region, A1, A2, A3, B1, B2, B3, C1, C2… detection unit, 1331, 1332, 1431, 1531… measured ROI, 1432, 1532… scanned ROI, 1600… reset function. Detailed Implementation

[0032] The ultrasound diagnostic apparatus of this embodiment includes an acquisition unit, an estimation unit, a calculation unit, and a display control unit. The acquisition unit acquires first ultrasound image data of a first mode. The estimation unit estimates the position of the object to be examined contained in the first ultrasound image data by applying a learned model to the first ultrasound image data and outputs the estimation result. The calculation unit calculates the coordinates of the region of interest corresponding to the second mode based on the estimation result and information of a second mode different from the first mode. The display control unit displays the region of interest in the second ultrasound image data of the second mode based on the coordinates.

[0033] Hereinafter, the implementation of the ultrasonic diagnostic device will be described in detail with reference to the accompanying drawings.

[0034] (First Implementation)

[0035] Figure 1 This is a block diagram illustrating a structural example of the ultrasonic diagnostic apparatus according to the first embodiment. Figure 1The ultrasound diagnostic device 1 includes a device body 100 and an ultrasound probe 101. The device body 100 is connected to an input device 102 and an output device 103. Additionally, the device body 100 is connected to an external device 104 via a network NW. The external device 104 may be, for example, a server equipped with a PACS (Picture Archiving and Communication Systems).

[0036] The ultrasonic probe 101 performs ultrasonic scanning on a scanning area within a biological body P, which is the subject of the examination, under control from the device body 100. The ultrasonic probe 101 may include, for example, multiple piezoelectric transducers, a matching layer disposed between the multiple piezoelectric transducers and a housing, and a backing material to prevent ultrasonic waves from propagating rearward from the multiple piezoelectric transducers relative to the radiation direction. The ultrasonic probe 101 may be, for example, a one-dimensional array linear probe with multiple ultrasonic transducers arranged along a predetermined direction. The ultrasonic probe 101 is detachably connected to the device body 100. A button may also be provided on the ultrasonic probe 101 for operations such as biasing and freezing the ultrasonic image (freeze operation).

[0037] Multiple piezoelectric transducers generate ultrasonic waves based on a drive signal supplied from the ultrasonic transmitting circuit 110 (described later) provided in the device body 100. Ultrasonic waves are then transmitted from the ultrasonic probe 101 to the biological body P. When ultrasonic waves are transmitted from the ultrasonic probe 101 to the biological body P, the transmitted ultrasonic waves are reflected sequentially at the discontinuities of acoustic impedance in the tissue of the biological body P, and are received as reflected wave signals by the multiple piezoelectric transducers. The amplitude of the received reflected wave signal depends on the difference in acoustic impedance at the discontinuities of the reflected ultrasonic waves. Furthermore, the reflected wave signal when the transmitted ultrasonic pulse is reflected by a moving blood flow or the surface of the heart wall, etc., is frequency-shifted due to the Doppler effect, depending on the velocity component of the ultrasonic wave transmission direction of the moving body. The ultrasonic probe 101 receives the reflected wave signals from the biological body P and converts them into electrical signals.

[0038] Figure 1 An example is shown showing the connection between an ultrasonic probe 101 and the device body 100. However, multiple ultrasonic probes can be connected to the device body 100. Which of the connected ultrasonic probes is used in an ultrasonic scan can be arbitrarily selected, for example, via a software button on a touch panel described later.

[0039] The main body 100 is a device that generates an ultrasonic image based on the reflected wave signal received by the ultrasonic probe 101. The main body 100 includes an ultrasonic transmitting circuit 110, an ultrasonic receiving circuit 120, an internal storage circuit 130, an image memory 140, an input interface 150, an output interface 160, a communication interface 170, and a processing circuit 180.

[0040] The ultrasonic transmitting circuit 110 is a processor that provides drive signals to the ultrasonic probe 101. The ultrasonic transmitting circuit 110 is implemented, for example, by a trigger generating circuit, a delay circuit, and a pulse generating circuit. The trigger generating circuit repeatedly generates rate pulses at a predetermined rate frequency to form transmitted ultrasonic waves. The delay circuit assigns a delay time to each of the multiple piezoelectric vibrators required to determine the transmission directionality by focusing the ultrasonic waves emitted from the ultrasonic probe into a beam for each rate pulse generated by the trigger generating circuit. The pulse generating circuit applies drive signals (drive pulses) to the multiple ultrasonic vibrators disposed on the ultrasonic probe 101 based on the timing of the rate pulses. By varying the delay time assigned to each rate pulse by the delay circuit, the transmission direction from the surfaces of the multiple piezoelectric vibrators can be arbitrarily adjusted.

[0041] Furthermore, the ultrasonic transmitting circuit 110 can arbitrarily change the output intensity of the ultrasonic wave according to the drive signal. In the ultrasonic diagnostic device, by increasing the output intensity, the effect of ultrasonic wave attenuation within the biological body P can be reduced. By reducing the effect of ultrasonic wave attenuation, the ultrasonic diagnostic device can obtain a reflected wave signal with a large signal-to-noise ratio (S / N) upon reception.

[0042] Typically, when ultrasound propagates within a living organism P, the vibration intensity of the ultrasound waves (also known as acoustic power) attenuates to a level equivalent to the output intensity. This attenuation is caused by absorption, scattering, and reflection. Furthermore, the degree of reduction in acoustic power depends on the frequency of the ultrasound wave and the distance along its direction of propagation. For example, increasing the frequency of the ultrasound wave increases the attenuation. Additionally, the longer the distance along the direction of propagation, the greater the attenuation.

[0043] The ultrasonic receiving circuit 120 is a processor that performs various processes on the reflected wave signal received by the ultrasonic probe 101 to generate a received signal. The ultrasonic receiving circuit 120 generates a received signal for the reflected wave signal of the ultrasonic wave acquired by the ultrasonic probe 101. Specifically, the ultrasonic receiving circuit 120 is implemented, for example, by a preamplifier, an A / D converter, a demodulator, and a beamformer. The preamplifier amplifies the reflected wave signal received by the ultrasonic probe 101 for each channel and performs gain correction processing. The A / D converter converts the gain-corrected reflected wave signal into a digital signal. The demodulator demodulates the digital signal. The beamformer, for example, assigns a delay time to the demodulated digital signal required to determine the receiving directionality and adds multiple digital signals with the assigned delay time. Through the addition processing of the beamformer, a received signal is generated in which the reflected component from the direction corresponding to the receiving directionality is emphasized.

[0044] The internal storage circuit 130 may be a storage medium that can be read by a processor, such as a magnetic storage medium, an optical storage medium, or a semiconductor memory. The internal storage circuit 130 stores programs for implementing ultrasound transceiver, programs related to the automatic setting of the region of interest (described later), and various data. The programs and various data may be pre-stored in the internal storage circuit 130. Alternatively, the programs and various data may be distributed from a non-transitory storage medium, read from the non-transitory storage medium, and installed in the internal storage circuit 130. Furthermore, the internal storage circuit 130 stores B-mode image data, contrast image data, and blood flow image data generated by the processing circuit 180 according to operations input via the input interface 150. The internal storage circuit 130 may also transmit the stored image data to an external device 104 via the communication interface 170.

[0045] Alternatively, the internal storage circuit 130 can also be a drive device that reads and writes various information between removable storage media such as CD drives, DVD drives, and flash memory. The internal storage circuit 130 can also write stored data to removable storage media and store the data in external device 104 via the removable storage media.

[0046] Image memory 140 may be, for example, a storage medium that can be read by a processor, such as a magnetic storage medium, an optical storage medium, or a semiconductor memory. Image memory 140 stores image data corresponding to multiple frames prior to the freeze operation input via input interface 150. The image data stored in image memory 140 may be displayed sequentially, for example (movie display).

[0047] The aforementioned internal storage circuit 130 and image memory 140 do not necessarily need to be implemented using separate storage devices. The internal storage circuit 130 and image memory 140 can also be implemented using a single storage device. Alternatively, the internal storage circuit 130 and image memory 140 can be implemented using multiple storage devices respectively.

[0048] Input interface 150 receives various instructions from the operator via input device 102. Input device 102 may be, for example, a mouse, keyboard, panel switch, slide switch, trackball, rotary encoder, operation panel, or touch panel. Input interface 150 is connected to processing circuit 180 via a bus, for example, to convert the operation instructions input by the operator into electrical signals and output the electrical signals to processing circuit 180. Furthermore, input interface 150 is not limited to connection to physical operating components such as mice and keyboards. For example, circuitry that receives electrical signals corresponding to operation instructions input from external input devices separately from the ultrasound diagnostic device 1 and outputs these electrical signals to processing circuit 180 is also included in the example of an input interface.

[0049] Output interface 160 is, for example, an interface for outputting electrical signals from processing circuit 180 to output device 103. Output device 103 can be any display such as a liquid crystal display, organic EL display, LED display, plasma display, or CRT display. Output device 103 can also be a touch panel type display that also serves as input device 102. In addition to the display, output device 103 may also include a speaker for outputting sound. Output interface 160 is connected to processing circuit 180 via a bus, for example, to output electrical signals from processing circuit 180 to output device 103.

[0050] The communication interface 170 is connected to the external device 104, for example, via a network NW, to perform data communication with the external device 104.

[0051] The processing circuit 180 is, for example, a processor that functions as the central processing unit of the ultrasound diagnostic device 1. The processing circuit 180 executes a program stored in the internal storage circuit 130 to perform functions corresponding to that program. The processing circuit 180 includes, for example, a B-mode processing function 181, a Doppler processing function 182, an image generation function 183, an acquisition function 184 (acquisition unit), an estimation function 185 (estimation unit), a calculation function 186 (calculation unit), a display control function 187 (display control unit), and a system control function 188.

[0052] B-mode processing function 181 is a function that generates B-mode data based on the received signal received from the ultrasonic receiving circuit 120. In B-mode processing function 181, processing circuit 180 performs envelope detection processing and logarithmic compression processing on the received signal received from ultrasonic receiving circuit 120, for example, to generate data (B-mode data) in which the signal strength is expressed as brightness. The generated B-mode data is stored as B-mode RAW data on a two-dimensional ultrasonic scan line (grating) in a RAW data memory (not shown).

[0053] Furthermore, the processing circuit 180, through the B-mode processing function 181, can perform contrast echo imaging, such as Contrast Harmonic Imaging (CHI). That is, the processing circuit 180 can separate the reflected wave data (higher harmonic components or frequency division components) of the biological organism P injected with contrast agent from the reflected wave data (fundamental component) originating from the tissue within the biological organism P. Thus, the processing circuit 180 can extract the higher harmonic components or frequency division components from the reflected wave data of the biological organism P to generate B-mode data for generating contrast imaging data.

[0054] B-mode data used to generate contrast image data is data representing the signal intensity of the reflected wave using the contrast agent as a reflection source, expressed in terms of brightness. Additionally, the processing circuit 180 can extract the fundamental component from the reflected wave data of the biological organism P to generate B-mode data for generating tissue image data.

[0055] Furthermore, during CHI, the processing circuit 180 can extract harmonic components (higher harmonic components) using a method different from the filtering method described above. In harmonic imaging, an imaging method called AMM is used, which combines AM and PM methods, and employs amplitude modulation (AM) or phase modulation (PM) methods.

[0056] In the AM, PM, and AMPM methods, ultrasonic waves with different amplitudes or phases are transmitted multiple times along the same scan line. As a result, the ultrasonic receiving circuit 120 generates multiple reflected wave data along each scan line and outputs the generated reflected wave data. The processing circuit 180, through the B-mode processing function 181, performs addition and subtraction operations on the multiple reflected wave data from each scan line, corresponding to the modulation method, to extract harmonic components. Furthermore, the processing circuit 180 performs envelope detection processing on the reflected wave data of the harmonic components, generating B-mode data.

[0057] The Doppler processing function 182 is a function that generates data (Doppler information) by performing frequency analysis on the received signal received from the ultrasonic receiving circuit 120, thereby extracting motion information of a moving body within a ROI (Region of Interest) set in the scanning area based on the Doppler effect. The generated Doppler information is stored as Doppler RAW data (also referred to as Doppler data) on the two-dimensional ultrasonic scanning line in a RAW data memory (not shown).

[0058] Specifically, the processing circuit 180 uses the Doppler processing function 182 to estimate, for example, the average velocity, average variance, and average power value at multiple sampling points as motion information of the moving body, and generates Doppler data representing the estimated motion information. The moving body can be, for example, blood flow, tissues such as the heart wall, or a contrast agent. In this embodiment, the processing circuit 180 uses the Doppler processing function 182 to estimate the average velocity of the blood flow, the variance of the blood flow velocity, and the power value of the blood flow signal at multiple sampling points as motion information (blood flow information), and generates Doppler data representing the estimated blood flow information.

[0059] Furthermore, the processing circuit 180 can execute a color Doppler method called Color Flow Mapping (CFM) through the Doppler processing function 182. In the CFM method, ultrasound waves are transmitted and received multiple times along multiple scan lines. In the CFM method, for example, by applying an MTI (Moving Target Indicator) filter to a data column at the same location, signals (clutter signals) from stationary or slowly moving tissues are suppressed, and signals from blood flow are extracted. Furthermore, in the CFM method, blood flow information such as blood flow velocity, blood flow variance, and blood flow energy are estimated using the extracted blood flow signals. In the image generation function 183, described later, the distribution of the estimated blood flow information is generated as, for example, ultrasound image data (color Doppler image data) displayed in color in two dimensions. Hereinafter, the mode of extracting blood flow signals using an MTI filter based on the Doppler method and using the extracted blood flow signals for imaging in an ultrasound diagnostic device will be referred to as the blood flow imaging mode. In addition, the so-called color display means that the distribution of blood flow information is displayed in correspondence with the prescribed color code, and grayscale is also included in the color display.

[0060] Blood flow imaging modalities come in various types depending on the desired clinical information. Generally, there are velocity imaging modalities that can visualize the direction of blood flow and the average velocity of blood flow, and power imaging modalities that can visualize the power of the blood flow signal.

[0061] Velocity display using blood flow imaging modes is a color scheme that displays colors corresponding to Doppler frequency shifts based on the direction and average velocity of blood flow. For example, in velocity display using blood flow imaging modes, red tones represent approaching flow, blue tones represent moving flow, and different hues represent different velocities. Velocity display using blood flow imaging modes is sometimes also called color Doppler mode or color Doppler imaging (CDI) mode.

[0062] Power-based blood flow imaging modes, such as those using variations in the hue, brightness (luminance), or chromaticity of reddish colors, represent the power of the blood flow signal. These modes are sometimes referred to as Power Doppler (PD) modes. Compared to velocity-based blood flow imaging modes, power-based modes can depict blood flow with higher sensitivity and are therefore also called high-sensitivity blood flow imaging modes.

[0063] In addition to CDI and PD modes, blood flow imaging modes include Superb Microvascular Imaging (SMI), a mode specifically designed for depicting low flow rates, and Advanced Dynamic Flow (ADF), a mode for high-resolution blood flow imaging. These blood flow imaging modes differ in their imaging methods defined by scanning protocols and signal processing. Furthermore, blood flow imaging modes may also include other modes not mentioned above.

[0064] Image generation function 183 is a function that generates B-mode image data based on data generated by B-mode processing function 181. For example, in image generation function 183, processing circuit 180 converts the scan line signal column of ultrasound scanning (scan conversion) into a scan line signal column of video format, such as television, to generate image data for display. Specifically, processing circuit 180 generates two-dimensional B-mode image data (also called ultrasound image data) composed of pixels by performing RAW-pixel conversion on B-mode RAW data stored in RAW data memory, such as coordinate conversion corresponding to the ultrasound scanning mode of ultrasound probe 101. In other words, processing circuit 180 generates multiple ultrasound images (medical images) corresponding to multiple consecutive frames through image generation function 183 and ultrasound transmission and reception.

[0065] Additionally, the processing circuit 180 generates Doppler image data that visualizes blood flow information, for example, by performing RAW-pixel conversion on the Doppler RAW data stored in the RAW data memory. The Doppler image data is average velocity image data, variance image data, energy image data, or a combination of these. The processing circuit 180 generates color Doppler image data where blood flow information is displayed in color, and Doppler image data where blood flow information is displayed in grayscale as a wave shape, as Doppler image data. The color Doppler image data is generated when the aforementioned blood flow imaging mode is executed.

[0066] The acquisition function 184 is a function that acquires various data related to the automatic setting processing of the area of ​​interest, as described later. Specifically, for example, the processing circuit 180 acquires, through the acquisition function 184, an execution instruction for another display mode different from the current display mode. Additionally, the processing circuit 180 acquires the ultrasound image data of the current display mode at the moment the execution instruction is acquired. Furthermore, the "execution instruction" can also be replaced by information related to other display modes ("display mode information") or information related to the changed display mode ("change mode information").

[0067] The estimation function 185 is a function that estimates the location of an object to be inspected within ultrasonic image data by applying a learned model to the ultrasonic image data. Specifically, for example, the processing circuit 180 applies the learned model to the ultrasonic image data using the estimation function 185, thereby estimating the location of the object to be inspected within the ultrasonic image data and outputting the estimation result. Regarding the estimation of the location of the object to be inspected, for example, if there is a region in the ultrasonic image data with a likelihood above a threshold, it is estimated that the object to be inspected is contained in that region. In this case, the estimation result may include, for example, one or more regions estimated to contain the object to be inspected (which may be referred to as "detection regions" or "detection units"). Conversely, if the estimated likelihood of all regions within the ultrasonic image data is below (or less than) the threshold, it is estimated that the image data does not contain the object to be inspected. In this case, the estimation result may not contain information about detection units, but rather information indicating that the object to be inspected was not detected. That is, the processing circuit 180 outputs the estimation result regardless of whether the location of the object to be inspected is estimated, or in other words, whether a detection unit is contained.

[0068] The learned model described above is, for example, a pre-prepared machine learning model based on ultrasound image data containing the object being inspected. Alternatively, machine learning can segment the ultrasound image data into arbitrary regions, performing the process on each segmented region or on each region obtained by combining the segmented regions. In this case, the estimation function 185 similarly performs estimation processing on each region obtained by segmenting the ultrasound image data into arbitrary regions.

[0069] The machine learning model in this implementation is typically a multi-layered network model that simulates the neural circuits of an organism's brain, namely a deep neural network (DNN). A DNN consists of a parameterized synthesis function defined by a combination of multiple adjustable functions and parameters.

[0070] The calculation function 186 calculates the coordinates (hereinafter referred to as ROI coordinates) of the region of interest corresponding to the desired display mode based on the estimation results. In this embodiment, the "ROI coordinates" include the position and size of the ROI. Specifically, for example, the processing circuit 180 determines one or more detection regions from one or more detection units included in the estimation results using the calculation function 186. Then, the processing circuit 180 selects the most reliable detection region from the one or more detection regions and calculates the ROI coordinates, which at least include the detection region. At this time, the ROI coordinates are calculated according to the desired display mode. The detection region is a whole area where one or more detection units repeat. A detailed explanation follows.

[0071] Furthermore, if the estimated result does not include the object to be inspected, the processing circuit 180 may not perform the processing based on the calculation function 186. In this case, the user manually sets the position and size of the ROI as before.

[0072] Display control function 187 is a function that displays images based on various ultrasonic image data generated by image generation function 183 on a display that serves as an output device 103. Specifically, for example, processing circuit 180 controls the display of images based on B-mode image data, Doppler image data, or image data containing both generated by image generation function 183 on the display via display control function 187.

[0073] More specifically, the processing circuit 180, through the display control function 187, converts (scan conversions) the scan line signal train of an ultrasonic scan into a scan line signal train in a video format, such as television, to generate display image data. Furthermore, the processing circuit 180 can perform various processing on the display image data, such as dynamic range adjustment, brightness adjustment, contrast adjustment, gamma curve correction, and RGB conversion. Additionally, the processing circuit 180 can add various parameter character information, scales, body position markings, and other supplementary information to the display image data. Furthermore, the processing circuit 180 can also display a graphical user interface (GUI) on the display, allowing the operator to input various instructions via an input device.

[0074] Furthermore, through the display control function 187, the processing circuit 180 displays the ROI in the ultrasonic image data based on the ROI coordinates calculated by the calculation function 186. Additionally, the processing circuit 180 can display information related to the automatic setting of the ROI. Specifically, after a change in display mode, the processing circuit 180 displays characters or markers notifying the user that the ROI has been automatically set, or changes the display color of the ROI in the changed display mode. Changing the display color can, for example, change the display color of the automatically set ROI from its previous color, or change the display color of the default ROI displayed when it is not automatically set from its previous color.

[0075] System control function 188 is a function that uniformly controls the operation of the entire ultrasonic diagnostic device 1. For example, in system control function 188, processing circuit 180 controls ultrasonic transmitting circuit 110 and ultrasonic receiving circuit 120 based on parameters related to the transmission and reception of ultrasonic waves.

[0076] In addition, the processing circuit 180 can also execute other imaging modes besides B mode and blood flow imaging mode. Other imaging modes include strain elastography mode, shear wave elastography (SWE) mode, and attenuation imaging (ATI) mode.

[0077] The structure of the ultrasonic diagnostic apparatus according to the first embodiment has been described above. Next, using... Figure 2 A summary of the processing in the first embodiment is provided.

[0078] Figure 2 This diagram illustrates an example of screen display and internal processing related to the automatic setting of the area of ​​interest in the first embodiment. Figure 2In the display screen, ultrasonic images 211 and 212, showing different display modes before and after the mode change, are shown. Additionally, Figure 2 The diagram shows the internal processing that occurs during mode transitions (automatic setting of the area of ​​interest).

[0079] First, the screen display will be explained. The ultrasound diagnostic device 1 of the first embodiment changes the screen display from ultrasound image 211 to ultrasound image 212 based on a user's operation related to mode change. Here, ultrasound image 211 corresponds to the current display mode (which may also be referred to as "first mode," "first display mode," and "display mode before change"). Ultrasound image 212 corresponds to the changed display mode (which may also be referred to as "second mode" and "second display mode"). Additionally, the ROI 213 most suitable for the changed display mode is also displayed in ultrasound image 212. Furthermore, during mode change, the screen update of ultrasound image 211 may be stopped, which is essentially the same as a frozen state.

[0080] Next, the internal processing will be explained. For example, taking advantage of a user's operation related to mode change, processing circuit 180 acquires ultrasonic image data and information related to the changed display mode via acquisition function 184. Processing circuit 180 applies the learned model 221 to the ultrasonic image data via estimation function 185, generating an estimation result related to the ultrasonic image data. Processing circuit 180 performs ROI coordinate calculation processing 222 via calculation function 186, calculating the ROI coordinates corresponding to the changed display mode based on the estimation result and the information of the changed display mode.

[0081] Figure 3 This is a flowchart illustrating an example of the operation of the processing circuit that performs the automatic setting of the region of interest in the first embodiment. Figure 3 The automatic setting of the focus area, as shown, begins, for example, when triggered by a user's operation related to mode change. Furthermore, operations related to mode change include, for example, executing a display mode different from the current display mode.

[0082] (Step ST110)

[0083] When the automatic setting of the area of ​​interest begins, the processing circuit 180 executes the acquisition function 184. When the acquisition function 184 is executed, the processing circuit 180 acquires an execution instruction for a second display mode, which is different from the current first display mode, input by the user. Furthermore, in the following description, the first display mode will be designated as mode B, and the second display mode as the blood flow imaging mode.

[0084] (Step ST120)

[0085] After receiving the execution instruction from the user, the processing circuit 180 also acquires the first ultrasonic image data of the first display mode at the time the execution instruction was received. Alternatively, the acquired first ultrasonic image data may also be dynamic image data containing two or more frames.

[0086] (Step ST130)

[0087] After acquiring the first ultrasonic image data, the processing circuit 180 executes the estimation function 185. When the estimation function 185 is executed, the processing circuit 180 estimates the location of the object to be inspected contained in the first ultrasonic image data by applying a learned model to the first ultrasonic image data, and outputs the estimation result. Specifically, the processing circuit 180 generates an estimation result that includes one or more detection units by applying a learned model to the first ultrasonic image data. Furthermore, if the estimation result does not include the object to be inspected, the estimation result does not include detection units.

[0088] (Step ST140)

[0089] After generating the estimation result, the processing circuit 180 determines whether the estimation result contains the object to be inspected. In other words, the processing circuit 180 determines whether the estimation result contains detection unit information. If the estimation result contains detection unit information, the process proceeds to step ST150. If the estimation result does not contain detection unit information, the process ends.

[0090] (Step ST150)

[0091] After determining that the estimated result contains detection unit information, the processing circuit 180 executes the calculation function 186. When executing the calculation function 186, the processing circuit 180 calculates the ROI coordinates corresponding to the second display mode based on the estimated result (detection unit information). Hereafter, the processing in step ST150 will be referred to as "ROI coordinate calculation processing". Figure 4 The flowchart illustrates a specific example of ROI coordinate calculation and processing.

[0092] Figure 4 It means Figure 3 This is an example of a flowchart for calculating and processing the ROI coordinates. Figure 4 The flowchart from Figure 3 Step ST140 transformation.

[0093] (Step ST151)

[0094] After determining that the estimated result contains detection unit information, the processing circuit 180 determines the detection area based on the detection units contained in the estimated result. Specifically, the processing circuit 180 determines one or more detection areas from one or more detection units. The determination of the detection area will be explained in detail below. Furthermore, "determining one or more detection areas from one or more detection units" includes, for example, determining one detection area from one detection unit, determining one detection area from multiple detection units, and determining any one of multiple detection areas from multiple detection units. Hereinafter, we will use... Figures 5 to 7 Explain the various situations.

[0095] Figure 5 This is a diagram illustrating the determination of a testing area from a single testing unit. Figure 5 The image shows ultrasonic images 510 and 520 before and after the detection area is determined. Ultrasonic image 510 contains a detection unit 511. Therefore, processing circuit 180 determines a detection unit 511 as a detection area. Thus, a determined detection area 521 is shown in ultrasonic image 520. In other words, detection area 521 is composed of a detection unit 511.

[0096] Figure 6 This diagram illustrates how a testing area is determined from multiple testing units. Figure 6 The image shows ultrasonic images 610 and 620 before and after the detection area is determined. Ultrasonic image 610 includes multiple detection units 611 to 613. The multiple detection units 611 to 613 partially overlap each other. Therefore, the processing circuit 180 determines the contour line containing the multiple detection units 611 to 613 as the detection area. Thus, a determined detection area 621 is shown in ultrasonic image 620. In other words, the detection area 621 is composed of multiple detection units 611, 612, and 613.

[0097] Figure 7 This diagram illustrates how multiple testing areas are determined from multiple testing units. Figure 7The ultrasonic image 710 and ultrasonic image 720 before and after determining the detection area are shown. Ultrasonic image 710 includes multiple detection units 711 to 718. Multiple detection units 711 to 713, multiple detection units 714 to 716, and multiple detection units 717 and 718 partially overlap each other. Therefore, processing circuit 180 determines the contour lines containing multiple detection units 711 to 713, the contour lines containing multiple detection units 714 to 716, and the contour lines containing multiple detection units 717 and 718 as detection areas, respectively. Thus, the determined multiple detection areas 721 to 723 are shown in ultrasonic image 720. In other words, detection area 721 is composed of multiple detection units 711, 712, and 713, detection area 722 is composed of multiple detection units 714, 715, and 716, and detection area 723 is composed of multiple detection units 717 and 718.

[0098] (Step ST152)

[0099] After identifying one or more detection areas, the processing circuit 180 determines whether there are two or more detection areas. If there are two or more detection areas, the process proceeds to step ST153. If there are not two or more detection areas (i.e., only one detection area), the process proceeds to step ST155.

[0100] (Step ST153)

[0101] After determining that there are two or more detection areas, the processing circuit 180 calculates the sum of the likelihood values ​​for each detection area.

[0102] (Step ST154)

[0103] After calculating the sum of the likelihood values ​​for each detection region, the processing circuit 180 selects the detection region with the highest sum of likelihood values. The following uses... Figure 8 Provide specific examples of the processing steps ST153 and ST154.

[0104] Figure 8 This is an example of a graph illustrating the likelihood of detection units contained within multiple detection regions. In Figure 8 The text shows the relationship with... Figure 7 The ultrasonic image 720 includes multiple detection areas corresponding to detection areas 721, 722, and 723. Detection area 721 shows multiple detection units A1, A2, and A3 corresponding to multiple detection units 711, 712, and 713. Similarly, detection area 722 shows multiple detection units B1, B2, and B3 corresponding to multiple detection units 714, 715, and 716, and detection area 723 shows multiple detection units C1 and C2 corresponding to multiple detection units 717 and 718.

[0105] For detection area 721, processing circuit 180 calculates a total value of 2.07 by adding the likelihoods of detection unit A1 (0.71), detection unit A2 (0.73), and detection unit A3 (0.63). Similarly, for detection area 722, processing circuit 180 calculates a total value of 2.77 by adding the likelihoods of detection unit B1 (0.91), detection unit B2 (0.93), and detection unit B3 (0.93). Likewise, for detection area 723, processing circuit 180 calculates a total value of 1.24 by adding the likelihoods of detection unit C1 (0.61) and detection unit C2 (0.63). After calculating the total likelihood values ​​for each detection area, processing circuit 180 selects detection area 722, which has the highest total likelihood value.

[0106] (Step ST155)

[0107] After determining that the detection area is a single location in step ST152, or after selecting a detection area in step ST154, the processing circuit 180 calculates the ROI coordinate data corresponding to the second display mode based on the detection area. In other words, the processing circuit 180 calculates the ROI coordinate data corresponding to the second display mode based on the estimation result and the information of the second display mode. Hereinafter, using... Figure 9 Explain a specific example of step ST155.

[0108] Figure 9 This is a diagram illustrating the calculation of ROI coordinates based on the detection area. Figure 9 The text shows the relationship with... Figure 7 and Figure 8 The detection area 722 corresponds to the detection area 910, the rectangle 920 inscribed in the outer periphery of the detection area 910, and the area of ​​interest 930 obtained by magnifying the rectangle 920 at a specified magnification.

[0109] The processing circuit 180 calculates a rectangle 920 based on the detection area 910. Then, the processing circuit 180 magnifies the rectangle 920 at a predetermined magnification rate according to the type of the second display mode, and calculates the area of ​​interest 930. The predetermined magnification rate is "1" or higher, and can be arbitrarily set according to the type of the second display mode. For example, when the second display mode is SWE mode, as long as the object to be inspected is included in the detection area, the predetermined magnification rate "1" can also be set so that the detection area and the area of ​​interest are the same size.

[0110] Furthermore, the calculation of ROI coordinate data is not limited to the above. For example, the ROI coordinate data of the region of interest can also be calculated based on the center and long side of the rectangle calculated based on the detection region. In addition, when calculating the region of interest based on the rectangle, at least one of the size and shape of the region of interest can be changed. Changing the shape of the region of interest is, for example, equivalent to making the ratio of the long side to the short side of the rectangle (aspect ratio) different from the aspect ratio of the region of interest.

[0111] (Step ST160)

[0112] After calculating the ROI coordinates, the processing circuit 180 displays the ROI in the second ultrasonic image data of the second display mode based on the ROI coordinates through the display control function 187.

[0113] As explained above, the ultrasound diagnostic device of the first embodiment acquires first ultrasound image data of a first mode, applies a learned model to the first ultrasound image data, estimates the position of the object to be examined contained in the first ultrasound image data, and outputs the estimation result. Based on the estimation result and information of a second mode that is different from the first mode, it calculates the coordinates of the region of interest corresponding to the second mode, and displays the region of interest in the second ultrasound data of the second mode according to the coordinates.

[0114] Therefore, the ultrasound diagnostic device of the first embodiment can automatically set the optimal ROI regardless of the type of mode to be changed, so there is no need to manually set the ROI every time the mode is changed, which can reduce the trouble for users.

[0115] In addition, the focus is on the automatic setting of the start of the processing in the area and the timing of each processing step, which are not limited to... Figure 3 The processing can be performed in parallel, for example, during the execution of the current first display mode, with automatic setting of the region of interest. In this case, for example, step ST110 can be omitted, and step ST120 can be performed regardless of the user's execution instructions. Then, taking advantage of the operation related to the user's mode change corresponding to step ST110, the estimation process in step ST130 or the ROI coordinate calculation process in step ST150 can be performed.

[0116] Furthermore, the various processes involved in ROI coordinate calculation are not limited to... Figure 4 The processing circuit 180 can select, for example, the detection region containing the detection unit with the highest likelihood from one or more detection regions, or the detection region with the highest number of repetitions of the detection unit from one or more detection regions.

[0117] Furthermore, while the first embodiment considers the case where the estimated result does not include the object to be inspected, it is not limited to this. For example, it may be based on the premise that the ultrasound image data before the conversion includes the object to be inspected. In this case, since the estimated result includes all the objects to be inspected, for example, it is possible to omit the object to be inspected. Figure 3 The ST140 process is described in step 1.

[0118] (Second Implementation)

[0119] In the first embodiment, the case of estimating the position of the object to be inspected using a learned model and calculating the ROI coordinates based on the estimation results was described. In the second embodiment, the case of estimating the ROI coordinates using a learned model will be described. Furthermore, the structure of the ultrasound diagnostic apparatus in the second embodiment is substantially the same as that of the ultrasound diagnostic apparatus 1. Hereinafter, using... Figure 10 A summary of the processing in the second embodiment is provided.

[0120] Figure 10 This diagram illustrates an example of screen display and internal processing related to the automatic setting of the area of ​​interest in the second embodiment. Figure 10 In the display screen, ultrasonic images 1011 and 1012, showing different display modes before and after the mode change, are shown. Additionally, Figure 10 The diagram shows the internal processing that occurs during mode transitions (automatic setting of the area of ​​interest).

[0121] First, the screen display will be explained. In the second embodiment, the ultrasound diagnostic device 1 changes the screen display from ultrasound image 1011 to ultrasound image 1012 based on a user's operation related to mode change. Here, ultrasound image 1011 corresponds to the current display mode (also referred to as the "first display mode" and the "display mode before change"). Ultrasound image 1012 corresponds to the changed display mode (also referred to as the "second display mode"). Additionally, the ROI 1013 most suitable for the second display mode is also displayed in ultrasound image 1012. Furthermore, during mode change, the screen update of ultrasound image 1011 can be stopped, which is essentially the same as a frozen state.

[0122] Next, the internal processing will be explained. For example, taking advantage of a user's operation related to mode change, the processing circuit 180 acquires ultrasonic image data and information related to the changed display mode via the acquisition function 184. The processing circuit 180 then applies the learned model 1021 to the ultrasonic image data and display mode information via the estimation function 185, and outputs ROI coordinate data corresponding to the changed display mode.

[0123] Figure 11 This is a flowchart illustrating an example of the operation of the processing circuit that performs the automatic setting of the region of interest in the second embodiment. Figure 11 The automatic setting of the focus area shown may begin, for example, when triggered by a user's operation related to mode change. Furthermore, operations related to mode change may include executing a display mode different from the current display mode.

[0124] (Step ST210)

[0125] When the automatic setting of the area of ​​interest begins, the processing circuit 180 executes the acquisition function 184. When the acquisition function 184 is executed, the processing circuit 180 acquires an execution instruction for a second display mode, which is different from the current first display mode, input by the user. Furthermore, in the following description, the first display mode will be designated as mode B, and the second display mode as the blood flow imaging mode.

[0126] (Step ST220)

[0127] After receiving the execution instruction from the user, the processing circuit 180 also acquires the first ultrasonic image data of the first display mode at the time the execution instruction was received. Alternatively, the acquired first ultrasonic image data may also be dynamic image data containing two or more frames.

[0128] (Step ST230)

[0129] After acquiring the first ultrasound image data, the processing circuit 180 executes the estimation function 185. When executing the estimation function 185, the processing circuit 180 estimates the ROI coordinates corresponding to the second display mode by applying a learned model to the first ultrasound image data. Specifically, the processing circuit 180 estimates the position of the object to be examined contained in the first ultrasound image data by applying a learned model associated with the information of the second display mode to the first ultrasound image data, and outputs the coordinates of the region of interest corresponding to the second display mode as the estimation result. In addition, the information of the second display mode is, for example, data in the form of a one-hot vector using "0" and "1" to indicate whether there is an element corresponding to the type of display mode. Furthermore, the learned model can be prepared separately according to the type of display mode, or a single model can be prepared regardless of the type of display mode.

[0130] (Step ST240)

[0131] After estimating the ROI coordinates, the processing circuit 180 displays the ROI in the second ultrasonic image data of the second display mode based on the ROI coordinates through the display control function 187.

[0132] As explained above, the ultrasound diagnostic device of the second embodiment acquires first ultrasound image data of the first mode and information of the second mode, which is different from the first mode. It applies a learned model associated with the information of the second mode to the first ultrasound image data, thereby estimating the position of the object to be examined contained in the first ultrasound image data, outputting the coordinates of the region of interest corresponding to the second mode as the estimation result, and displaying the region of interest in the second ultrasound image data of the second mode based on the coordinates.

[0133] Therefore, the ultrasound diagnostic device of the second embodiment can automatically set the optimal ROI regardless of the type of mode to be changed, so there is no need to manually set the ROI every time the mode is changed, which can reduce the trouble for users.

[0134] (Example of a display screen)

[0135] Figure 12 This is a diagram illustrating the display screen after the automatic setting of the area of ​​interest has been performed according to the first and second embodiments. Figure 12 The display screen 1200 displays an ultrasound image 1210 when the blood flow imaging mode is selected as the second display mode. The ROI 1211 is displayed on the ultrasound image 1210. Furthermore, the display screen 1200 displays the string 1212 "ROI Auto-Setting," which indicates that the ROI is automatically set through the area of ​​interest auto-setting process. Alternatively, the string can be changed on the display screen 1200 to display a marker (e.g., an icon) indicating that ROI auto-setting has been performed. Optionally, the color of the ROI 1211 (i.e., the color of the outline of the area of ​​interest) can be changed from the default color to indicate whether ROI auto-setting has been performed or not. Additionally, if the outline color is changed, the processing circuit 180 can return to the default color after a specified time has elapsed or after a timeout period when the user has manually set the ROI.

[0136] (Other implementation methods)

[0137] In the first and second embodiments, mode transitions are assumed to include, for example, a transition to a different imaging mode (e.g., a transition from mode B to a blood flow imaging mode), but are not limited thereto. Mode transitions in other embodiments may also include, for example, a transition to a mode that accompanies the current display mode (e.g., a measurement mode).

[0138] Figure 13 This diagram is used to illustrate a first example related to the automatic setting of the region of interest in other embodiments. Figure 13The image shows an ultrasonic image 1310 displayed in B-mode, a segmented image 1320, and an ultrasonic image 1330 displayed in strain elastic imaging mode. Figure 13 In the first example, the processing circuit 180 performs image segmentation on the ultrasonic image 1310 and sets the measurement ROI based on the segmentation results. Additionally, the scanning ROI is preset.

[0139] For example, when a breast region is shown in an ultrasound image 1330, the processing circuit 180 performs image segmentation on the ultrasound image 1330 related to the breast region and generates a segmented image 1320. In the segmented image 1320, five regions 1321 to 1325 are distinguished and shown, and are respectively associated with "skin", "fat", "breast", "tumor" and "pectoral muscle".

[0140] After performing image segmentation, the processing circuit 180, based on the segmented image 1320 as the segmentation result, sets two measurement ROIs, such as the FLR (FatLesion Ratio), required to calculate the value of the distortion comparison between fat and lesions. Specifically, the processing circuit 180 automatically sets measurement ROI 1331 related to the region 1324 representing "tumor" and measurement ROI 1332 related to the region 1322 representing "fat" for the ultrasound image 1330.

[0141] Figure 14 This is a second example used to illustrate the automatic setting of the region of interest process in other embodiments. Figure 14 Ultrasonic image 1410, segmented image 1420, and ultrasonic image 1430 displayed in SWE mode are shown. Figure 14 In the second example, the processing circuit 180 performs image segmentation on the ultrasonic image 1410 and sets the scanning ROI and measurement ROI based on the segmentation results. Alternatively, the scanning ROI can be preset.

[0142] For example, if the ultrasound image 1410 contains a tumor, the processing circuit 180 performs image segmentation on the ultrasound image 1410 to generate a segmented image 1420. In the segmented image 1420, multiple regions, including the region 1421 representing a "tumor," are distinguished and shown.

[0143] After performing image segmentation, the processing circuit 180 automatically sets the scan ROI 1432 in the SWE and the measurement ROI 1431 for measuring, for example, elasticity, based on the segmented image 1420 as the segmentation result. The scan ROI 1432 can be preset by the user or automatically set by the methods of the first and second embodiments.

[0144] Figure 15 This is a diagram used to illustrate a third example related to the automatic setting of the region of interest in other embodiments. Figure 15 The image shows an ultrasound image 1510 displayed in B mode, a segmented image 1520, and an ultrasound image 1530 displayed in low-flow-rate blood flow imaging mode. Figure 15 In the third example, the processing circuit 180 performs image segmentation on the ultrasonic image 1510 and sets the scanning ROI and the measurement ROI based on the segmentation results.

[0145] For example, if the ultrasonic image 1510 includes a measurement target area, the processing circuit 180 performs image segmentation on the ultrasonic image 1510 to generate a segmented image 1520. In the segmented image 1520, multiple regions, including the region 1521 representing the "measurement target area", are shown separately.

[0146] After performing image segmentation, the processing circuit 180 automatically sets the scanning ROI 1532 in the low-flow-rate blood flow imaging mode and the measurement ROI 1531, for example, for calculating the vascular index of the measurement target area, based on the segmented image 1520 as the segmentation result. Furthermore, the scanning ROI 1532 can be preset by the user or automatically set using the methods of the first and second embodiments.

[0147] In the embodiments described above, the Region of Interest (ROI) is automatically set through an automatic ROI setting process, but this is not limited to this. For example, the ultrasound diagnostic device 1 can also automatically change parameters (e.g., image quality parameters) related to the changed mode based on the set ROI's position and size via the system control function 188 (setting unit). Image quality parameters include, for example, the ultrasonic beam's transmit and receive frequencies, focus position, gain, and depth. Furthermore, the ultrasound diagnostic device 1 can also set whether to automatically change image quality parameters while automatically setting the ROI.

[0148] (Third implementation method)

[0149] In the above embodiments, a structure was described in which the region of interest is automatically set and displayed in an ultrasound image where no region of interest is displayed, for example, based on a user's operation related to mode change. On the other hand, in the third embodiment, a structure was described in which the region of interest is reset and displayed in an ultrasound image where a region of interest is displayed, for example, according to predetermined conditions. Furthermore, the process of resetting the region of interest will be referred to below as the region of interest reset process.

[0150] As a necessity for resetting the area of ​​interest, an example can be given of eliminating the undesirable situation where only the shift in the area of ​​interest caused by changes in the imaging cross-section is addressed. Changes in the imaging cross-section can be caused by changes in the ultrasound probe or by changes in the organism itself. Changes in the imaging cross-section caused by the ultrasound probe occur, for example, due to a shift in the position where the ultrasound probe contacts the body, or a change in the position where the ultrasound probe contacts the body. Changes in the imaging cross-section caused by the organism itself occur, for example, due to movement of the area of ​​interest (e.g., an organ) due to respiration or pulsation. When the imaging cross-section changes, a discrepancy occurs between the area of ​​interest within the ultrasound image (e.g., the area where blood flow is to be displayed) and the area of ​​interest set in the ultrasound image (e.g., the area where blood flow is displayed). Therefore, to address the shift in the area of ​​interest caused by the discrepancy between the area of ​​interest within the ultrasound image and the area of ​​interest, it is necessary to reset the area of ​​interest.

[0151] Figure 16 This is a block diagram illustrating a structural example of the ultrasonic diagnostic apparatus according to the third embodiment. Figure 16 The ultrasonic diagnostic device 1A has a device body 100A and an ultrasonic probe 101. The device body 100A is connected to an input device 102 and an output device 103. In addition, the device body 100A is connected to an external device 104 via a network NW.

[0152] The main body 100A is a device that generates an ultrasonic image based on the reflected wave signal received by the ultrasonic probe 101. The main body 100A includes an ultrasonic transmitting circuit 110, an ultrasonic receiving circuit 120, an internal storage circuit 130, an image memory 140, an input interface 150, an output interface 160, a communication interface 170, and a processing circuit 180A.

[0153] The processing circuit 180A is, for example, a processor that functions as the central processing unit of the ultrasound diagnostic device 1A. The processing circuit 180A executes a program stored in the internal storage circuit 130 to perform functions corresponding to that program. The processing circuit 180A, for example, includes a B-mode processing function 181, a Doppler processing function 182, an image generation function 183, an acquisition function 184 (acquisition unit), an estimation function 185 (estimation unit), a calculation function 186 (calculation unit), a display control function 187 (display control unit), a system control function 188, and a reset function 1600 (reset unit).

[0154] The reset function 1600 resets the previously set area of ​​interest (ROI) based on specified conditions. These specified conditions include, for example, conditions regarding whether to recalculate the ROI coordinates (recalculation conditions), conditions regarding whether to reset the recalculated ROI coordinates (reset conditions), conditions regarding whether to calculate the correlation value related to the camera cross-section offset (correlation value calculation conditions), and conditions regarding whether to reset the ROI coordinates based on the calculated correlation value. Additionally, the specified conditions also include cases where the user inputs an instruction to reset the ROI.

[0155] Specifically, for example, the processing circuit 180A determines whether to recalculate the ROI coordinates based on recalculation conditions by resetting function 1600. The recalculation conditions are, for example, the frame interval for calculating the ROI coordinates. Therefore, by setting the frame interval to any number greater than 1, the processing circuit 180A can be configured to recalculate the ROI coordinates per frame or per multiple frames.

[0156] Additionally, for example, the processing circuit 180A determines whether to display a new ROI based on reset conditions using the reset function 1600. The reset conditions are, for example, a threshold related to the consistency between the current ROI coordinate region and the recalculated ROI coordinate region. For example, if the consistency is 100%, it means there is no deviation between the ROI coordinates before and after recalculation. Conversely, for example, the greater the decrease in consistency from 100%, the greater the deviation between the ROI coordinates before and after recalculation. The threshold is set arbitrarily based on the tolerance for deviation. Therefore, the processing circuit 180A can set itself to display a new ROI when the consistency is below the threshold.

[0157] Additionally, for example, the processing circuit 180A determines whether to calculate a correlation value based on correlation value calculation conditions by resetting function 1600. The correlation value is a value relating to the correlation between two ultrasound images (e.g., B-mode images) between two different frames. The calculation of the correlation value can also be performed, for example, within a defined area of ​​the ultrasound image (e.g., the entire image or a region of interest). The correlation value calculation conditions are, for example, the frame interval for calculating the correlation value. Therefore, by setting the frame interval to any number greater than 1, the processing circuit 180A can be configured to calculate the correlation value per frame or per multiple frames.

[0158] Additionally, for example, the processing circuit 180A recalculates the ROI coordinates by comparing the correlation value with a threshold and determines whether to display the new ROI. An arbitrary value is set as the threshold based on the degree of correlation. Therefore, the processing circuit 180A can be configured to recalculate the ROI coordinates and display the new ROI when the correlation value is below the threshold.

[0159] The following describes two specific examples of the region of interest (ROI) resetting process. The first example involves recalculating the ROI coordinates at specified frame intervals, and then, based on the recalculated ROI coordinates, (1) always displaying the structure of the new ROI, or (2) displaying the structure of the new ROI if the conditions for resetting the ROI are met. The second example involves recalculating the ROI coordinates if the conditions for resetting the ROI are met, and then displaying the structure of the new ROI based on the recalculated ROI coordinates.

[0160] (First specific example)

[0161] Figure 17 This is a flowchart illustrating a first specific example of the operation of the processing circuit that performs the region of interest resetting process in the third embodiment. Figure 17 The shown focus area resetting process, for example, in Figure 3 The flowchart begins after the ST160 process.

[0162] (Step ST310)

[0163] When the region of interest (ROI) resetting process begins, processing circuit 180A executes resetting function 1600. When executing resetting function 1600, processing circuit 180A determines whether the recalculation conditions are met. Specifically, processing circuit 180A determines whether the frame interval between the frame that previously calculated the ROI coordinates and the current frame is an arbitrary number. If the frame interval is an arbitrary number, processing circuit 180A determines that the recalculation conditions are met and proceeds to step ST320. If the frame interval is not an arbitrary number, i.e., the frame interval is less than an arbitrary number, processing circuit 180A determines that the recalculation conditions are not met and repeats step ST310 until the frame interval becomes an arbitrary number.

[0164] (Step ST320)

[0165] After determining that the recalculation conditions are met, the processing circuit 180A recalculates the ROI coordinates. Specifically, as described in the first embodiment, the processing circuit 180A estimates the position of the object under inspection based on the B-mode image and recalculates the ROI coordinates based on the estimation result. Alternatively, as described in the second embodiment, the processing circuit 180A directly estimates (recalculates) the ROI coordinates based on the B-mode image.

[0166] (Step ST330)

[0167] After recalculating the ROI coordinates, the processing circuit 180A determines whether the reset conditions are met through the reset function 1600. Specifically, the processing circuit 180A calculates the consistency between the current ROI coordinate region and the recalculated ROI coordinate region, and determines whether the calculated consistency is less than a threshold. If the consistency is less than the threshold, the processing circuit 180A determines that the reset conditions are met, and the process proceeds to step ST340. If the consistency is not less than the threshold, the processing circuit 180A determines that the reset conditions are not met, and the process returns to step ST310.

[0168] (Step ST340)

[0169] After determining that the reset conditions are met, the processing circuit 180A displays the new ROI in the ultrasonic image data based on the recalculated ROI coordinates through the display control function 187.

[0170] Furthermore, the reset conditions in step ST330 are not limited to a comparison of consistency related to the region of the ROI coordinates. For example, the reset conditions could be a comparison of consistency and a threshold related to the region of the location of the object under inspection contained in the estimation result, or a comparison of correlation values ​​and a threshold related to the B-mode image data.

[0171] (Second specific example)

[0172] Figure 18 This is a flowchart illustrating a second specific example of the operation of the processing circuit that performs the region of interest resetting process in the third embodiment. Figure 18 The shown focus area resetting process, for example, in Figure 3 The flowchart begins after the ST160 process.

[0173] (Step ST410)

[0174] When the region of interest reset process begins, the processing circuit 180A executes the reset function 1600. When executing the reset function 1600, the processing circuit 180A determines whether the correlation value calculation conditions are met. Specifically, the processing circuit 180A determines whether the frame interval between the reference frame and the current frame is an arbitrary number. If the frame interval is an arbitrary number, the processing circuit 180A determines that the correlation value calculation conditions are met, and the process proceeds to step ST420. If the frame interval is not an arbitrary number, i.e., the frame interval is less than an arbitrary number, the processing circuit 180A determines that the correlation value calculation conditions are not met, and the process in step ST410 is repeated until the frame interval becomes an arbitrary number.

[0175] (Step ST420)

[0176] After determining that the correlation value calculation conditions are met, the processing circuit 180A calculates the correlation value between a specified region of a reference ultrasonic image and a specified region of the current ultrasonic image. The reference ultrasonic image is, for example, an ultrasonic image of a frame where the ROI has been newly set or reset. Alternatively, the reference ultrasonic image can also be a frame preceding a specified frame of the current ultrasonic image.

[0177] (Step ST430)

[0178] After calculating the correlation value, the processing circuit 180A determines whether the correlation value is less than a threshold. If the correlation value is determined to be less than the threshold, the process proceeds to step ST440. If the correlation value is determined to be greater than the threshold, the process returns to step ST410.

[0179] (Step ST440)

[0180] After determining that the correlation value is less than the threshold, the processing circuit 180A recalculates the ROI coordinates. Regarding the recalculation, ... Figure 17 The steps are the same as for ST320.

[0181] (Step ST450)

[0182] After the ROI coordinates are recalculated, the processing circuit 180A displays the new ROI in the ultrasonic image data based on the recalculated ROI coordinates through the display control function 187.

[0183] As explained above, the ultrasound diagnostic apparatus of the third embodiment can reset the area of ​​interest according to the prescribed conditions, so that the area of ​​interest can be displayed appropriately even when the imaging cross-section changes.

[0184] According to at least one of the embodiments described above, the optimal ROI can be automatically set regardless of the type of transformation mode.

[0185] Several embodiments have been described, but these embodiments are given by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other ways, and various omissions, substitutions, modifications, and combinations of embodiments are possible without departing from the spirit of the invention. These embodiments or variations thereof are included within the scope or spirit of the invention, and are also included within the scope of the invention as described in the claims and its equivalents.

Claims

1. An ultrasonic diagnostic device, comprising: The acquisition unit acquires the first ultrasonic image data of the first mode; The estimation unit, based on the execution instruction of a second mode different from the first mode received during the display of the first ultrasonic image data, applies the first ultrasonic image data displayed at the moment the execution instruction of the second mode is received to the learned model to estimate the position of the object to be inspected. The calculation unit calculates the coordinates of the region of interest corresponding to the second pattern based on the position of the object under inspection estimated by the estimation unit and the information representing the type of the second pattern; as well as The display control unit displays the region of interest in the second ultrasound image data of the second mode based on the coordinates. The computing unit changes at least one of the size and shape of the region of interest based on information indicating the type of the second mode.

2. The ultrasonic diagnostic device according to claim 1, The estimation result of the position of the object under inspection, as determined by the estimation unit, includes more than one detection unit, which includes the object under inspection. The calculation unit determines one or more detection areas based on the one or more detection units, and calculates the coordinates based on the most reliable detection area among the one or more detection areas.

3. The ultrasonic diagnostic device according to claim 2, In the case where multiple detection areas have been identified, The calculation unit calculates the sum of the likelihoods of the detection units contained in each of the more than one detection areas based on the likelihood of the detection units when the position of the object to be inspected is estimated, and determines the detection area with the highest sum of likelihoods among the more than one detection areas as the detection area.

4. The ultrasonic diagnostic device according to claim 2, In the case where multiple detection areas have been identified, The calculation unit determines the detection region containing the highest likelihood of the detection unit among the more than one detection regions as the detection region based on the likelihood of the detection unit when estimating the position of the object under inspection.

5. The ultrasonic diagnostic device according to claim 2, In the case where multiple detection areas have been identified, The calculation unit determines the detection region with the highest number of repetitions of detection units among the one or more detection regions as the detection region.

6. The ultrasonic diagnostic apparatus according to any one of claims 2 to 5, A detection area consists of one or more detection units.

7. The ultrasonic diagnostic device according to claim 6, When a detection area is composed of the plurality of detection units The calculation unit calculates the coordinates based on a rectangle inscribed in the outer periphery of the plurality of detection units.

8. The ultrasonic diagnostic device according to claim 7, The calculation unit calculates the coordinates based on the center and the long side of the rectangle.

9. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, It also includes a reset unit that resets the area of ​​interest according to specified conditions.

10. The ultrasonic diagnostic device according to claim 9, The computing unit calculates the coordinates of a new region of interest in a frame that is later than the frame in which the coordinates of the region of interest were calculated. If the consistency between the coordinates of the region of the region of interest and the coordinates of the new region of interest is less than a threshold, the resetting unit resets the new region of interest. The display control unit displays the new area of ​​interest in the second ultrasonic image data.

11. The ultrasonic diagnostic device according to claim 9, The calculation unit calculates the correlation value between a specified region of the reference ultrasonic image data and a specified region of the current ultrasonic image data. If the relevant value is less than the threshold, the reset unit determines to reset a new area of ​​interest. The computing unit calculates the coordinates of the new region of interest based on the current ultrasound image data. The display control unit displays the new area of ​​interest in the second ultrasonic image data.

12. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, The computing unit calculates the coordinates based on the user's operations related to mode transitions.

13. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, The acquisition unit acquires the first ultrasonic image data by taking advantage of the user's operation related to mode change.

14. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, The estimation unit estimates the location of the object being inspected based on the user's actions related to mode transitions.

15. The ultrasound diagnostic apparatus according to any one of claims 1 to 5, The display control unit changes the color of the outer frame of the area of ​​interest based on the estimation result of the position of the object under inspection estimated by the estimation unit.

16. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, The display control unit displays at least one of a string and a mark on the display screen of the second mode based on the estimation result of the position of the object under inspection estimated by the estimation unit.

17. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, The second mode is either blood flow imaging mode or elastography mode.

18. The ultrasonic diagnostic apparatus according to claim 17, The second mode is a measurement mode that accompanies either blood flow imaging mode or elastography mode. The area of ​​interest refers to the measurement area.

19. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, It also includes a setting unit that changes parameters related to the second mode based on the location of the area of ​​interest.

20. The ultrasonic diagnostic apparatus according to claim 19, The setting unit changes any one of the following parameters: the transmit / receive frequency, the focus position, the gain, and the depth of the ultrasonic beam.

21. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5, The learned model is a deep neural network.

Images