Ultrasound diagnostic device, image processing device, and program

Abstract

To execute processing which uses both amplitude information and phase information after processing of depriving or altering the phase information.SOLUTION: An ultrasonic diagnostic apparatus according to embodiment comprises a first processing unit, a reconstitution unit, and a second processing unit. The first processing unit receives an input of first ultrasonic data and outputs second ultrasonic data. The reconstitution unit reconstitutes third ultrasonic data based on the amplitude information of the second ultrasonic data and the phase information of the first ultrasonic data. The second processing unit executes processing which uses the amplitude information and the phase information of the third ultrasonic data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The embodiments disclosed in the present specification and drawings relate to an ultrasound diagnostic apparatus, an image processing apparatus, and a program. [Background technology]

[0002] Conventionally, in ultrasound diagnostic devices, techniques are known that use amplitude information and phase information contained in ultrasound data obtained from received reflected waves to perform various processes such as noise reduction processing and blood flow detection processing.

[0003] However, since such processing that uses both amplitude information and phase information cannot be performed after processing that causes the phase information of the reflected wave to be lost or altered, it can be difficult to efficiently combine and perform multiple processes. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2020-114294 [Patent Document 2] Japanese Patent Publication No. 2020-114295 Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to enable processing that uses both amplitude information and phase information after processing that loses or alters phase information. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems. [Means for solving the problem]

[0006] An ultrasound diagnostic apparatus according to an embodiment includes a first processing unit, a reconstruction unit, and a second processing unit. The first processing unit receives input of first ultrasound data having amplitude information and phase information, and outputs second ultrasound data having amplitude information but not phase information. The reconstruction unit reconstructs third ultrasound data based on the amplitude information of the second ultrasound data and the phase information of the first ultrasound data. The second processing unit performs processing using the amplitude information and phase information of the third ultrasound data including both the amplitude information and the phase information. The first ultrasound data is complex signal data for a plurality of frames, and the first processing unit generates second ultrasound data by compounding the complex signal data for a plurality of frames. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing an example of an ultrasonic diagnostic apparatus according to the first embodiment. [Figure 2] FIG. 2 is a diagram showing an example of the relationship between functions related to generation of compounded IQ data according to the first embodiment. [Figure 3] FIG. 3 is a diagram showing an example of the flow of the compounded IQ data generation process according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of noise reduction processing using a trained model according to the first embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a method for generating a trained model according to the first embodiment. [Figure 6] FIG. 6 is a block diagram showing an example of an ultrasonic diagnostic apparatus according to the second embodiment. [Figure 7] FIG. 7 is a diagram showing an example of the relationship between functions related to generation of phase-reconstructed IQ data according to the second embodiment. [Figure 8] FIG. 8 is a diagram showing an example of the flow of a process for generating phase-restored IQ data according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of an ultrasound diagnostic apparatus, an image processing apparatus, and a program will be described in detail with reference to the drawings.

[0009] (First embodiment) Fig. 1 is a block diagram showing an example of an ultrasonic diagnostic apparatus 1 according to the first embodiment. As shown in Fig. 1, the ultrasonic diagnostic apparatus 1 includes an apparatus main body 100, an ultrasonic probe 21, an input device 22, and a display 23. The apparatus main body 100 is also connected to an external device 30 via a network NW.

[0010] The ultrasonic probe 21 has a plurality of elements such as piezoelectric vibrators. These elements generate ultrasonic waves based on a drive signal supplied from an ultrasonic transmission circuit 101 of the device main body 100. The ultrasonic probe 21 also receives reflected waves from the subject P and converts them into electrical signals. The ultrasonic probe 21 also has, for example, a matching layer provided on the piezoelectric vibrator and a backing material that prevents ultrasonic waves from propagating backward from the piezoelectric vibrator. The ultrasonic probe 21 is detachably connected to the device main body 100.

[0011] When ultrasonic waves are transmitted from the ultrasonic probe 21 to the subject P, the transmitted ultrasonic waves are reflected successively by discontinuous surfaces of acoustic impedance in the tissues of the subject P and are received as reflected wave signals by multiple elements of the ultrasonic probe 21. The amplitude of the received reflected wave signals depends on the difference in acoustic impedance at the discontinuous surfaces where the ultrasonic waves are reflected. When the transmitted ultrasonic pulses are reflected by the surface of a moving blood flow, heart wall, or the like, the reflected wave signals undergo a frequency shift due to the Doppler effect, depending on the velocity component of the moving object in the direction of ultrasonic transmission. The ultrasonic probe 21 then outputs the reflected wave signals to the ultrasonic receiving circuit 102 of the device main body 100.

[0012] In this embodiment, the ultrasonic probe 21 is a one-dimensional array probe in which a plurality of ultrasonic transducers are arranged in a predetermined direction. However, without being limited to this example, the ultrasonic probe 21 may be a two-dimensional array probe (a probe in which a plurality of ultrasonic transducers are arranged in a two-dimensional matrix) or a mechanical 4D probe (a probe that can perform ultrasonic scanning by mechanically moving an array of ultrasonic transducers in a direction perpendicular to the arrangement direction) that can acquire volume data.

[0013] The input device 22 is realized by input means such as a mouse, keyboard, button, panel switch, touch command screen, foot switch, trackball, joystick, etc. The input device 22 receives various setting requests from the operator of the ultrasound diagnostic apparatus 1 and transfers the received various setting requests to the apparatus main body 100.

[0014] The display 23 displays, for example, a GUI (Graphical User Interface) that allows the operator of the ultrasound diagnostic apparatus 1 to input various setting requests using the input device 22, and displays ultrasound images and the like that are shown based on ultrasound image data generated in the apparatus main body 100. The display 23 is realized by a liquid crystal monitor, an OLED (Organic Light Emitting Diode) monitor, or the like.

[0015] The device main body 100 generates ultrasound image data based on the reflected wave signals received by the ultrasound probe 21. The device main body 100 can generate two-dimensional ultrasound image data based on the reflected wave data corresponding to a two-dimensional region of the subject P received by the ultrasound probe 21. The device main body 100 can also generate three-dimensional ultrasound image data based on the reflected wave data corresponding to a three-dimensional region of the subject P received by the ultrasound probe 21.

[0016] As shown in FIG. 1, the device main body 100 includes an ultrasonic transmission circuit 101, an ultrasonic reception circuit 102, a buffer memory 103, a RAW data memory 104, a storage circuit 105, an image memory 106, a communication interface 107, a processing circuit 108, an input interface 130, and an output interface 140.

[0017] The ultrasonic transmission circuit 101, under the control of the processing circuit 108, causes the ultrasonic probe 21 to transmit ultrasonic waves. The ultrasonic transmission circuit 101 includes, for example, a trigger generation circuit, a delay circuit, and a pulser circuit, which are not shown. The trigger generation circuit repeatedly generates trigger pulses for forming transmitted ultrasonic waves at a predetermined rate frequency fr Hz (period: 1 / fr seconds). In addition, the delay circuit provides each trigger pulse with a delay time required to focus the ultrasonic waves into a beam for each channel and determine the transmission directivity. The pulser circuit applies a drive pulse to the ultrasonic probe 21 at a timing based on this trigger pulse.

[0018] The ultrasonic receiving circuit 102 generates reflected wave data based on the reflected wave signal received by the ultrasonic probe 21. The reflected wave data is an example of first ultrasonic data in this embodiment. The ultrasonic receiving circuit 102 then stores the generated reflected wave data in the buffer memory 103.

[0019] More specifically, the reflected waves of the ultrasonic waves transmitted by the ultrasonic probe 21 reach a piezoelectric vibrator inside the ultrasonic probe 21, and are then converted from mechanical vibrations into electrical signals (reflected wave signals) in the piezoelectric vibrator and input to the ultrasonic receiving circuit 102. The ultrasonic receiving circuit 102 has, for example, a preamplifier, an A / D (Analog to Digital) converter, a quadrature detection circuit, etc., and performs various processes on the reflected wave signals received by the ultrasonic probe 21 to generate reflected wave data.

[0020] The preamplifier amplifies the reflected wave signal for each channel and performs gain adjustment (gain correction). The A / D converter converts the gain-corrected reflected wave signal into a digital signal by A / D converting it. The quadrature detection circuit converts the A / D converted reflected wave signal into an in-phase signal (I signal, I: In-phase) and a quadrature signal (Q signal, Q: Quadrature-phase) in the baseband.

[0021] The quadrature detection circuit then stores the I signal and Q signal as reflected wave data in buffer memory 103. Hereinafter, the I signal and Q signal will be collectively referred to as IQ signal. Furthermore, since the IQ signal is A / D converted digital data, it will also be referred to as IQ data. The IQ data is complex signal data that has amplitude information and phase information.

[0022] The ultrasonic receiving circuit 102 generates two-dimensional reflected wave data from two-dimensional reflected wave signals received by the ultrasonic probe 21. The ultrasonic receiving circuit 102 may also generate three-dimensional reflected wave data from three-dimensional reflected wave signals received by the ultrasonic probe 21.

[0023] The buffer memory 103 at least temporarily stores the reflected wave data (IQ data) generated by the ultrasonic receiving circuit 102. For example, the buffer memory 103 stores several frames of reflected wave data or several volumes of reflected wave data. For example, the buffer memory 103 stores a predetermined number of frames of reflected wave data under the control of the ultrasonic receiving circuit 102. When a new frame of reflected wave data is generated by the ultrasonic receiving circuit 102 while the predetermined number of frames of reflected wave data are stored, the buffer memory 103, under the control of the ultrasonic receiving circuit 102, discards the oldest generated frame of reflected wave data and stores the newly generated frame of reflected wave data. For example, the buffer memory 103 is realized by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory. Note that one frame of reflected wave data generated by the ultrasonic receiving circuit 102 is one collected frame of reflected wave data. The buffer memory 103 is an example of a storage unit in this embodiment. Note that the buffer memory 103 may also be referred to as a temporary storage unit.

[0024] The RAW data memory 104 stores various data such as B-mode data and Doppler data generated by the processing circuitry 108 described below. The RAW data memory 104 is realized by a semiconductor memory element such as a RAM or a flash memory, a hard disk, an optical disk, or the like.

[0025] The storage circuitry 105 is realized by, for example, a magnetic or optical storage medium, a semiconductor memory element such as a flash memory, a hard disk, an optical disk, or other processor-readable storage medium. The storage circuitry 105 stores programs and various data for implementing ultrasonic transmission and reception. The programs and various data may be stored in the storage circuitry 105 in advance. Alternatively, the programs and various data may be stored in a non-transitory storage medium and distributed, and then read from the non-transitory storage medium and installed in the storage circuitry 105. The storage circuitry 105 may be an example of a storage unit in this embodiment.

[0026] The image memory 106 stores various types of image data generated by the processing circuit 108. For example, the image memory 106 is realized by a semiconductor memory element such as RAM or flash memory, a hard disk, an optical disk, or the like. Note that the RAW data memory 104 and the image memory 106 may be integrated into one memory.

[0027] The communication interface 107 is connected to the external device 30 via, for example, a network NW, and performs data communication with the external device 30.

[0028] The external device 30 is, for example, a workstation that performs post-processing of various data generated by the ultrasound diagnostic apparatus 1 and processing such as displaying ultrasound image data. The external device 30 includes, for example, a processing circuit such as a processor, a storage device, and a display. The external device 30 may also be a tablet terminal or the like.

[0029] The input interface 130 accepts various instructions from an operator via the input device 22. The input interface 130 is connected to the processing circuitry 108 via, for example, a bus, converts the operation instructions input by the operator into electrical signals, and outputs the electrical signals to the processing circuitry 108. Note that the input interface 130 is not limited to being connected to physical operation components such as a mouse and keyboard. For example, an example of an input interface also includes a circuit that receives electrical signals corresponding to operation instructions input from an external input device provided separately from the ultrasound diagnostic apparatus 1 and outputs the electrical signals to the processing circuitry 108.

[0030] The output interface 140 outputs, for example, an electrical signal from the processing circuit 108 to the outside. The output interface 140 is connected to the processing circuit 108 via, for example, a bus, and outputs the electrical signal from the processing circuit 108 to the display 23.

[0031] The processing circuitry 108 is a processor that reads out and executes programs from the storage circuitry 105 to realize functions corresponding to the programs. The processing circuitry 108 of this embodiment includes a division function 110, a compound function 111, a reconstruction function 112, a noise reduction function 113, a B-mode processing function 114, a Doppler processing function 115, an image generation function 116, a display control function 117, and a system control function 118.

[0032] The division function 110 is an example of a division unit. The compound function 111 is an example of a first processing unit and a compound processing unit. The reconstruction function 112 is an example of a reconstruction unit. The noise reduction function 113 is an example of a second processing unit and a noise reduction unit. The B-mode processing function 114 is an example of a B-mode processing unit. The Doppler processing function 115 is an example of a Doppler processing unit. The image generation function 116 is an example of an image generation unit. The display control function 117 is an example of a display control unit. The system control function 118 is an example of a system control unit.

[0033] Here, for example, each processing function of the processing circuitry 108, namely, a segmentation function 110, a compound function 111, a reconstruction function 112, a noise reduction function 113, a B-mode processing function 114, a Doppler processing function 115, an image generation function 116, a display control function 117, and a system control function 118, is stored in the storage circuitry 105 in the form of a computer-executable program. For example, the processing circuitry 108 realizes the function corresponding to each program by reading and executing the program from the storage circuitry 105. In other words, the processing circuitry 108 in a state where each program has been read out has each function shown in the processing circuitry 108 of FIG. 1. 1 has been described as realizing the processing functions performed by the division function 110, compound function 111, reconstruction function 112, noise reduction function 113, B-mode processing function 114, Doppler processing function 115, image generation function 116, display control function 117, and system control function 118 by a single processor, but it is also possible to combine multiple independent processors to configure the processing circuitry 108 and have each processor execute a program to realize the function. Also, while it is described in FIG. 1 as a single storage circuitry 105 storing programs corresponding to each processing function, it is also possible to configure multiple storage circuits to be distributed and have the processing circuitry 108 read out corresponding programs from individual storage circuits.

[0034] In the above description, an example has been described in which a "processor" reads and executes a program corresponding to each function from a storage circuit. However, the embodiment is not limited to this. The term "processor" refers to a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application-specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). If the processor is a CPU, for example, the processor realizes the function by reading and executing a program stored in the storage circuit 105. On the other hand, if the processor is an ASIC, instead of storing the program in the storage circuit 105, the function is directly incorporated as a logic circuit within the processor circuit. Note that each processor in the present embodiment is not limited to being configured as a single circuit per processor, and may be configured as a single processor by combining multiple independent circuits to realize its function. Furthermore, the functions of the multiple components in FIG. 1 may be realized by integrating them into a single processor.

[0035] FIG. 2 is a diagram showing an example of the relationship between the functional units involved in generating compounded IQ data according to the first embodiment.

[0036] The dividing function 110 divides phase data having phase information from the IQ data stored in the buffer memory 103. More specifically, as shown in Fig. 2, when the dividing function 110 receives input of IQ data having amplitude information and phase information, it outputs phase data having phase information and IQ data having amplitude information and phase information.

[0037] The compound function 111 receives input IQ data and outputs compounded envelope data. More specifically, the compound function 111 generates envelope data from multiple frames of IQ data and compounds the envelope data to generate compounded envelope data. In this embodiment, for ease of explanation, the data before compounding is referred to as "envelope data" and the data after compounding is referred to as "compounded envelope data." Note that data before and after compounding may be collectively referred to simply as envelope data. The envelope data and compounded envelope data have amplitude information but not phase information. The compounded envelope data is an example of second ultrasound data in this embodiment.

[0038] The reconstruction function 112 reconstructs compounded IQ data having amplitude information and phase information based on the amplitude information of the compounded envelope data and the phase information of the IQ data. In this embodiment, since the phase information of the IQ data is included in the phase data divided by the division function 110, the reconstruction function 112 reconstructs the compounded IQ data using the amplitude information of the compounded envelope data and the phase information of the phase data.

[0039] Like IQ data, the compounded IQ data has a data structure including both amplitude information and phase information. Generally, when compounding is performed on IQ data, the phase information is lost. In contrast, in the compounded IQ data of this embodiment, the phase information is added by the reconstruction function 112, so that the phase information is maintained even though compounding is performed. The compounded IQ data is an example of third ultrasound data in this embodiment.

[0040] The noise reduction function 113 generates noise-reduced IQ data having a higher signal-to-noise (SN) ratio than the compounded IQ data based on the amplitude information and phase information of the compounded IQ data.

[0041] The noise-reduced IQ data is an example of fourth ultrasound data in this embodiment. The noise reduction process performed by the noise reduction function 113 is an example of a process that uses amplitude information and phase information of the compounded IQ data in this embodiment.

[0042] The amplitude information of the compounded IQ data is derived from the compounded envelope data, and the phase information of the compounded IQ data is derived from the phase information of the IQ data stored in the buffer memory 103. In other words, by using the compounded IQ data, the noise reduction function 113 can perform noise reduction processing using the amplitude information of the compounded envelope data and the phase information derived from the IQ data before the phase information was damaged by the compounding processing.

[0043] Next, the flow of processing executed by the division function 110, the compound function 111, and the reconstruction function 112 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the flow of processing for generating compounded IQ data 53 according to the first embodiment. In Fig. 3, the processing by the division function 110, the compound function 111, and the reconstruction function 112 is illustrated by being surrounded by dashed lines.

[0044] The IQ data 51a and 51b shown in Fig. 3 are each IQ data for one frame. Hereinafter, when there is no need to distinguish between the IQ data 51a and 51b, they will simply be referred to as IQ data 51. Also, although Fig. 3 shows that two frames of IQ data 51a and 51b are to be processed, three or more frames of IQ data 51a and 51b may also be to be processed.

[0045] The division function 110 generates added IQ data 510 by adding IQ data 51a and 51b for multiple frames as shown in equation (1) (S1). The IQ data 51a and 51b and the added IQ data 510 are complex signal data having a real part and an imaginary part.

[0046]

number

[0047] In equation (1), "IQ0" indicates the IQ data 51a, and "IQ1" indicates the IQ data 51b.

[0048] Then, the division function 110 extracts the argument of the complex number ∠IQ as phase information from the added IQ data 510 (S2). The division function 110 outputs phase data 511 including the extracted phase information.

[0049] Furthermore, the compound function 111 extracts absolute values ​​of the IQ data 51a and 51b for multiple frames as shown in equation (2) to generate envelope data corresponding to the IQ data 51a and 51b (S3), and performs averaging of the extracted absolute values ​​(S4) to generate one compounded envelope data 52. The absolute value of the IQ data 51 is an example of amplitude information.

[0050]

number

[0051] 3, the compounding targets are two frames of IQ data 51a and 51b, so in equation (2), the sum of the absolute value of IQ data 51a and the absolute value of IQ data 51b is divided by 2. The division factor varies depending on the number of frames to be compounded.

[0052] The reconstruction function 112 reconstructs the compounded IQ data 53 from the compounded envelope data 52 generated by the compound function 111 and the phase data 511 generated by the division function 110 by the calculation shown in equation (3) (S5).

[0053]

number

[0054] ∠IQ and ∠IQ in equation (3) are the arguments of the complex numbers extracted from the summed IQ data 510 by the division function 110.

[0055] The compounded IQ data 53 is then used for noise reduction processing by the noise reduction function 113 (S6).

[0056] Next, the noise reduction function 113 will be described in detail with reference to Fig. 4. Fig. 4 is a diagram showing an example of noise reduction processing by the trained model 90 according to the first embodiment. As shown in Fig. 4, when compounded IQ data 53 is input, the trained model 90 outputs noise-reduced IQ data 54. The noise reduction function 113 obtains the noise-reduced IQ data 54 by inputting the compounded IQ data 53 to the trained model 90.

[0057] The trained model 90 is a trained model that has been trained by associating a plurality of input ultrasound data with a plurality of teacher ultrasound data. The teacher ultrasound data is data in which the noise components of the input ultrasound data have been reduced. The input ultrasound data and the teacher ultrasound data corresponding to the input ultrasound data constitute one set of training data.

[0058] The trained model 90 is a trained model generated by, for example, deep learning such as a neural network or other machine learning. Deep learning techniques that can be applied include, but are not limited to, a deep convolutional neural network (DCNN), a convolutional neural network (CNN), and a recurrent neural network (RNN). The trained model 90 is configured, for example, by a neural network and trained parameter data.

[0059] The trained model 90 is assumed to be stored in, for example, the memory circuitry 105. The noise reduction function 113 reads out the trained model 90 from the memory circuitry 105 and inputs the compounded IQ data 53. Alternatively, the trained model 90 may be incorporated into the noise reduction function 113.

[0060] FIG. 5 is a diagram showing an example of a method for generating a trained model 90 according to the first embodiment. The trained model 90 is generated by, for example, a learning device 60. The learning device 60 includes a machine learning model such as DCNN. The learning device 60 generates the trained model 90 by performing learning (supervised learning) based on input IQ data 61 and teacher IQ data 62 relating to an ultrasound examination of the same position on a subject. The teacher IQ data 62 is data in which noise from the input IQ data 61 has been reduced. Although FIG. 5 illustrates one set of input IQ data 61 and teacher IQ data 62, the learning device 60 is assumed to train using multiple sets of input IQ data 61 and teacher IQ data 62. The input IQ data 61 is an example of input ultrasound data. The teacher IQ data 62 is an example of teacher ultrasound data.

[0061] The ultrasound diagnostic device 1 may have a learning function for generating the trained model 90. In this case, the ultrasound diagnostic device 1 may be called a learning device 60.

[0062] Returning to FIG. 1, the B-mode processing function 114 generates B-mode data from the noise-reduced IQ data 54. The B-mode processing function 114 performs, for example, logarithmic compression processing on the noise-reduced IQ data 54 to generate data (B-mode data) in which signal intensity is expressed as brightness of luminance. The B-mode processing function 114 stores the generated B-mode data in the RAW data memory 104 as B-mode RAW data on a two-dimensional ultrasonic scan line (raster). Note that the B-mode RAW data may also be B-mode data on a three-dimensional ultrasonic scan line.

[0063] The division function 110 , the compound function 111 , the reconstruction function 112 , and the noise reduction function 113 may be included in the B-mode processing function 114 .

[0064] The Doppler processing function 115 performs frequency analysis on the IQ data 51 stored in the buffer memory 103 to generate data (Doppler data) that extracts motion information based on the Doppler effect of a moving object within a region of interest (ROI) set in the scan region. For example, the Doppler processing function 115 can execute a color Doppler method, also known as a color flow mapping (CFM) method. The Doppler processing function 115 stores the generated Doppler data in the RAW data memory 104 as Doppler RAW data on a two-dimensional ultrasonic scan line. Note that the Doppler RAW data may also be Doppler data on a three-dimensional ultrasonic scan line.

[0065] The image generation function 116 generates B-mode image data based on the B-mode RAW data generated by the B-mode processing function 114. The image generation function 116 also generates Doppler image data based on the Doppler RAW data generated by the Doppler processing function 115.

[0066] For example, the image generation function 116 generates two-dimensional ultrasound image data composed of pixels by performing RAW-pixel conversion on B-mode RAW data and Doppler RAW data. Examples of ultrasound image data include B-mode image data, color Doppler image data, and Doppler waveform image data. The image generation function 116 may also generate volume data by performing RAW-voxel conversion, including interpolation processing that takes spatial position information into account, on the B-mode RAW data stored in the RAW data memory. The image generation function 116 may also generate rendering image data or multi-planar reconstruction (MPR) image data by performing rendering processing or MPR processing on various types of volume data. The image generation function 116 stores the generated ultrasound image data in the image memory 106.

[0067] The display control function 117 causes the display 23 to display ultrasound images based on various ultrasound image data generated by the image generation function 116. The display control function 117 may also cause the display 23 to display a GUI that allows the operator to input various setting requests using the input device 22.

[0068] The system control function 118 controls the overall operation of the ultrasonic diagnostic apparatus 1. For example, the system control function 118 controls the ultrasonic probe 21 via the ultrasonic transmission circuit 101, thereby controlling ultrasonic scanning.

[0069] As described above, the ultrasound diagnostic device 1 of this embodiment includes a reconstruction function 112 that reconstructs compounded IQ data 53 based on amplitude information of compounded envelope data 52 generated from IQ data 51 by the compound function 111 and phase information of the IQ data 51. Therefore, according to the ultrasound diagnostic device 1 of this embodiment, even after compounding processing that causes the phase information of the IQ data 51 to be lost, it is possible to execute noise reduction processing using the amplitude information and phase information.

[0070] The ultrasound diagnostic device 1 of this embodiment also compounds multiple frames of IQ data 51 to generate compounded envelope data 52. The ultrasound diagnostic device 1 of this embodiment also generates noise-reduced IQ data 54 having a higher S / N ratio than the compounded IQ data 53, based on amplitude information and phase information of the compounded IQ data 53.

[0071] Generally, noise reduction processing of IQ data is performed for each frame of IQ data. Therefore, when processing that integrates multiple frames of IQ data, such as compounding, is performed, noise reduction processing is performed individually for each frame of the multiple frames of IQ data to be compounded before compounding processing is performed. Then, compounding processing is performed on the multiple frames of noise-reduced IQ data. With this method, the processing load increases depending on the number of frames to be compounded. For this reason, it has sometimes been difficult to perform such noise reduction processing during real-time processing that generates ultrasound image data during ultrasound scanning of a subject. Furthermore, since compounding processing causes the loss of phase information necessary for noise reduction processing, it has also been difficult to perform compounding processing before noise reduction processing.

[0072] In contrast, the ultrasound diagnostic apparatus 1 of this embodiment reconstructs compounded IQ data 53 based on amplitude information of compounded envelope data 52 generated from multiple frames of IQ data 51 and phase information of the multiple frames of IQ data 51. Furthermore, the ultrasound diagnostic apparatus 1 of this embodiment performs noise reduction processing on the compounded IQ data 53. That is, the ultrasound diagnostic apparatus 1 of this embodiment performs noise reduction processing on the compounded IQ data 53, which is obtained by combining multiple frames to be compounded. Therefore, even if the number of frames to be compounded increases, the load of the noise reduction processing can be reduced. Therefore, even if both compounding and noise reduction processing are performed in real-time processing to generate ultrasound image data during an ultrasound scan of the subject P, the time resolution of the ultrasound image data can be improved.

[0073] Furthermore, the ultrasound diagnostic device 1 of this embodiment obtains noise-reduced IQ data 54 by inputting compounded IQ data 53 to the trained model 90. In general, the data structure of data input to the trained model 90 must be uniform. For example, if the trained model 90 has trained input data with a data structure having amplitude information and phase information, such as IQ data, data having amplitude information and phase information must be input. Since the compounded IQ data 53 of this embodiment has a data structure having amplitude information and phase information, similar to the IQ data 51, the ultrasound diagnostic device 1 of this embodiment can apply the trained model 90, which performs noise reduction processing on individual IQ data, to noise reduction processing on the compounded IQ data 53.

[0074] Furthermore, the ultrasound diagnostic device 1 of this embodiment separates phase data 511 having phase information from the IQ data 51. The ultrasound diagnostic device 1 of this embodiment reconstructs compounded IQ data 53 using amplitude information of compounded envelope data 52 and phase information of phase data 511, thereby making it possible to include in the compounded IQ data 53 the phase information before it is lost by compounding.

[0075] In this embodiment, noise reduction processing is given as an example of processing that uses amplitude information and phase information of the compounded IQ data 53, but processing other than noise reduction processing may be used as long as it uses amplitude information and phase information. Also, in this embodiment, compounding is given as an example of processing that causes the phase information of the IQ data 51 to be lost, but processing other than compounding may be used as long as it causes the phase information of the IQ data 51 to be lost or altered.

[0076] (Second embodiment) In the first embodiment described above, a case where a noise reduction process using phase information is performed after a compound process in which phase information is lost is described. In this second embodiment, a case where a process using phase information is performed after a process in which phase information may be altered is described.

[0077] Fig. 6 is a block diagram showing an example of an ultrasonic diagnostic apparatus 1 according to the second embodiment. Similar to the first embodiment described in Fig. 1, the ultrasonic diagnostic apparatus 1 of this embodiment includes an apparatus main body 100, an ultrasonic probe 21, an input device 22, and a display 23, and is connected to an external device 30 via a network NW.

[0078] Furthermore, the device main body 100 of this embodiment, like the first embodiment, includes an ultrasonic transmission circuit 101, an ultrasonic reception circuit 102, a buffer memory 103, a RAW data memory 104, a storage circuit 105, an image memory 106, a communication interface 107, a processing circuit 108, an input interface 130, and an output interface 140.

[0079] The processing circuitry 108 of the ultrasound diagnostic apparatus 1 of this embodiment includes a segmentation function 210, a noise reduction function 213, a reconstruction function 212, a B-mode processing function 214, a Doppler processing function 215, an image generation function 116, a display control function 117, and a system control function 118.

[0080] The division function 110 is an example of a division section. The noise reduction function 213 is an example of a first processing section and a noise reduction section in this embodiment. The reconstruction function 212 is an example of a reconstruction section. The B-mode processing function 214 is an example of a B-mode processing section. The Doppler processing function 215 is an example of a second processing section, a blood flow detection section, and a Doppler processing section in this embodiment. The image generation function 116 is an example of an image generation section. The display control function 117 is an example of a display control section. The system control function 118 is an example of a system control section.

[0081] FIG. 7 is a diagram showing an example of the relationship between functions related to generation of phase-reconstructed IQ data according to the second embodiment.

[0082] The division function 210 divides phase data having phase information from the IQ data stored in the buffer memory 103. As shown in Fig. 7, when the division function 210 receives input of IQ data having amplitude information and phase information, it outputs phase data having phase information and IQ data having amplitude information and phase information. As in the first embodiment, the IQ data stored in the buffer memory 103 is an example of first ultrasound data.

[0083] The noise reduction function 213 receives input of IQ data and outputs noise-reduced IQ data. As in the first embodiment, the noise reduction function 213 of this embodiment inputs IQ data to the trained model 90 to obtain noise-reduced IQ data.

[0084] As in the first embodiment, the trained model 90 is a model in which a plurality of input ultrasound data are associated with a plurality of teacher ultrasound data and trained by a method such as deep learning.

[0085] The noise-reduced IQ data has a higher S / N ratio than the IQ data, and in this embodiment, the noise-reduced IQ data is an example of second ultrasound data.

[0086] The noise-reduced IQ data contains amplitude information and phase information, but this information may be altered by the noise reduction process. In this embodiment, "the information may be altered" does not necessarily mean that the information is altered, but includes the case where the quality of the information is not guaranteed.

[0087] The reconstruction function 212 reconstructs phase-restored IQ data having amplitude information and phase information based on the amplitude information of the noise-reduced IQ data and the phase information of the IQ data. Note that the reconstruction function 212 does not use the phase information of the noise-reduced IQ data, and therefore noise-reduced envelope data including only the amplitude information of the noise-reduced IQ data may be used as input data to the reconstruction function 212.

[0088] The phase-restored IQ data is data in which noise reduction processing has been performed and the phase information has been restored to its pre-deterioration state. The phase-restored IQ data is an example of third ultrasound data in this embodiment.

[0089] The Doppler processing function 215 performs frequency analysis on the phase-reconstructed IQ data to extract motion information based on the Doppler effect of a moving object within a ROI set in the scan region. The Doppler processing function 215 of this embodiment executes blood flow detection processing to detect the direction and magnitude (power) of blood flow based on amplitude information and phase information of the phase-reconstructed IQ data. The blood flow detection processing is an example of processing that uses amplitude information and phase information of the third ultrasound data in this embodiment.

[0090] The method for detecting blood flow from the phase-reconstructed IQ data can be a known color flow mapping method for detecting blood flow from IQ data. The Doppler processing function 215 stores the blood flow data detected from the phase-reconstructed IQ data in the RAW data memory 104. The blood flow data is, for example, Doppler data indicating blood flow information estimated by the color flow mapping method.

[0091] The division function 210 , noise reduction function 213 , and reconstruction function 212 of this embodiment may be included in the Doppler processing function 215 .

[0092] Next, the flow of processing executed by the division function 210, noise reduction function 213, and reconstruction function 212 will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the flow of processing for generating phase-reconstructed IQ data 1053 according to the second embodiment. In Fig. 8, the processing by the division function 210, noise reduction function 213, and reconstruction function 212 is illustrated by being surrounded by dashed lines.

[0093] The IQ data 1051 shown in Fig. 8 is IQ data corresponding to a data string at the same position when ultrasonic transmission and reception are performed on multiple scanning lines. Note that Fig. 8 illustrates processing for the IQ data 1051 corresponding to one data string, but processing for the IQ data 1051 corresponding to multiple data strings may be performed in parallel.

[0094] The division function 210 extracts the argument of the complex number as phase information from the IQ data stored in the buffer memory 103 (S101). The division function 210 outputs phase data 512 including the extracted phase information.

[0095] The noise reduction function 213 executes noise reduction processing using the trained model 90 on the IQ data stored in the buffer memory 103 (S102), and outputs noise-reduced IQ data 1052.

[0096] The reconstruction function 212 extracts the absolute value from the noise-reduced IQ data 1052 as amplitude information (S103), and reconstructs the phase-restored IQ data 1053 from the amplitude information and the phase information of the phase data 512 (S104). As a reconstruction method, the calculation shown in equation (3) can be adopted, as in the first embodiment.

[0097] The phase-reconstructed IQ data 1053 is then used in the blood flow detection process by the Doppler processing function 215 (S105).

[0098] 6, the B-mode processing function 214 of this embodiment performs logarithmic compression processing or the like on the IQ data 1051 stored in the buffer memory 103 to generate data (B-mode data) in which signal intensity is expressed as luminance brightness. The B-mode processing function 214 stores the generated B-mode data in the RAW data memory 104.

[0099] The image generation function 116, the display control function 117, and the system control function 118 have the same functions as those in the first embodiment. The image generation function 116 generates, for example, two-dimensional or three-dimensional color Doppler image data in which blood flow information is visualized from the two-dimensional Doppler data generated by the Doppler processing function 215.

[0100] As described above, the ultrasound diagnostic device 1 of this embodiment includes a reconstruction function 212 that reconstructs phase-restored IQ data 1053 having amplitude information and phase information based on amplitude information of noise-reduced IQ data 1052 and phase information of IQ data 1051. Therefore, according to the ultrasound diagnostic device 1 of this embodiment, even after noise reduction processing that may alter the phase information of IQ data 1051, it is possible to execute blood flow detection processing using amplitude information and phase information.

[0101] According to the ultrasound diagnostic device 1 of this embodiment, the phase-reconstructed IQ data 1053 having a high S / N ratio due to noise reduction can be used for blood flow detection processing, thereby improving the image quality of color Doppler image data obtained by color flow mapping.

[0102] (Variation 1) In the first embodiment described above, the ultrasound diagnostic apparatus 1 executes the process of generating the compounded IQ data 53. However, for example, this process may be executed by an external device 30 connected to the ultrasound diagnostic apparatus 1. When this configuration is adopted, the processing circuit of the external device 30 includes a division function 110, a compound function 111, a reconstruction function 112, and a noise reduction function 113.

[0103] The external device 30 may also have the same functions as the ultrasound diagnostic device 1 of the second embodiment. For example, the processing circuit of the external device 30 may have a division function 210, a noise reduction function 213, a reconstruction function 212, and a Doppler processing function 215. The external device 30 is an example of an image processing device in this modification.

[0104] (Variation 2) In the second embodiment described above, the processing circuitry 108 of the ultrasound diagnostic apparatus 1 has functions different from those of the first embodiment, but the processing circuitry 108 may have the functions of both the first and second embodiments. For example, when an ultrasound examination using B-mode processing is performed, the same processing as in the first embodiment may be executed, and when an ultrasound examination using Doppler processing is performed, the same processing as in the second embodiment may be executed.

[0105] (Variation 3) In the first and second embodiments described above, the reconstruction functions 112, 212 used the phase information divided from the IQ data 51, 1051 by the division functions 110, 210 for reconstruction, but the reconstruction method is not limited to this.

[0106] For example, the reconstruction functions 112 and 212 may use the phase information of the IQ data 51 and 1051 stored in the buffer memory 103 for reconstruction.

[0107] (Variation 4) Although the noise reduction process using the trained model 90 has been exemplified in the first and second embodiments, other methods of noise reduction may also be employed. For example, noise reduction process using a mathematical model or the like may be used in the first and second embodiments.

[0108] (Variation 5) In the first embodiment described above, noise reduction processing is exemplified as processing that uses both amplitude information and phase information, and in the second embodiment, blood flow detection processing is exemplified as processing that uses both amplitude information and phase information, but these processings are merely examples, and other processing that uses both amplitude information and phase information may be included in the first and second embodiments.

[0109] The various data handled in this specification are typically digital data.

[0110] In accordance with at least one embodiment described above, a process that uses both amplitude and phase information can be performed after a process that loses or alters phase information.

[0111] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0112] 1. Ultrasound diagnostic equipment 10. Device body 21 Ultrasound probe 22 Input Devices 23 Display 30 External device 51a, 51b, 1051 IQ data 52 Compounded Envelope Data 53 Compounded IQ Data 54,1052 noise-reduced IQ data 60 Learning Device 61 Input IQ data 62 Teacher IQ Data 90 trained models 100 Device body 101 Ultrasonic transmission circuit 102 Ultrasonic receiving circuit 103 Buffer Memory 104 RAW data memory 105 Memory circuit 106 Image Memory 107 Communication Interface 108 Processing Circuit 110,210 division function 111 Compound Function 112,212 Reconfiguration function 113,213 Noise reduction function 114,214 B-mode processing function 115,215 Doppler processing function 116 Image generation function 117 Display control function 118 System Control Functions 130 Input Interface 140 Output Interface 510 Added IQ Data 511,512 phase data 1053 Phase-reconstructed IQ data P Subject

Claims

1. a first processing unit that receives input of first ultrasound data having amplitude information and phase information and outputs second ultrasound data having amplitude information but not phase information; a reconstruction unit that reconstructs third ultrasound data including both amplitude information and phase information based on amplitude information of the second ultrasound data and phase information of the first ultrasound data; a second processing unit that performs processing using amplitude information and phase information of the third ultrasound data; Equipped with the first ultrasound data is complex signal data for a plurality of frames, the first processing unit generates the second ultrasound data by compounding the complex signal data for the plurality of frames; Ultrasound diagnostic equipment.

2. the second processing unit generates fourth ultrasound data having a higher signal-to-noise (SN) ratio than the third ultrasound data based on amplitude information and phase information of the third ultrasound data; The ultrasonic diagnostic apparatus according to claim 1 .

3. The second processing unit obtains the fourth ultrasound data by inputting the third ultrasound data into a trained model that has trained a plurality of input ultrasound data and a plurality of teacher ultrasound data in which noise components of the plurality of input ultrasound data have been reduced. The ultrasonic diagnostic apparatus according to claim 2 .

4. the second processing unit executes a blood flow detection process for detecting a blood flow based on amplitude information and phase information of the third ultrasound data. The ultrasonic diagnostic apparatus according to claim 1 .

5. a division unit that divides phase data having phase information from the first ultrasound data, the reconstruction unit reconstructs the third ultrasound data using amplitude information of the second ultrasound data and phase information of the phase data. The ultrasonic diagnostic apparatus according to any one of claims 1 to 4.

6. a storage unit that stores the first ultrasound data, the reconstruction unit reconstructs the third ultrasound data using the second ultrasound data and phase information of the first ultrasound data stored in the storage unit. The ultrasonic diagnostic apparatus according to any one of claims 1 to 5.

7. a first processing unit that receives input of first ultrasound data having amplitude information and phase information and outputs second ultrasound data having amplitude information but not phase information; a reconstruction unit that reconstructs third ultrasound data including both amplitude information and phase information based on amplitude information of the second ultrasound data and phase information of the first ultrasound data; a second processing unit that performs processing using amplitude information and phase information of the third ultrasound data; Equipped with the first ultrasound data is complex signal data for a plurality of frames, the first processing unit generates the second ultrasound data by compounding the complex signal data for the plurality of frames; Image processing device.

8. a first processing step of receiving input of first ultrasound data having amplitude information and phase information and outputting second ultrasound data having amplitude information but not phase information; a reconstruction step of reconstructing third ultrasound data including both amplitude information and phase information based on amplitude information of the second ultrasound data and phase information of the first ultrasound data; a second processing step of performing processing using amplitude information and phase information of the third ultrasound data; on the computer, the first ultrasound data is complex signal data for a plurality of frames, In the first processing step, the second ultrasound data is generated by compounding the complex signal data for the plurality of frames. program.

Images