Ultrasound diagnostic device and program

Abstract

To make further appropriate image quality adjustment to an ultrasonic image.SOLUTION: An ultrasonograph includes an acquisition part, an analysis part and a determination part. The acquisition part acquires an ultrasonic image including a part corresponding to a heart of a subject. The ultrasonic image includes image data acquired by transmitting ultrasonic waves to a scan area in a subject and representing, by luminance, signal intensity of reflected waves reflected in the subject. The analysis part executes analysis based on a distribution of luminance levels of the image data. The determination part determines an image processing content relating to the ultrasonic image on the basis of information analyzed by the analysis part. Further, the determination part differentiates a degree of image processing for an area corresponding to a cardiac apex of the heart included in the ultrasonic image from a degree of image processing for an area other than the area corresponding to the cardiac apex.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The embodiments disclosed in the present specification and drawings relate to an ultrasound diagnostic apparatus and a program. [Background technology]

[0002] In recent years, ultrasound images generated by ultrasound diagnostic devices are used in the diagnosis of biological parts in a subject. The ultrasound diagnostic device radiates ultrasound to the subject using an ultrasound probe in which multiple ultrasound transducers are arranged, and generates an ultrasound image by receiving the reflected waves of the radiated ultrasound. However, depending on the biological part such as the heart, the ultrasound image may not necessarily have the brightness expected by the user. In recent years, there are ultrasound diagnostic devices equipped with a function for uniformly adjusting the brightness level of an ultrasound image, but when the biological part is the heart, the expected brightness, etc. differs depending on the part to be diagnosed and the orientation of the heart in the image, so that appropriate image quality adjustment may not be possible. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-61239 A [Patent Document 2] Patent No. 6367261 [Patent Document 3] JP 2009-39475 A [Patent Document 4] JP 2018-79000 A [Patent Document 5] JP 2017-164077 A Summary of the Invention [Problem to be solved by the invention]

[0004] The problem to be solved by the embodiments disclosed in this specification and the drawings is to perform more appropriate image quality adjustment for an ultrasound image. However, the problem to be solved by the embodiments disclosed in this specification and the drawings is not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0005] An ultrasound diagnostic device according to an embodiment includes an acquisition unit, an analysis unit, and a determination unit. The acquisition unit acquires an ultrasound image including a portion corresponding to the heart of a subject. The ultrasound image includes image data in which ultrasound waves are transmitted to a scan area within the subject, and the signal strength of the reflected waves reflected within the subject is expressed by brightness. The analysis unit performs an analysis based on the distribution of brightness levels of the image data. The determination unit determines image processing content for the ultrasound image based on the information analyzed by the analysis unit. The determination unit also differentiates the degree of image processing for an area included in the ultrasound image that corresponds to the apex of the heart from the degree of image processing for an area outside the area corresponding to the apex of the heart. [Brief description of the drawings]

[0006] [Figure 1] 1 is a configuration diagram of an ultrasound diagnostic system 1 including an ultrasound diagnostic apparatus 100 according to a first embodiment. [Diagram 2] FIG. 4 is a diagram for explaining the processing executed by an analysis function 164. [Diagram 3] FIG. 13 is a diagram for explaining the analysis performed in a direction other than the beam direction L1. [Figure 4] 13 is a diagram showing the distribution of signal brightness levels with respect to depth in the beam direction L1 in a B-mode image IM2. FIG. [Diagram 5] 13 is a diagram showing the distribution of signal brightness levels with respect to depth in the beam direction L2 in a B-mode image IM2. FIG. [Figure 6] FIG. 13 is a diagram showing an example of the contents of a direction determination table 182. [Figure 7] FIG. 13 is a diagram showing an example of the contents of an image processing content setting table 184. [Figure 8] FIG. 4 is a diagram for explaining the image processing content in the first view mode. [Figure 9] 5 is a flowchart showing an example of a flow of processing executed by the processing circuitry 160 of the first embodiment. [Figure 10] FIG. 1 is a configuration diagram of an ultrasound diagnostic system 1A including an ultrasound diagnostic device 100A according to a second embodiment. [Figure 11] A diagram showing a schematic diagram of an example of a method for generating a trained model 186 in a learning function 174 according to the second embodiment. [Figure 12] 10 is a flowchart showing an example of the flow of processing executed by a processing circuit 160A according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an ultrasonic diagnostic apparatus and a program according to an embodiment will be described with reference to the drawings.

[0008] (First embodiment) 1 is a configuration diagram of an ultrasound diagnostic system 1 including an ultrasound diagnostic device 100 of the first embodiment. The ultrasound diagnostic system 1 includes an ultrasound probe 10, an external device 20, and the ultrasound diagnostic device 100. The external device 20 and the ultrasound diagnostic device 100 are connected via a network NW such as a wide area network (WAN), a local area network (LAN), the Internet, a dedicated line, a wireless base station, a provider, or the like. The ultrasound probe 10 may be included in the configuration of the ultrasound diagnostic device 100.

[0009] The ultrasonic probe 10 performs ultrasonic scanning on a scanning area in a living body P, which is a subject, under the control of, for example, the ultrasonic diagnostic device 100. The scanning area is, for example, an area associated with the position and direction of the probe surface of the ultrasonic probe 10. The ultrasonic probe 10 has, for example, a plurality of piezoelectric transducers, a matching layer provided on the piezoelectric transducers, and a backing material that prevents the propagation of ultrasonic waves backward from the piezoelectric transducers. The ultrasonic probe 10 is, for example, a one-dimensional array linear probe in which a plurality of ultrasonic transducers are arranged along a predetermined direction. The ultrasonic probe 10 may be detachably connected to the ultrasonic diagnostic device 100, or a plurality of ultrasonic probes 10 may be connected to the ultrasonic diagnostic device 100. When a plurality of ultrasonic probes 10 are connected to the ultrasonic diagnostic device 100, which of the connected ultrasonic probes is to be used for ultrasonic scanning is arbitrarily selected by a switching operation by an operator or the like.

[0010] The external device 20 is, for example, a PACS (Picture Archiving and Communication System) that is a system for managing various types of medical image data, an electronic medical record system that manages electronic medical records to which medical images are attached, etc. The external device 20 may also be a storage device such as a storage server or a database.

[0011] The ultrasound diagnostic device 100 includes, for example, an ultrasound transmission circuit 110, an ultrasound reception circuit 112, a signal processing circuit 120, a communication interface 130, an input interface 140, a display 150, a processing circuit 160, and a memory circuit 180. The input interface 140 is an example of a "receiving unit." The display 150 is an example of a "display unit." The memory circuit 180 is an example of a "memory unit."

[0012] The ultrasonic transmission circuit 110 transmits drive signals to the multiple piezoelectric transducers of the ultrasonic probe 10, and generates ultrasonic waves by vibration of the piezoelectric transducers. As a result, ultrasonic waves are transmitted from the surface (body surface) of the living body P in contact with the probe surface of the ultrasonic probe 10 to the inside.

[0013] The ultrasonic receiving circuit 112 receives signals that are generated when ultrasonic waves transmitted from the ultrasonic probe 10 are reflected by the tissues of the living body P, and the reflected signals (reflected wave signals) are received by multiple piezoelectric transducers and converted into electrical signals. When ultrasonic pulses transmitted into the living body P are reflected by the surface of a moving blood flow or a heart wall, the reflected wave signals undergo frequency shift due to the Doppler effect depending on the velocity component of the moving body in the ultrasonic transmission direction. The ultrasonic receiving circuit 112 amplifies the reflected wave signals received by the ultrasonic probe 10 and converts them into digital signals. The ultrasonic receiving circuit 112 may also generate a received signal in which the reflected components from the direction corresponding to the reception directivity are emphasized by providing a delay time required to determine the reception directivity to the digital signals and adding up multiple digital signals to which the delay time has been provided.

[0014] The signal processing circuit 120 performs signal processing to generate ultrasound data based on the signal received by the ultrasound receiving circuit 112. The ultrasound data includes, for example, B-mode data. For example, the signal processing circuit 120 performs envelope detection processing and logarithmic amplification processing on the reception signal (reflected wave signal) received by the ultrasound receiving circuit 112 to generate B-mode data in which the signal strength is expressed by the level of luminance. In addition, the signal processing circuit 120 converts (scan converts) the scan line signal sequence of the ultrasound scan into a scan line signal sequence in a format that can be displayed on the display 150 or the like, and generates B-mode image data including B-mode data on two-dimensional ultrasound scan lines (raster) within the scan area. The B-mode image data may include information regarding the time of generation.

[0015] The ultrasound data may include Doppler data. In this case, the signal processing circuit 120 performs frequency analysis based on the reception signal received by the ultrasound reception circuit 112 to generate Doppler data that extracts motion information based on the Doppler effect of a moving object in a ROI (Region Of Interest) set in the scan region. For example, the signal processing circuit 120 generates Doppler data that estimates an average velocity, an average variance value, an average power value, etc., as motion information of an object (moving object) included in the scan region, at each of a plurality of sample points. Here, the moving object is, for example, blood flow, tissue such as a heart wall, and a contrast agent. For example, the signal processing circuit 120 generates Doppler data that estimates an average velocity, an average variance value, an average power value, etc., of the blood flow, at each of a plurality of sample points, as motion information (blood flow information) of the blood flow. In addition, the signal processing circuit 120 performs scan conversion on a scan line signal sequence of the ultrasound scan based on the generated Doppler data, for example, to generate Doppler image data including Doppler data on two-dimensional ultrasound scan lines in the ROI. The Doppler image data may include information about the time when the image data was generated. In the following, the ultrasound image data will be mainly described as B-mode image data.

[0016] The communication interface 130 includes, for example, a communication interface such as a NIC (Network Interface Card), etc. The communication interface 130 is connected to the external device 20 via the network NW, and performs data communication with the external device 20.

[0017] The input interface 140 receives various input operations from an operator, converts the received input operations into electrical signals, and outputs the electrical signals to the processing circuit 160. For example, the input interface 140 is realized by a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, or the like. The input interface 140 may also be realized by a user interface that receives voice input from a microphone, for example. When the input interface 140 is a touch panel, the display 150 described later may be formed integrally with the input interface 140. Note that in this specification, the input interface 140 is not limited to only those that include physical operating parts such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs the electrical signal to a control circuit is also included as an example of the input interface 140.

[0018] The display 150 displays various types of information. For example, the display 150 displays an image generated by the processing circuit 160 in a predetermined display state under the control of the display control function 172, and displays a GUI (Graphical User Interface) for receiving various input operations from an operator. For example, the display 150 is an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) display, an organic EL (Electro Luminescence) display, or the like.

[0019] The processing circuitry 160 includes, for example, an acquisition function 162, an analysis function 164, a judgment function 166, a decision function 168, an image generation function 170, and a display control function 172. The processing circuitry 160 realizes these functions by, for example, a hardware processor executing a program stored in a storage device (storage circuitry 180).

[0020] The hardware processor means a circuit such as a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD) or a complex programmable logic device (CPLD), or a field programmable gate array (FPGA)). Instead of storing the program in the memory circuit 180, the program may be directly embedded in the circuit of the hardware processor. In this case, the hardware processor realizes the function by reading and executing the program embedded in the circuit. The above program may be stored in the memory circuit 180 in advance, or may be stored in a non-transitory storage medium such as a DVD or a CD-ROM, and may be installed in the memory circuit 180 from the non-transitory storage medium by mounting the non-transitory storage medium in a drive device (not shown) of the ultrasound diagnostic apparatus 100. The hardware processor is not limited to being configured as a single circuit, but may be configured as one hardware processor by combining multiple independent circuits to realize each function. Also, multiple components may be integrated into one hardware processor to realize each function. The acquisition function 162 is an example of an "acquisition unit". The analysis function 164 is an example of an "analysis unit". The judgment function 166 is an example of a "judgment unit". The decision function 168 is an example of a "decision unit". The image generation function 170 is an example of an "image generation unit". The display control function 172 is an example of a "display control unit".

[0021] The storage circuit 180 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, or the like. These storage media, including non-transient storage media, may be realized by other storage devices connected via a network NW, such as a NAS (Network Attached Storage) or an external storage server device. The storage circuit 180 may also include a transient storage medium, such as a ROM (Read Only Memory) or a register. The storage circuit 180 stores, for example, an orientation determination table 182, an image processing content setting table 184, a program, and other information. The contents of the orientation determination table 182 and the image processing content setting table 184 will be described later.

[0022] The acquisition function 162 acquires the B-mode image data processed by the signal processing circuit 120. The acquisition function 162 also receives information indicating a scan mode in the ultrasound diagnostic device 100 based on the operation content of the operator inputted via the input interface 140. The scan mode includes, for example, a first scan mode in which a part corresponding to the heart of the subject is scanned, and a second scan mode in which a part corresponding to a part other than the heart is scanned.

[0023] When the analysis function 164 receives information indicating the first scan mode from the acquisition function 162, the analysis function 164 analyzes a signal brightness level based on the distance (depth) from the probe surface of the ultrasound probe 10 based on the B-mode image data acquired by the acquisition function 162. The distance from the probe surface of the ultrasound probe 10 may be interpreted as the distance from the body surface of the living body P. The same applies below. The analysis function 164 also analyzes the distribution of the analyzed signal brightness level to acquire characteristic information of the B-mode image data. The characteristic information includes, for example, the number of peaks in the distribution of the signal brightness level, the peak interval, the peak section, etc. Details of the processing in the analysis function 164 will be described later.

[0024] The determination function 166 determines the orientation of the portion corresponding to the heart in the B-mode image (hereinafter, referred to as the heart in the image) based on the feature information analyzed by the analysis function 164.

[0025] The determination function 168 determines the image processing content to be executed on the B-mode image data by the image generation function 170 based on the result of the determination by the determination function 166. Details of the processing in the analysis function 164, the determination function 166, and the determination function 168 will be described later.

[0026] The image generating function 170 generates a display image (ultrasound image) to be displayed on the display 150 based on the B-mode image data acquired by the acquiring function 162. For example, the image generating function 170 generates a two-dimensional B-mode image as a display image, in which information indicating the brightness level included in each coordinate position (e.g., pixel position) of the B-mode image data is converted into a predetermined color or brightness on the image.

[0027] In addition, the image generation function 170 may perform image processing (smoothing processing) that regenerates an average brightness image using multiple image frames in a B-mode image, or image processing (edge ​​enhancement processing) that uses a differential filter within the image.

[0028] When the Doppler image data is acquired by the acquisition function 162, the image generation function 170 may generate a Doppler image based on the Doppler image data. In this case, the image generation function 170 generates a two-dimensional Doppler image by converting, for example, the magnitude of the motion information of the moving object at each coordinate position of the Doppler image data (for example, the average velocity, average variance value, average power value, etc. of the blood flow) into a color, pattern, etc. In addition, the image generation function 170 may generate a display image by superimposing the generated Doppler image on a B-mode image.

[0029] Furthermore, when the image generating function 170 receives an instruction to perform standard image quality adjustment from the input interface 140, the image generating function 170 may perform image processing corresponding to the standard image quality adjustment on the display image regardless of the type of scan mode. The standard image quality adjustment is, for example, a gain (GAIN) adjustment or a STC (Sensitivity Time Control) adjustment. The gain adjustment includes, for example, adjustment of the luminance level of the entire display image so that the average luminance, maximum luminance value, or minimum luminance value of the entire display image falls within a predetermined luminance range, and adjustment of the amplification degree in the amplification process of the reflected wave signal executed by the signal processing circuit 120. The STC adjustment is, for example, a function for independently adjusting the luminance level for each depth in order to complement the decrease in luminance due to attenuation of ultrasonic waves according to the depth of the display image (i.e., the distance from the probe surface of the ultrasonic probe 10) or to reduce the luminance of the strong echo part of the deep myocardium. For example, the image generating function 170 can make it easier for the operator to view the image of the part present in the deep area by increasing the gain of the deep area by the STC adjustment to increase the luminance.

[0030] The input interface 140 may be provided with a switch for switching whether or not to continuously perform the standard image quality adjustment during scanning. In this case, the image generating function 170 continuously performs the above-mentioned standard image quality adjustment when the above switch is on. In addition, when the image generating function 170 acquires gain or STC adjustment values ​​manually input by the operator using a dial switch or the like of the input interface 140, the image generating function 170 may perform gain adjustment or STC adjustment of the display image based on the adjustment values.

[0031] Furthermore, during or after the standard image quality adjustment process, the image generating function 170 executes the image processing determined by the determining function 168 to generate an image for display.

[0032] The image generating function 170 may also combine the display image with character information of various parameters, scales, information indicating a body mark, etc. Character information of various parameters is, for example, information indicating the scan mode, the distance from the probe surface of the ultrasound probe 10 to a predetermined site (for example, the heart or blood vessels), and characteristic information obtained by the analysis of the analysis function 164.

[0033] The display control function 172 displays the display image generated by the image generation function 170 on the display 150. For example, the display control function 172 may switch the display content displayed on the display 150 or the content of the image generated by the image generation function 170 based on the operation content of the operator or the like inputted via the input interface 140. For example, the display control function 172 performs control such as switching between display and non-display of the display image, switching whether or not to superimpose a Doppler image on a B-mode image, and displaying in a display form according to the scan mode based on the operation content of the operator or the like.

[0034] The details of the processing in the analysis function 164, the judgment function 166, and the decision function 168 will be described below. FIG. 2 is a diagram for explaining the processing executed by the analysis function 164. In the example of FIG. 2, the B-mode image IM1 and the distribution of the signal brightness level are shown in a simplified manner. The same applies to the following figures. For example, the analysis function 164 analyzes the signal brightness level for the depth of a predetermined ultrasonic transmission / reception direction (hereinafter referred to as the beam direction) corresponding to the scan area for the B-mode image data. In the example of FIG. 2, the distribution of the signal brightness level for the depth (in other words, the distance from the probe surface of the ultrasound probe 10) in the beam direction L1 (the direction along the Y axis in FIG. 2) in the B-mode image IM1 on the two-dimensional coordinate system (XY coordinate system) is shown. The B-mode image IM1 includes an in-image heart H1 expressed by brightness information. The beam direction L1 is, for example, a direction corresponding to the center of the scan area (the center of the B-mode image). The heart has, for example, four cardiac chambers (right ventricle, left ventricle, right atrium, left atrium), myocardium, endocardium, and pericardium, and the brightness levels corresponding to each part are different. Therefore, a distribution of signal brightness levels is obtained as shown in Figure 2.

[0035] Furthermore, the analysis function 164 analyzes the distribution of the signal luminance level to obtain characteristic information of the image. For example, the analysis function 164 analyzes the number of peaks, the peak interval, and the peak section, regarding a continuous section in which the signal luminance level is equal to or higher than a predetermined threshold value TH1 as one peak. In the example of FIG. 2, the analysis function 164 obtains information such as the number of peaks 3, the peak intervals W1 and W2, and the peak sections Wa, Wb, and Wc as characteristic information. Furthermore, the analysis function 164 may include other information obtained from the distribution of the signal luminance level, such as the position of the peak, the maximum luminance level, and the peak pattern, in the characteristic information, or may include the distribution of the signal luminance level itself in the characteristic information.

[0036] The analysis function 164 may also analyze the signal brightness level for the depth in a direction other than the beam direction L1 in the scan region to acquire feature information. FIG. 3 is a diagram for explaining the analysis for a direction other than the beam direction L1. In the example of FIG. 3, a distribution of the signal brightness level for the depth of a beam direction L2 tilted by a predetermined angle θ1 from the angle of the beam direction L1 (reference angle 0 degrees) with respect to the position of the probe surface as a reference is shown for a B-mode image IM1. The analysis function 164 also analyzes the distribution of the signal brightness level as shown in FIG. 3 for the depth of the beam direction L2 to acquire feature information such as the number of peaks 1 and the peak section Wd. The angle θ1 for which feature information is acquired may be one or more angles that are set in advance, or may be set by the operator. The analysis function 164 may acquire feature information for each different angle θ1, and may acquire feature information at each angle as feature information in one B-mode image.

[0037] The above-mentioned feature information differs greatly depending on the orientation of the heart H1 in the image included in the B-mode image. FIG. 4 is a diagram showing the distribution of the signal brightness level with respect to the depth of the beam direction L1 in the B-mode image IM2. FIG. 5 is a diagram showing the distribution of the signal brightness level with respect to the depth of the beam direction L2 in the B-mode image IM2. The orientation of the heart H1 in the image in the B-mode image IM2 is different from the orientation of the heart H1 in the image in the B-mode image IM1. For example, a B-mode image with a different orientation of the heart H1 in the image is acquired depending on the position and orientation of the ultrasound probe 10. The distribution of the signal brightness level with respect to the depth of the beam direction L1 shown in FIG. 4 is different from the distribution shown in FIG. 2, and the distribution of the signal brightness level with respect to the depth of the beam direction L2 shown in FIG. 5 is different from the distribution shown in FIG. 3. Therefore, the respective feature information is also different. The determination function 166 can determine the orientation of the heart H1 in the image included in the B-mode image by comparing the feature information analyzed by the analysis function 164 with the feature information previously acquired for each orientation of the heart H1 in the image. Furthermore, the determination function 166 can obtain feature information of a plurality of beam directions for one B-mode image, thereby enabling the determination function 166 to determine the orientation of the heart H1 in the image with higher accuracy.

[0038] Here, when the in-image heart H1 is located near the center of the image IM1 as shown in Fig. 2 to Fig. 5, the larger the value of the angle θ1 (the further the ultrasonic transmission / reception direction is from the center of the image), the further away from the in-image heart H1 becomes, so the signal brightness level in that direction becomes smaller overall. Therefore, the analysis function 164 may analyze the value of the angle θ1 at which the peak of the signal brightness level does not become equal to or greater than the threshold value TH1, and include the angle θ in the feature information. This allows the determination function 166 to determine the orientation of the in-image heart H1 using information indicating the angle at which the peak of the signal brightness level does not become equal to or greater than the threshold value TH1.

[0039] Next, the details of the process in the determination function 166 will be described. For example, the determination function 166 determines the orientation of the heart in the image using an orientation determination table 182 stored in advance in the storage circuitry 180. FIG. 6 is a diagram showing an example of the contents of the orientation determination table 182. In the orientation determination table 182, for example, the angle θ1 and feature information are associated with information indicating the orientation of the heart in the image. The orientation determination table 182 illustrated in FIG. 6 includes portrait and landscape orientations as the orientation of the heart in the image. The portrait orientation is, for example, an orientation in which the direction from the viewpoint of the B-mode image to the heart crosses the longitudinal direction of the heart. In the case of the portrait orientation, for example, as shown in the B-mode image IM1 in FIG. 2 and FIG. 3, the longitudinal direction of the heart H1 in the image is positioned in the vertical direction (Y-axis direction) of the image. In addition, the landscape orientation is, for example, an orientation in which the direction from the viewpoint of the B-mode image to the heart is along the longitudinal direction of the heart. In the case of the horizontal orientation, for example, as shown in the B-mode image IM2 in FIG. 4 and FIG. 5, the longitudinal direction of the heart H1 in the image is positioned in the horizontal direction (X-axis direction) of the image.

[0040] The determination function 166, for example, compares the characteristic information of each orientation in association with the angle θ1, and acquires the orientation with the highest similarity as the orientation of the heart H1 in the image. Furthermore, in addition to portrait and landscape orientations, characteristic information of three or more different orientations may be registered in the orientation determination table 182. This allows the determination function 166 to determine the orientation in more detail.

[0041] The determination function 166 may also determine whether the orientation of the in-image heart H1 is a predetermined orientation. The predetermined orientation may be portrait, landscape, or other orientation. For example, when determining whether the predetermined orientation is portrait, the orientation determination table 182 may store feature information for portrait orientation. In this case, the determination function 166 compares the feature information analyzed by the analysis function 164 with the feature information associated with portrait orientation, and determines that the orientation of the in-image heart H1 is portrait if the similarity of the feature information is equal to or greater than a predetermined value, and determines that the orientation of the in-image heart H1 is not portrait if the similarity is less than the predetermined value. In this way, by determining whether the orientation of the in-image heart H1 is a predetermined orientation, it is not necessary to compare with feature information associated with a plurality of orientations, so that the processing load can be reduced and the determination result can be obtained more quickly.

[0042] Next, details of the process in the decision function 168 will be described. The decision function 168 decides the image processing content for the display image generated by the image generation function 170 based on the result of the determination made by the determination function 166. For example, the decision function 168 refers to an image processing content setting table 184 stored in advance in the storage circuitry 180 using information indicating the orientation of the heart in the image determined by the determination function 166, and decides the image processing content for the display image.

[0043] FIG. 7 is a diagram showing an example of the contents of the image processing contents setting table 184. In the image processing contents setting table 184, for example, information indicating the orientation of the heart in the image is associated with image processing contents for an image including the heart in the image. The image processing contents include, for example, information indicating a gain value for image quality adjustment and information regarding a target area of ​​the image to be subjected to image quality adjustment. The gain value may be, for example, information for further adjusting the value of the gain adjustment or STC adjustment when the above-mentioned standard image quality adjustment is performed, or may be information indicating the adjustment degree of the gain adjustment or STC adjustment when the standard image quality adjustment is performed. The gain value may also be information indicating the adjustment degree of the gain adjustment or STC adjustment when the standard image quality adjustment is not performed. The image processing content may also include information on an algorithm (program) for executing image processing according to the orientation of the heart in the image.

[0044] For example, image processing content setting table 184 stores image processing content suitable for the first view mode when the orientation of the heart in the image is vertical, and stores image processing content suitable for the second view mode when the orientation of the heart is not vertical (for example, horizontal). Therefore, determination function 168 acquires image processing content suitable for the first view mode when the orientation of the heart in the image is vertical, and acquires image processing content suitable for the second view mode when the orientation of the heart in the image is horizontal, and causes image generation function 170 to execute processing according to the image processing content.

[0045] Here, the first view mode and the second view mode and the image processing contents suitable for each of them will be specifically described. FIG. 8 is a diagram for explaining the image processing contents in the first view mode. In the example of FIG. 8, a vertically oriented in-image heart H1 is shown in a two-dimensional B-mode image IM3. The first view mode is, for example, a view mode corresponding to an apical view. The first view mode is, for example, a mode in which an ultrasonic probe 10 is positioned on the apical side to perform an ultrasonic scan and display cross sections of four or two cardiac chambers. In addition, the first view mode is expected to clearly display the cross sections of the cardiac chambers and, at the same time, to clearly display the myocardium and endocardium of the portion H2 corresponding to the apex. However, when the heart is scanned so as to be vertical, noise called biological artifacts is often simultaneously displayed in the portion H2 corresponding to the apex. Therefore, there is a possibility that the image of the portion corresponding to the myocardium and endocardium may be hidden behind the noise. Furthermore, if the above-mentioned standard image quality adjustment is performed on B-mode image IM3 including the heart H1 in a vertically oriented image, the above-mentioned noise will be recognized as a signal, and image quality adjustment will be performed to reduce (lower) the brightness of the entire image, which has been increased by the noise. As a result, the signal brightness level of the myocardium and endocardium, which are the areas that one wishes to view, will decrease, and the structure of the apex of the heart may not be displayed clearly.

[0046] Therefore, as image processing content suitable for the first view mode, the image generating function 170 makes the degree of image processing in the area AR1 including the portion H2 corresponding to the apex included in the B-mode image IM3 different from the degree of the area outside the area AR1. For example, when the standard image quality adjustment is performed on the entire B-mode image IM3, the image generating function 170 performs a brightness adjustment to increase (raise) the brightness in the area AR1 by a predetermined amount because the brightness of the area AR1 is decreased (darkened). The predetermined amount may be an amount associated with the brightness before the standard image quality adjustment is performed, or may be a fixed amount. Furthermore, the image generating function 170 may perform a brightness adjustment to increase the brightness in the area AR1 by a predetermined amount before the standard image quality adjustment is performed.

[0047] Furthermore, the image generating function 170 may adjust the degree of brightness adjustment in the area AR1 smaller than the degree of adjustment in areas other than the area AR1 when adjusting the standard image quality based on the image processing content associated with the first view mode. This makes it possible to prevent the brightness of the area AR1 from decreasing.

[0048] The image quality adjustment described above makes it possible to display the structure of the apex of the heart and the like more clearly without reducing the ability to visualize the myocardium and endocardium.

[0049] Furthermore, the image generating function 170 may generate an ultrasound image in which the degree of image processing is gradually changed from outside the area to inside the area in the image processing near the boundary of the area AR1. In this case, the image generating function 170 acquires the degree of brightness adjustment outside the area AR1 and the degree of brightness adjustment inside the area AR1 based on, for example, the contents of the standard image quality adjustment or the image processing contents acquired by the determination function 168. Then, the image generating function 170 performs brightness adjustment processing (for example, gradation processing) in which the degree of brightness adjustment is continuously changed using a predetermined number of pixels existing in a position from the outside of the area AR1 toward the inside of the area AR1. This makes it possible to suppress a large change in the degree of brightness adjustment at the boundary of the area AR1, and to display an image with less discomfort near the boundary of the area AR1.

[0050] The shape of the area AR1 is not limited to the example in Fig. 8, and may be, for example, a rectangle, a circle, or other shapes. If information on the position of the target area (for example, the area AR1) is not included in the image processing contents of the image processing contents setting table 184, the image generating function 170 may acquire edge information based on the brightness difference between adjacent pixels in the B-mode image IM3, predict the portion H2 corresponding to the apex of the heart from the contour shape based on the acquired edge information, and set the area AR1. In addition, in the first view mode, the image generating function 170 may perform the above-mentioned image quality adjustment on the entire B-mode image IM3 without setting a target area.

[0051] The second view mode is, for example, a view mode corresponding to a parasternal view. The second view mode is, for example, a mode in which the ultrasound probe 10 is positioned between the ribs at the left edge of the sternum to perform an ultrasound scan and display the left ventricular outflow tract and the vicinity of the aortic valve. In the second view mode, since there is no structure that the operator or the like wants to view in the vicinity of the probe surface, artifacts are often not noticeable, and even if an artifact is displayed in the vicinity of the close distance, there is no problem in diagnosis. Therefore, in the second view mode, the image generating function 170 only needs to perform standard image quality adjustment. In this case, the image processing contents of the image processing contents setting table 184 may store processing contents that perform only standard image quality adjustment, or may not store any processing contents, or may store processing contents with a smaller degree of adjustment than the processing contents of the first view mode. In addition, the second view mode may be used, for example, when displaying an ultrasound image in which the orientation of the heart in the image is other than vertical, or an ultrasound image including a part other than the heart obtained by the second scan mode.

[0052] The image generating function 170 can perform image processing based on the view mode according to the orientation of the heart in the image contained in the B-mode image, and therefore can more appropriately perform brightness adjustment of the image as expected by the operator, etc. In addition, when the first scan mode for scanning the part corresponding to the heart of the subject is instructed, image quality adjustment according to the orientation of the heart in the image is automatically performed, so that the operator does not need to manually adjust the image quality every time the view mode is changed, thereby reducing the burden on the operator.

[0053] Next, the operation of the ultrasound diagnostic device 100 of the first embodiment will be described. First, an operator instructs the ultrasound diagnostic device 100 to execute a program according to this embodiment via the input interface 140. The processing circuitry 160 of the ultrasound diagnostic device 100 reads the program according to this embodiment from the storage circuitry 180 in accordance with the instruction, and executes the read program.

[0054] The operator inputs a scan mode from the input interface 140 and an instruction to execute image processing such as standard image quality adjustment, and performs a scan of the heart using the ultrasound probe 10. The scan is for collecting B-mode data of a scan area including the heart, but may include a scan for collecting Doppler data. The following describes a case where B-mode data is collected. Ultrasound transmitted from the ultrasound probe 10 into the body of a subject such as a patient is reflected by the body tissues one after another and received by the ultrasound probe 10 as a reflected wave signal. The ultrasound receiving circuit 112 performs various processes on the reflected wave signal received by the ultrasound probe 10 to generate a received signal. The signal processing circuit 120 generates B-mode data and B-mode image data based on the received signal received from the ultrasound receiving circuit 112, and outputs the generated data to the processing circuit 160.

[0055] The processing circuitry 160 executes various processes using data input from the signal processing circuitry 120. Fig. 9 is a flowchart showing an example of the flow of processes executed by the processing circuitry 160 of the first embodiment. In the example of Fig. 9, the acquisition function 162 of the processing circuitry 160 acquires a scan mode input from the input interface 140 (step S100). Next, the acquisition function 162 acquires B-mode data (step S102).

[0056] Next, the analysis function 164 judges whether the image display mode acquired by the acquisition function 162 is the first scan mode (step S104). If it is judged that the image display mode is the first scan mode, the analysis function 164 performs an analysis based on the brightness level distribution for the depth for each beam direction (ultrasound transmission / reception direction) included in the B-mode data, and generates feature information (step S106). Next, the determination function 166 judges the orientation of the heart in the image included in the B-mode data based on the result (feature information) analyzed by the analysis function 164 (step S108). Next, the determination function 166 judges whether the orientation of the heart is a predetermined orientation (step S110). The predetermined orientation is, for example, portrait orientation, but may be changed to another orientation depending on the contents and purpose of diagnosis.

[0057] If it is determined that the orientation of the heart is the predetermined orientation, the decision function 168 acquires image processing content for the first view mode (step S112). If it is determined in the process of step S104 that the first scan mode is not selected, or if it is determined in the process of step S110 that the orientation of the heart is not the predetermined orientation, the decision function 168 acquires image processing content for the second view mode (step S114).

[0058] Next, the image generating function 170 generates a B-mode image based on the B-mode data, and executes image processing such as standard image quality adjustment (step S116). In addition, when or after executing the image processing of step S116, the image generating function 170 executes image processing such as brightness adjustment based on the image processing content acquired in the processing of step S112 or step S114 to generate an image for display (step S118). Next, the display control function 172 causes the display 150 to display the generated image for display (step S120). This ends the processing of this flowchart. Note that in the above-mentioned processing, the processing of step S118 may be executed before the image processing of step S116. Also, the processing shown in FIG. 9 is executed continuously during scanning.

[0059] According to the first embodiment described above, it is possible to perform more appropriate image quality adjustment for an ultrasound image. Specifically, according to the first embodiment, for example, it is possible to determine the orientation of a portion corresponding to the heart based on the distribution of signal brightness levels using B-mode image data, and to optimize an image for display by performing brightness adjustment according to the determined orientation. Also, according to the first embodiment, it is possible to provide an ultrasound diagnostic device with high automatic signal brightness adjustment capability.

[0060] Second embodiment The ultrasonic diagnostic device in the second embodiment will be described below. FIG. 10 is a configuration diagram of an ultrasonic diagnostic system 1A including an ultrasonic diagnostic device 100A of the second embodiment. The same reference numerals are used for components common to the ultrasonic diagnostic system 1 of the first embodiment, and the description thereof will be omitted. The ultrasonic diagnostic device 100A includes, for example, an ultrasonic transmission circuit 110, an ultrasonic reception circuit 112, a signal processing circuit 120, a communication interface 130, an input interface 140, a display 150, a processing circuit 160A, and a memory circuit 180A. The processing circuit 160A includes an acquisition function 162, an analysis function 164, a decision function 168A, an image generation function 170, a display control function 172, and a learning function 174. For example, an image processing content setting table 184, a trained model 186, a program, and other information are stored in the memory circuit 180A. The ultrasonic diagnostic device 100A of the second embodiment differs from the ultrasonic diagnostic device 100 of the first embodiment in that the processing circuitry 160A includes a learning function 174 instead of the analysis function 164 and the determination function 166, and in that the storage circuitry 180A includes a trained model 186 instead of the orientation determination table 182. The following description will mainly focus on the above differences.

[0061] The learning function 174 generates a trained model 186 that has been trained to output information indicating the orientation of the heart in an image contained in the B-mode image data when B-mode image data is input. For example, the learning function 174 uses, for example, an AI (Artificial Intelligence) function to learn the relationship between B-mode image data collected when an area including a part corresponding to the heart was previously scanned by ultrasound and information indicating the orientation of the heart based on the B-mode image data, thereby generating a trained model 186 that outputs the orientation of the heart in an image relative to the input B-mode image data as a determination result. In addition, the learning function 174 may perform machine learning to realize a function of determining the similarity between B-mode image data collected when an area including a part corresponding to the heart was previously scanned by ultrasound and B-mode image data when the orientation of the heart in the image is a predetermined orientation. In the following description, the learning function 174 is described as being configured to generate the trained model 186.

[0062] FIG. 11 is a diagram showing an example of a method for generating a trained model 186 in the learning function 174 according to the second embodiment. The trained model 186 is a trained model that has been trained to output information indicating the orientation of the heart in an image included in the input B-mode image data when B-mode image data is input using a technique such as CNN (Convolutional Neural Network) or DNN (Deep Neural Network). CNN is a neural network in which several layers such as a convolution layer and a pooling layer are connected. DNN is a neural network in which layers of any form are connected in a multi-layered manner. The trained model 186 is generated by machine learning using a machine learning model LM by a calculation device (not shown), for example. When generating the trained model 186 by machine learning, the calculation device (not shown) inputs the B-mode image data and the judgment result for this B-mode image data to the machine learning model LM. The machine learning model LM is a model in the form of, for example, CNN or DNN, in which parameters are provisionally set.

[0063] The example of FIG. 11 shows a schematic state in which B-mode image data for each orientation of the heart is input to the machine learning model LM. A calculation device (not shown) adjusts parameters of the machine learning model LM so that the output of the machine learning model LM when B-mode image data in which the orientation of the heart in the image is specified is input to the machine learning model LM approaches the orientation of the heart in the input B-mode image data. As a method for adjusting parameters, for example, a backpropagation method (error backpropagation method) or the like is used. The machine learning model LM whose parameters have been adjusted by a calculation device (not shown) becomes a trained model 186.

[0064] The trained model 186 is not limited to one generated by learning using techniques such as CNN and DNN, etc. For example, the trained model 186 may be one generated using any machine learning technique such as a gradient method such as SGD (Stochastic Gradient Descent), Momentum SGD, AdaGrad, RMSprop, AdaDelta, Adam (Adaptive moment estimation), logistic regression analysis, or a technique based on a support vector machine.

[0065] When B-mode image data is input, the trained model 186 determines the similarity with the B-mode image data for each orientation of the heart in the image, and outputs information on the orientation of the heart with the highest similarity as the determination result.

[0066] The determination function 168A uses the trained model 186 trained by the learning function 174 to determine the orientation of the heart with respect to the B-mode image data acquired by the acquisition function 162. Furthermore, the determination function 168A refers to the orientation of the heart in the image in the image processing content setting table 184 based on the information of the orientation of the heart determined by the trained model 186, and acquires image processing content associated with the matching orientation. Furthermore, the determination function 168A causes the image generation function 170 to execute processing based on the acquired image processing content.

[0067] The learning function 174 may generate a trained model trained to output a determination result as to whether or not the heart in the image is in a predetermined orientation (e.g., vertical orientation) instead of the trained model 186 trained to output information indicating the orientation of the heart in the image included in the B-mode image data when B-mode image data is input. In this case, the determination function 168A uses the trained model to refer to the orientation of the heart in the image in the image processing content setting table 184 when the orientation of the heart with respect to the B-mode image data is a predetermined orientation, and obtains image processing content associated with the matching orientation. This allows more appropriate image processing to be performed when the heart in the image is in a predetermined orientation.

[0068] Furthermore, the learning function 174 may generate a trained model trained to output a determination result of the orientation of the heart in an image included in the B-mode image data when B-mode data is input instead of the B-mode image data. In this case, the acquisition function 162 acquires the B-mode data from the signal processing circuit 120. Then, the determination function 168A uses the trained model to determine the orientation of the heart relative to the B-mode data.

[0069] In the second embodiment, the learning function 174 may not be included in the ultrasound diagnostic device 100A. In this case, the acquisition function 162 acquires the trained model 186 from an external device provided with the learning function 174 or an external device that manages the trained model 186, and stores it in the memory circuitry 180. In addition, when the trained model 186 is not stored in the memory circuitry 180, the determination function 168A may transmit B-mode image data to an external device equipped with the trained model 186, and receive information on the orientation of the heart in the image included in the B-mode image data from the external device.

[0070] Fig. 12 is a flowchart showing an example of the flow of processing executed by the processing circuit 160A of the second embodiment. The processing executed by the processing circuit 160A of the second embodiment differs from the processing of steps S100 to S120 executed by the processing circuit 160 of the first embodiment in that the processing of step S200 is executed instead of the processing of steps S106 and S108. The following mainly focuses on the above difference. In the example of Fig. 12, it is assumed that the learned model 186 has already been generated by the learning function 174.

[0071] 12, when it is determined that the acquired scan mode is the first scan mode, the determination function 168A determines the orientation of the heart included in the B-mode image data based on the trained model 186 (step S200). Next, the determination function 168A determines whether the determined orientation of the heart is a predetermined orientation (step S110).

[0072] According to the second embodiment described above, in addition to achieving the same effects as the first embodiment, by using the trained model 186, it is possible to determine the orientation of the heart in the image contained in the B-mode image data without performing analysis based on the distribution of brightness levels.

[0073] The above-described embodiment can be expressed as follows. A memory for storing programs; a processor; The processor executes the program, Acquire an ultrasound image including a portion corresponding to the subject's heart; The ultrasound image includes image data in which an ultrasound wave is transmitted to a scan region within the subject, and a signal intensity of a reflected wave reflected within the subject is represented by a luminance; performing an analysis based on a distribution of luminance levels of the image data; determining image processing content for the ultrasound image based on the analyzed information; making a degree of image processing for an area corresponding to the apex of the heart included in the ultrasound image different from a degree of image processing for an area other than the area corresponding to the apex of the heart; The ultrasound diagnostic device is configured as follows.

[0074] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention.

[0075] For example, in the first or second embodiment described above, instead of the second scan mode for scanning a portion corresponding to a part other than the heart, there may be a plurality of scan modes subdivided for each part of the subject (part other than the heart). Also, in the first or second embodiment, three or more view modes may be present according to the orientation of the heart in the image. In this case, the image processing contents in each view mode according to the orientation of the heart in the image are stored in the image processing contents setting table 184. The decision function 168 (168A) causes the image generation function 170 to execute image processing based on the image processing contents acquired by referring to the image processing contents setting table 184.

[0076] In the first or second embodiment described above, the image processing associated with the first view mode is executed in the portrait orientation, but instead, the image processing associated with the first view mode may be executed according to another specific orientation. In the first or second embodiment described above, a part or all of the processing in the signal processing circuit 120 may be included in the image generating function 170, and a part or all of the processing in the image generating function 170 may be included in the signal processing circuit 120. For example, the image generating function 170 may generate B-mode data or B-mode image data. In addition, the signal processing circuit 120 may generate a B-mode image or a display image. [Explanation of symbols]

[0077] 1, 1A...ultrasonic diagnostic system, 10...ultrasonic probe, 20...external device, 100, 100A...ultrasonic diagnostic device, 110...ultrasonic transmission circuit, 112...ultrasonic reception circuit, 120...signal processing circuit, 130...communication interface, 140...input interface, 150...display, 160, 160A...processing circuit, 162...acquisition function, 164...analysis function, 166...judgment function, 168, 168A...decision function, 170...image generation function, 172...display control function, 174...learning function, 180, 180A...memory circuit

Claims

1. an acquisition unit for acquiring an ultrasound image including a portion corresponding to a heart of a subject; The ultrasound image includes image data in which an ultrasound wave is transmitted to a scan region within the subject, and a signal intensity of a reflected wave reflected within the subject is represented by a luminance; an analysis unit that performs an analysis based on a distribution of luminance levels of the image data; a determination unit that determines image processing content for the ultrasound image based on the information analyzed by the analysis unit, the determination unit divides the ultrasound image into a first area corresponding to the apex of the heart and a second area outside the first area, and subjects the first area and the second area to different degrees of image processing. Ultrasound diagnostic equipment.

2. the analysis unit acquires edge information based on a distribution of luminance levels of the image data, and predicts the first area from a contour shape based on the acquired edge information. The ultrasonic diagnostic apparatus according to claim 1 .

3. and an image generating unit that performs image processing near the boundary of the first area based on the image processing content determined by the determining unit, and generates an ultrasound image in which the degree of the image processing is gradually changed from outside the first area toward inside the first area. The ultrasonic diagnostic apparatus according to claim 1 .

4. The analysis unit generates feature information based on a distribution of luminance levels of the image data. The ultrasonic diagnostic apparatus according to claim 1 .

5. The ultrasound image is a B-mode image. The ultrasonic diagnostic apparatus according to claim 4.

6. Ultrasound diagnostic equipment, Acquire an ultrasound image including a portion of the subject's heart; The ultrasound image includes image data in which an ultrasound wave is transmitted to a scan region within the subject, and a signal intensity of a reflected wave reflected within the subject is represented by a luminance; performing an analysis based on a distribution of luminance levels of the image data; determining image processing content for the ultrasound image based on the analyzed information; dividing the ultrasonic image into a first area corresponding to the apex of the heart and a second area outside the first area, and differentiating the degree of image processing between the first area and the second area; program.

Images