Ultrasonic diagnosis device, medical image processing device, and medical image processing program

Abstract

To enhance visibility of a biological structure in a medical image.SOLUTION: An ultrasonic diagnosis device includes: a multiple resolution decomposition unit which generates a plurality of pieces of low frequency data and high frequency data corresponding to a plurality of gradual resolutions from ultrasonic data; an extraction unit which extracts negative high frequency data across a prescribed resolution among the plurality of gradual resolutions from the plurality of pieces of high frequency data; a multiple resolution restoring unit which restores a resolution of first addition data obtained by adding resolutions of the negative high frequency data across the prescribed resolutions while matching the resolution to the same resolution as the resolution before reduction of the ultrasonic data; a synthesizing unit which generates a synthesized image on the basis of the restored first addition data and the ultrasonic data; and a display unit which displays the synthesized image.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The embodiments disclosed in this specification and the drawings relate to an ultrasound diagnostic apparatus, a medical image processing apparatus, and a medical image processing program. [Background technology]

[0002] Conventionally, ultrasonic images may contain virtual images (artifacts) such as multiplexing and side lobes along with biological information. These virtual images are an obstacle when diagnosing biological structures and properties. For this reason, it is desirable to suppress the occurrence of virtual images and suppress their display. Conventionally, display suppression has been performed by manipulating the dynamic range and changing the color map. This utilizes the fact that in most ultrasonic data, virtual images have a different signal intensity (often low) from biological information, and improves the visibility of biological information by highlighting the difference between the signal intensity of the biological information and the signal intensity of the virtual image.

[0003] Conventional methods for suppressing virtual images involve changing display settings. For this reason, unless the display settings are appropriately set each time according to the characteristics of the acquired ultrasound data, it is difficult to obtain an appropriate effect of suppressing virtual images. In addition, depending on the characteristics of the ultrasound data, the signal strength of the biological information and the signal strength of the virtual image may overlap greatly, making it difficult to improve visibility by emphasizing the difference in signal strength. Another method for improving visibility is to improve contrast using technology related to transmit aperture synthesis. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-118715 A Summary of the Invention [Problem to be solved by the invention]

[0005] One of the problems to be solved by the embodiments disclosed in this specification and the drawings is to improve the visibility of biological structures in medical images. However, the problems to be solved by the embodiments disclosed in this specification and the drawings are not limited to the above problem. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems. [Means for solving the problem]

[0006] The ultrasound diagnostic device according to the present embodiment includes a multi-resolution decomposition unit, an extraction unit, a multi-resolution restoration unit, and a display unit. The multi-resolution decomposition unit generates a plurality of low-frequency data and high-frequency data corresponding to a plurality of stepwise resolutions from ultrasound data. The extraction unit extracts negative high-frequency data from the plurality of high-frequency data across a predetermined resolution. The multi-resolution restoration unit restores the resolution of first sum data obtained by adding the negative high-frequency data together across the predetermined resolution to the same resolution as the resolution of the ultrasound data before reduction. The synthesis unit generates a synthetic image based on the restored first sum data and the ultrasound data. The display unit displays the synthetic image. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing an example of the arrangement of an ultrasonic diagnostic apparatus according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of multi-resolution decomposition according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing an example of various data corresponding to a plurality of hierarchical layers according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a process using a Laplacian pyramid, which is an example of multi-resolution decomposition for generating high-frequency data, in the process executed by the extraction function according to the first embodiment. [Diagram 5] FIG. 5 is a diagram showing an example of extracting fifth negative high frequency data based on fifth reduced data and sixth reduced data in the sixth layer and the fifth layer according to the first embodiment. [Figure 6] FIG. 6 is a diagram showing an example of extracting fifth negative high frequency data from fifth high frequency data calculated from fifth reduced data and enlarged sixth reduced data according to the first embodiment; [Figure 7] FIG. 7 is a diagram showing an example of processing by a restoration function according to the first embodiment. [Figure 8] 8 is a diagram showing an example of an image related to the processing shown in FIG. 7 according to the first embodiment. [Figure 9] FIG. 9 is a diagram showing an example of processing related to a weighting function, a synthesis function, and a luminance correction function according to the first embodiment. [Figure 10] FIG. 10 is a flowchart showing an example of a procedure of a contrast improvement process according to the first embodiment. [Figure 11] FIG. 11 is a view showing an example of a comparison between use and non-use of the contrast improvement process according to the first embodiment. [Figure 12] FIG. 12 is a diagram showing an example of the effect of contrast improvement processing according to the first embodiment. [Figure 13] FIG. 13 is a diagram showing an example in which a second weight is assigned to negative high frequency data depending on a hierarchy according to a first application example of the first embodiment. [Figure 14] FIG. 14 is a diagram showing an example of processing in which positive restored data is generated based on positive high-frequency data extracted by the extraction function according to the second application example of the first embodiment; [Figure 15] FIG. 15 is a diagram showing an example of processing related to a weighting function, a synthesis function, and a luminance correction function according to a second application example of the first embodiment. [Figure 16] FIG. 16 is a diagram showing an example in which a fourth weight is assigned to negative high frequency data depending on a hierarchy according to a third application example of the first embodiment. [Figure 17] FIG. 17 is a diagram showing an example of the configuration of a medical image processing apparatus according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an ultrasonic diagnostic device, a medical image processing device, and a medical image processing program according to the present embodiment will be described with reference to the drawings. For the sake of specificity, an ultrasonic diagnostic device will be taken as an example in the first embodiment. In the following embodiments, parts with the same reference numerals perform the same operations, and duplicated descriptions will be omitted as appropriate.

[0009] (First embodiment) 1 is a diagram showing an example of the configuration of an ultrasonic diagnostic device 1 according to this embodiment. As shown in FIG 1, the ultrasonic diagnostic device 1 has an ultrasonic probe 11, an input interface 13, a display 15, and a device main body 19.

[0010] The ultrasonic probe 11 includes a plurality of piezoelectric transducers, a matching layer provided on the ultrasonic wave emitting surface side of the piezoelectric transducers, and a backing material provided on the rear side of the piezoelectric transducers to prevent the propagation of ultrasonic waves backward from the piezoelectric transducers. Each of the plurality of piezoelectric transducers generates ultrasonic waves in response to a drive signal supplied from a transmission / reception circuit 23 described later. The ultrasonic probe 11 is a one-dimensional array probe detachably connected to the device body 7. The plurality of piezoelectric transducers generate ultrasonic waves based on a drive signal supplied from an ultrasonic transmission circuit 71 in the device body 7. The ultrasonic probe 11 may be provided with a button to be pressed during a freeze operation or the like.

[0011] When ultrasonic waves are transmitted from the ultrasonic probe 11 to the subject P, the transmitted ultrasonic waves are reflected one after another by discontinuous surfaces of acoustic impedance in the internal tissues of the subject P. The reflected ultrasonic waves are received as reflected wave signals (hereinafter referred to as echo signals) by a plurality of piezoelectric transducers of the ultrasonic probe 11. The amplitude of the received echo signal depends on the difference in acoustic impedance at the discontinuous surface where the ultrasonic waves are reflected. When the transmitted ultrasonic pulse is reflected by the surface of a moving blood flow or a heart wall, the echo signal undergoes a frequency shift due to the Doppler effect depending on the velocity component of the moving object in the ultrasonic transmission direction. The ultrasonic probe 11 receives the echo signal from the subject P and converts it into an electrical signal.

[0012] The input interface 13 takes in various instructions, commands, information, selections, and settings from the operator into the ultrasonic diagnostic device 1. The input interface 13 is realized by a trackball, a switch button, a mouse, a keyboard, a touch pad that performs input operations by touching the operation surface, and a touch panel display in which a display screen and a touch pad are integrated, etc. The input interface 13 converts the input operation received from the operator into an electric signal. Note that in this specification, the input interface 13 is not limited to an interface having physical operation parts such as a mouse and a keyboard. For example, an example of the input interface 13 includes an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the ultrasonic diagnostic device 1 and outputs the received electric signal to the device main body 19. The input interface 13 corresponds to an input unit.

[0013] The display 15 may be, for example, a liquid crystal display (LCD), a cathode ray tube (CRT) display, an organic electroluminescence display (OELD), a plasma display, or any other arbitrary display. The display 15 may be incorporated in the device body 7. The display 15 may be a desktop type, or may be configured as a tablet terminal or the like capable of wireless communication with the device body 7. The display 15 corresponds to a display unit.

[0014] The display 15 displays various images generated by an image generating circuit 29 (described later) and the like. The display 15 has a display circuit that realizes the display of various images. The display 15 also displays a Graphical User Interface (GUI) that allows the operator to input various setting requests. Note that multiple displays may be connected to the device body 19 of the ultrasonic diagnostic device 1.

[0015] The device main body 19 has a transmission / reception circuit (transmission / reception section) 23, a B-mode data generation circuit (B-mode data generation section) 25, a Doppler data generation circuit (Doppler data generation section) 27, an image generation circuit (image generation section) 29, a communication interface 31, a memory (storage section) 33, a control circuit (control section) 35, and a processing circuit (processing section) 37.

[0016] The transmission / reception circuit 23 has a pulse generator, a transmission delay circuit, and a pulser circuit, and supplies a drive signal to each of the piezoelectric transducers in the ultrasonic probe 11. The pulse generator repeatedly generates a rate pulse for forming a transmission ultrasonic wave at a predetermined rate frequency fr (Hz) (period: 1 / fr second). The transmission delay circuit provides each rate pulse with a delay time required to converge the transmission ultrasonic wave into a beam and determine the transmission directivity. The pulser circuit applies a voltage pulse as a drive signal to each piezoelectric transducer of the ultrasonic probe 11 at a timing based on the rate pulse. As a result, an ultrasonic beam is transmitted to the subject P.

[0017] The transmission / reception circuit 23 further includes a preamplifier, an analog-to-digital (hereinafter referred to as A / D) converter, a reception delay circuit, and an adder. The transmission / reception circuit 23 generates a reception signal based on the reception echo signal generated by each piezoelectric transducer. The preamplifier amplifies the echo signal from the subject P captured via the ultrasonic probe 11 for each channel. The A / D converter converts the amplified reception echo signal into a digital signal. The reception delay circuit provides the reception echo signal converted into a digital signal with a delay time required to determine reception directivity. The adder adds multiple echo signals to which a delay time has been applied. By this addition, the transmission / reception circuit 23 generates a reception signal in which the reflection component from the direction corresponding to the reception directivity is emphasized. By this transmission directivity and reception directivity, The overall directivity of the ultrasonic transmission and reception is determined. This overall directivity determines the ultrasonic beam (so-called "ultrasonic scan line").

[0018] The B-mode data generation circuit 25 has an envelope detector and a logarithmic converter, and generates B-mode data based on the received signal. The envelope detector performs envelope detection on the received signal. The logarithmic converter performs logarithmic conversion on the envelope-detected signal, and relatively emphasizes weak signals in the envelope-detected signal. The B-mode data generation circuit 25 generates signal values ​​(referred to as B-mode data) for each depth in each scanning line based on the signals emphasized by the logarithmic converter.

[0019] The Doppler data generating circuit 27 has a mixer, a low pass filter (hereinafter referred to as LPF), etc., and generates Doppler data based on the received signal. The mixer multiplies the received signal by a reference signal having a frequency f0 of the transmitted ultrasound, and generates a signal having a Doppler shift frequency fd component and a signal having a frequency component of (2f0+fd). The LPF removes the high frequency component (2f0+fd) signal from the signal output from the mixer. In this way, the Doppler data generating circuit 27 generates Doppler data having a Doppler shift frequency fd component from the received signal. The Doppler data generating circuit 27 may generate dynamic information such as blood flow velocity, dispersion, power, etc. (for example, data related to a color Doppler image, data related to a power Doppler image) as Doppler data by executing Doppler processing including frequency analysis.

[0020] The image generating circuit 29 has a digital scan converter (hereinafter referred to as DSC), an image memory, and the like, neither of which are shown. The DSC converts the scan line signal sequence of the ultrasound scan, which is made up of B-mode data and Doppler data, into a scan line signal sequence in a video format (scan conversion). The image generating circuit 29 synthesizes text information of various parameters, scales, and the like, with the scan-converted B-mode data and Doppler data to generate ultrasound image data. The ultrasound image data is data for display. The ultrasound image is an example of a medical image. The ultrasound image data is also an example of medical data. Meanwhile, the B-mode data, volume data, and Doppler data are also called raw data (also called raw data). Hereinafter, the ultrasound image and raw data are collectively called ultrasound data. For example, the ultrasound data is at least one of data related to a B-mode image, raw data related to a B-mode image, and data related to a power Doppler image. The image memory stores a plurality of ultrasound images (hereinafter referred to as ultrasound video images) corresponding to a series of frames immediately before the input of a freeze operation. The ultrasound images stored in the image memory are used for cine display.

[0021] The communication interface 31 is connected to an external device such as a medical image storage device via a network, and transfers various data output from the image generating circuit 29, the processing circuit 37, etc. to the external device.

[0022] The memory 33 is composed of an HDD (hard disk drive), an SSD (solid state drive), a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), a semiconductor memory, etc. The memory 33 stores programs related to ultrasonic transmission and reception, programs corresponding to various processes executed by the control circuit 35 and the processing circuit 37, etc. The memory 33 stores raw data, ultrasonic image data, various data generated and processed by the processing circuit 37, etc.

[0023] The control circuit 35 includes, for example, a processor and a memory as hardware resources. The control circuit 35 functions as the core of the ultrasonic diagnostic apparatus 1. Specifically, the control circuit 35 reads out a control program stored in the memory 33, loads it on the memory, and controls various units of the ultrasonic diagnostic apparatus 1 according to the loaded control program.

[0024] The processing circuit 37 includes, for example, a processor and a memory as hardware resources. Specifically, the processing circuit 37 reads out a program stored in the memory 33, expands the program on the memory, and realizes various functions according to the expanded program. The processing circuit 37 has a multi-resolution decomposition function 371, an extraction function 373, a multi-resolution restoration function 375, a weighting function 377, a synthesis function 379, and a luminance correction function 381. The processing circuit 37 that realizes the multi-resolution decomposition function 371, the extraction function 373, the multi-resolution restoration function 375, the weighting function 377, the synthesis function 379, and the luminance correction function 381 corresponds to the multi-resolution decomposition unit, the extraction unit, the multi-resolution restoration unit, the weighting unit, the synthesis unit, and the luminance correction unit, respectively.

[0025] For example, when raw data (B-mode data) of a B-mode image related to B mode is acquired by the B-mode data generation circuit 25, the processing circuit 37 executes contrast improvement processing by a multi-resolution decomposition function 371, an extraction function 373, a multi-resolution restoration function 375, a weighting function 377, a synthesis function 379, and a brightness correction function 381. The B-mode data is a B-mode image before a B-mode image as a display image is generated, that is, before scan conversion. The contrast improvement processing is, for example, a process of acquiring structural information of a living body in the ultrasound data by performing a multi-resolution analysis on the ultrasound data, and suppressing the signal intensity in the virtual image region by treating a region spatially excluding the living body structure as a virtual image region. Hereinafter, for the sake of concrete explanation, the contrast improvement processing will be described as using B-mode data, i.e., raw data, as the ultrasound data. Note that the contrast improvement processing may use various ultrasound images after scan conversion as the ultrasound data.

[0026] The processing circuitry 37 generates a plurality of low-frequency data and a plurality of high-frequency data corresponding to a plurality of gradual resolutions from the ultrasound data by a multi-resolution decomposition function 371. The plurality of gradual resolutions correspond to a plurality of hierarchical layers. The multi-resolution decomposition performed by the multi-resolution decomposition function 371 will be described below with reference to Figs. 2 and 4.

[0027] FIG. 2 is a diagram showing processing by Gaussian pyramid, which is an example of multi-resolution decomposition for generating low-frequency data. An original image OI shown in FIG. 2 corresponds to raw data of a B-mode image. For example, if the number of vertical pixels and the number of horizontal pixels in the original image are greater than a predetermined number of pixels, the multi-resolution decomposition function 371 executes a resizing process RS on the original image OI to generate a resized image RI. The number of vertical pixels x the number of horizontal pixels in the resized image RI is, for example, 512 x 256. Note that if the number of vertical pixels and the number of horizontal pixels in the original image are equal to a predetermined number of pixels, the resizing process RS is unnecessary.

[0028] The multiple hierarchies PR in Fig. 2 are six hierarchies with multiple image sizes smaller than the image size of the resized image RI, i.e., six hierarchies with lower resolution than the original image OI and different resolutions. The number of multiple hierarchies is set in advance. The number of multiple hierarchies may be set by the user via the input interface 13. The number of multiple hierarchies may also be input by the user as appropriate via the input interface 13 by adjustment, change, etc.

[0029] The multi-resolution decomposition function 371 executes a first Gaussian reduction GSD1 on the resized image RI to generate first reduced data RD1 with an image size of 256 x 128, which is half the number of vertical and horizontal pixels. Here, Gaussian reduction means image reduction processing using a Gaussian filter. The size of the first reduced data RD1 is 1 / 4 of the resized image RI, and belongs to the first hierarchical level in which the resized image RI is reduced to a low resolution.

[0030] The multi-resolution decomposition function 371 executes a second Gaussian reduction GSD2 on the first reduced data RD1 to generate second reduced data RD2 with an image size of 128 x 64, which is half the number of vertical and horizontal pixels. The size of the second reduced data RD2 is 1 / 4 of the first reduced data RD1. The second reduced data RD2 belongs to the second hierarchical level, which is the first reduced data RD1 reduced to a lower resolution.

[0031] The multi-resolution decomposition function 371 executes a third Gaussian reduction GSD3 on the second reduced data RD2 to generate third reduced data RD3 with an image size of 64 x 32, which is half the number of vertical and horizontal pixels. The size of the third reduced data RD3 is 1 / 4 of the second reduced data RD2. The third reduced data RD3 belongs to the third hierarchical level, which is the second reduced data RD2 reduced to a lower resolution.

[0032] The multi-resolution decomposition function 371 executes a fourth Gaussian reduction GSD4 on the third reduced data RD3 to generate fourth reduced data RD4 with an image size of 32 x 16, where the number of vertical and horizontal pixels is half. The size of the fourth reduced data RD4 is 1 / 4 of the third reduced data RD3. The fourth reduced data RD4 belongs to the fourth hierarchical level, which is the third reduced data RD3 reduced to a lower resolution.

[0033] The multi-resolution decomposition function 371 performs a fifth Gaussian reduction GSD5 on the fourth reduced data RD4 to generate fifth reduced data RD5 with an image size of 16 x 8, which is half the number of vertical and horizontal pixels. The size of the fifth reduced data RD5 is 1 / 4 of the fourth reduced data RD4. The fifth reduced data RD5 belongs to the fifth hierarchical level, which is the fourth reduced data RD4 reduced to a lower resolution.

[0034] The multi-resolution decomposition function 371 performs a sixth Gaussian reduction GSD6 on the fifth reduced data RD5 to generate sixth reduced data RD6 with an image size of 8 x 4, which is half the number of vertical and horizontal pixels. The size of the sixth reduced data RD6 is 1 / 4 of the fifth reduced data RD5. The sixth reduced data RD6 belongs to the sixth hierarchical level, which is the fifth reduced data RD5 reduced to a lower resolution.

[0035] 3 is a diagram showing an example of an original image OI, a first reduced data RD1, a second reduced data RD2, a third reduced data RD3, a fourth reduced data RD4, a fifth reduced data RD5, and a sixth reduced data RD6. As shown in FIG. 3, the reduced data has a lower resolution depending on the hierarchical level.

[0036] Fig. 4 explains a process using a Laplacian pyramid, which is an example of multi-resolution decomposition for generating high-frequency data. Fig. 4 is a diagram showing an example of a process executed by the multi-resolution decomposition function 371. The process using the Laplacian pyramid in Fig. 4 is an example for obtaining high-frequency data of each layer in the multi-resolution decomposition, and is not limited to the above process. For example, high-frequency data obtained when performing multi-resolution decomposition using another method may be used.

[0037] In FIG. 4, when the sixth and fifth hierarchical layers are taken as two adjacent layers, the reduced data belonging to the higher layer among the two adjacent layers PR (hereinafter referred to as the higher layer data) corresponds to the fifth reduced data RD5, and the reduced data belonging to the lower layer among the two adjacent layers PR (hereinafter referred to as the lower layer data) corresponds to the sixth reduced data RD6. At this time, the multi-resolution decomposition function 371 executes the sixth Gaussian enlargement GSE6 corresponding to the inverse process of the sixth Gaussian reduction GSD6 on the sixth reduced data RD6, and enlarges the sixth reduced data RD6 to an image size (16×8) corresponding to the fifth layer. Here, Gaussian enlargement means an image enlargement process using a Gaussian filter. The data obtained by enlarging the sixth reduced data RD6 corresponds to the enlarged data. The multi-resolution decomposition function 371 generates the fifth high-frequency data DD5 having an image size of 16×8 by subtracting (SU5) the enlarged sixth reduced data (enlarged data) from the fifth reduced data RD5.

[0038] In FIG. 4, when the fifth layer and the fourth layer are considered as two adjacent layers, the high layer data corresponds to the fourth reduced data RD4, and the low layer data corresponds to the fifth reduced data RD5. At this time, the multi-resolution decomposition function 371 executes the fifth Gaussian enlargement GSE5, which corresponds to the inverse process of the fifth Gaussian reduction GSD5, on the fifth reduced data RD5, and enlarges the fifth reduced data RD5 to an image size (32×16) corresponding to the fourth layer. The data obtained by enlarging the fifth reduced data RD5 corresponds to the enlarged data. The multi-resolution decomposition function 371 generates the fourth high frequency data DD4 having an image size of 32×16 by subtracting (SU4) the enlarged fifth reduced data (enlarged data) from the fourth reduced data RD4.

[0039] In FIG. 4, when the fourth layer and the third layer are considered as two adjacent layers, the high layer data corresponds to the third reduced data RD3, and the low layer data corresponds to the fourth reduced data RD4. At this time, the multi-resolution decomposition function 371 executes the fourth Gaussian expansion GSE4 corresponding to the inverse process of the fourth Gaussian reduction GSD4 on the fourth reduced data RD4, and enlarges the fourth reduced data RD4 to an image size (64×32) corresponding to the third layer. The data obtained by enlarging the fourth reduced data RD4 corresponds to the enlarged data. The multi-resolution decomposition function 371 generates the third high frequency data DD3 having an image size of 64×32 by subtracting (SU3) the enlarged fourth reduced data (enlarged data) from the third reduced data RD3.

[0040] 2 and 4 are merely examples, and the processing by the multi-resolution decomposition function 371 is not limited to the above processing. For example, the multi-resolution decomposition may be performed based on other methods or numbers of pixels. The multi-resolution decomposition function 371 stores the generated multiple low-frequency data and multiple high-frequency data in the memory 33.

[0041] The processing circuit 37 extracts negative high-frequency data, also called negative edges, from the high-frequency data over a predetermined resolution, in other words, from the lowest resolution layer to a predetermined layer, by the extraction function 373. The negative high-frequency data corresponds to data having negative luminance values ​​(negative values) in the high-frequency data. For example, the extraction function 373 extracts negative high-frequency data from the high-frequency data by replacing positive luminance values ​​in the high-frequency data with 0.

[0042] Specifically, as shown in FIG. 4, the extraction function 373 extracts negative high-frequency data from the high-frequency data as structural information from the fifth layer to the third layer. The high-frequency data corresponds to data indicating the structure in the ultrasound data. For this reason, the extraction function 373 may be referred to as a structural information extraction function. In this case, the processing circuit 37 that realizes the structural information extraction function corresponds to a structural information extraction unit. The negative high-frequency data corresponds to structural data indicating a relatively low brightness value among the structures. Furthermore, the negative high-frequency data in the low layer corresponds to data indicating a relatively low brightness area of ​​the ultrasound data due to its low resolution.

[0043] FIG. 5 is a diagram showing an example of extracting the fifth negative high-frequency data ND5 based on the fifth reduced data RD5 and the enlarged sixth reduced data ERD6 in the sixth and fifth layers. FIG. 6 is a diagram showing an example of extracting the fifth negative high-frequency data ND5 from the fifth high-frequency data DD5 calculated from the fifth reduced data RD5 and the enlarged sixth reduced data ERD6. As shown in FIG. 4 to FIG. 6, the extraction function 373 extracts the fifth negative high-frequency data ND5 from the fifth high-frequency data DD5. Similarly, the extraction function 373 extracts the fourth negative high-frequency data ND4 from the fourth high-frequency data DD4, and extracts the third negative high-frequency data ND3 from the third high-frequency data DD3.

[0044] The processing circuit 37 uses the multi-resolution restoration function 375 to adjust the resolution across a predetermined resolution, add multiple negative high-frequency data, and generate first added data. That is, the multi-resolution restoration function 375 adjusts the resolution across a predetermined hierarchy, adds multiple negative high-frequency data, and generates first added data. Next, the multi-resolution restoration function 375 restores the resolution of the first added data to the same resolution as the resolution before the ultrasound data is reduced. Hereinafter, the processing by the multi-resolution restoration function 375 will be described with reference to Figs. 7 and 8.

[0045] FIG. 7 is a diagram showing an example of processing by the multi-resolution restoration function 375. FIG. 8 is a diagram showing an example of an image related to the processing shown in FIG. 7. In FIG. 7, the predetermined layer corresponds to the third layer. As shown in FIG. 7, the multi-resolution restoration function 375 adds the fifth negative high-frequency data ND5 expanded by the fifth Gaussian expansion GSE5 and the fourth negative high-frequency data ND4. Next, the multi-resolution restoration function 375 expands the added negative high-frequency data by the fourth Gaussian expansion GSE4, and adds the expanded negative high-frequency data to the third negative high-frequency data ND3. As a result, the multi-resolution restoration function 375 generates the first addition data AD1 based on the third negative high-frequency data ND3, the fourth negative high-frequency data ND4, and the fifth negative high-frequency data ND5, as shown in FIG. 8.

[0046] 7 and 8, the multi-resolution restoration function 375 restores the resolution of the first addition data AD1 to the same resolution as the resolution of the ultrasound data (original image OI) before reduction by using multiple Gaussian enlargements AGSE. The resolution of the ultrasound data (original image OI) before reduction corresponds to the size (512×256) of the resized image RI in FIG. 2. The multiple Gaussian enlargements AGSE corresponding to restoration by the Gaussian pyramid correspond to a Gaussian enlargement that combines a third Gaussian enlargement corresponding to the inverse processing of the third Gaussian reduction GSD3, a second Gaussian enlargement corresponding to the inverse processing of the second Gaussian reduction GSD2, and a first Gaussian enlargement corresponding to the inverse processing of the first Gaussian reduction GSD1.

[0047] Specifically, the multi-resolution restoration function 375 sequentially performs the third Gaussian expansion, the second Gaussian expansion, and the first Gaussian expansion on the first addition data AD1 to generate the negative restoration data NRD shown in Fig. 8. The restoration data NRD is high-resolution data reflecting information on the negative high-frequency data ND5, ND4, and ND3 extracted by the extraction function 373, and as described above, ND5, ND4, and ND3 are negative high-frequency data on low hierarchical levels, and hold information indicating a relatively low-brightness area in the ultrasound data. In other words, the restoration data NRD is high-resolution data indicating a relatively low-brightness area in the ultrasound data.

[0048] The processing circuitry 37 uses a weighting function 377 to assign a first weight to the restored first sum data (negative restored data NRD) according to the contrast of the biological structure in the original image OI. The first weight is set, for example, as a positive value. The first weight can be input, set, and adjusted as appropriate by a user's instruction via the input interface 13. The first weight is set, for example, as a large value when an area within the cardiac cavity where low brightness is expected is to be emphasized on the composite image.

[0049] The processing circuit 37 generates a composite image based on the restored first sum data (negative restored data NRD) and the ultrasound data by the synthesis function 379. Specifically, the synthesis function 379 synthesizes the restored first sum data to which the first weight is applied with the ultrasound data to generate a composite image. As described above, the restored first sum data (negative restored data NRD) is data indicating a relatively low brightness area in the ultrasound data, and by synthesizing the data with the ultrasound data after applying the first weight, it is possible to suppress the low brightness area in the ultrasound data, for example, an area in the cardiac cavity where low brightness is expected, to a lower brightness on the synthetic image, and it is possible to enhance the contrast between the low brightness area and the high brightness area in the ultrasound data.

[0050] The processing circuitry 37 corrects the luminance of the composite image by the luminance correction function 381. Specifically, the luminance correction function 381 corrects the luminance of the composite image based on a first average luminance value related to the ultrasound data (original image OI) and a second average luminance value in the composite image. More specifically, the luminance correction function 381 corrects the luminance value of the composite image so as to bring the second average luminance value closer to the first average luminance value.

[0051] Hereinafter, the processing related to the weighting function 377, the composition function 379, and the brightness correction function 381 will be described with reference to FIG. 9. FIG. 9 is a diagram showing an example of the processing related to the weighting function 377, the composition function 379, and the brightness correction function 381. As shown in FIG. 9, the weighting function 377 assigns a first weight W1 to the negative restored data NRD. The composition function 379 executes a resizing process RS on the negative restored data to which the first weight W1 has been assigned. Through the resizing process, the image size of the negative restored data to which the first weight W1 has been assigned becomes the same as the image size of the original image OI. The composition function 379 combines the resized negative restored data with the original image OI to generate a composite image CI. The brightness correction function 381 executes brightness correction on the composite image CI. The composite image CI to which the brightness correction has been executed is displayed on the display 15.

[0052] The term "processor" used in the description of the control circuit 35 and the processing circuit 37 refers to a circuit such as a CPU (Central Processing Unit), a GPU (graphics processing unit), or an application specific integrated circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)).

[0053] The processor realizes various functions by reading and executing the programs stored in the memory 33. Instead of storing the various programs in the memory 33, the various programs may be directly incorporated into the circuitry of the processor in the control circuit 35 or the processing circuit 37. In this case, the processor realizes various functions by reading and executing the various programs incorporated into the circuitry. The functions executed by the processing circuit 37 may be incorporated in the control circuit 35. The functions executed by the control circuit 35 may be incorporated in the processing circuit 37.

[0054] The configuration of this embodiment has been described above. The procedure of the contrast improvement process will be described below with reference to FIG. 10. FIG. 10 is a flowchart showing an example of the procedure of the contrast improvement process. For the sake of specificity, it is assumed that the ultrasound data input to the contrast improvement process is a B-mode image.

[0055] (Contrast improvement processing) (Step S101) B-mode data is generated as ultrasound data by transmitting and receiving ultrasound to and from the subject P. Raw data such as B-mode data is used as an original image OI shown in FIG.

[0056] (Step S102) The multi-resolution decomposition function 371 executes a multi-resolution analysis on the original image OI, thereby generating a plurality of low-frequency data and a plurality of high-frequency data corresponding to a plurality of gradual resolutions (a plurality of layers) from the ultrasound data.

[0057] (Step S103) The extraction function 373 extracts negative high frequency data from each of the plurality of high frequency data up to a predetermined resolution.

[0058] (Step S104) The multi-resolution restoration function 375 adjusts the resolution over a predetermined resolution and adds a plurality of negative high-frequency data to generate the first added data AD1. The multi-resolution restoration function 375 restores the resolution of the first added data AD1 to the same resolution as the resolution of the ultrasound data (original image OI) before reduction. As a result, the multi-resolution restoration function 375 generates the negative restored data NRD.

[0059] (Step S105) The weighting function 377 assigns a first weight W1 to the negative restored data NRD according to the contrast of the biological structure in the original image OI. Note that the first weight W1 can be appropriately changed by a user's instruction for the composite image CI displayed on the display 15.

[0060] (Step S106) The synthesis function 379 synthesizes the negative reconstruction data to which the first weight W1 is applied and the ultrasound data to generate a synthetic image CI, which reduces artifacts in non-structural parts such as the heart cavity in the synthetic image CI.

[0061] (Step S107) The brightness correction function 381 corrects the brightness of the composite image CI. The image generation circuit 29 executes scan conversion on the composite image CI whose brightness has been corrected. The display 15 displays the scan-converted composite image CI. Note that when a B-mode image is used as the original image OI, the scan conversion in this step is not necessary.

[0062] According to the ultrasound diagnostic device 1 of the first embodiment described above, a plurality of low frequency data and a plurality of high frequency data corresponding to a plurality of stepped resolutions are generated from ultrasound data, negative high frequency data is extracted from the plurality of high frequency data across a predetermined resolution, the resolution of first added data obtained by combining and adding the negative high frequency data across the predetermined resolution is restored to the same resolution as the resolution of the ultrasound data before reduction, a composite image CI is generated based on the restored first added data and the ultrasound data, and the composite image CI is displayed.

[0063] That is, according to the ultrasonic diagnostic device 1, negative high-frequency data that is a negative edge is selectively extracted from low-resolution data obtained by multi-resolution decomposition, and multi-resolution restoration, weighting, and synthesis with ultrasonic data are performed, so that it is possible to selectively correct the brightness of a relatively low-brightness region, such as a heart chamber, among the rough structures of a living body in an ultrasonic image. FIG. 11 is a diagram showing an example of a comparison between the use and non-use of contrast improvement processing in the ultrasonic diagnostic device 1. The dotted line frame in FIG. 11 indicates the heart chamber region, and the solid line frame indicates the myocardial region (biological structure) to be observed. Low brightness is expected in the heart chamber region. When contrast improvement processing is not performed as shown in the NCP of FIG. 11, artifacts appear in the heart chamber region. On the other hand, when contrast improvement processing is performed as shown in the ECP of FIG. 11, the heart chamber region has low brightness and artifacts are suppressed. As shown in FIG. 11, according to the present ultrasound diagnostic device 1, the signal intensity of the virtual image in spatial areas other than the biological structure (e.g., the cardiac chamber area) can be suppressed, the signal intensity difference between the biological information in the ultrasound data and the virtual image can be increased, and the visibility of the biological information in the ultrasound image can be improved.

[0064] FIG. 12 is a diagram showing an example of the effect of the contrast improvement process. In the raw data RD of the B mode shown in FIG. 12, the septum region SR of the heart is indicated by a dotted frame, the heart wall region WR of the heart is indicated by a long dashed frame, and the heart cavity region CR of the heart is indicated by a solid frame. In the raw data RD, the histogram IH of the luminance values ​​before input to the contrast improvement process shows the histogram SRIH of the luminance values ​​in the septum region SR, the histogram WRIH of the luminance values ​​in the heart wall region WR, and the histogram CRIH of the luminance values ​​in the heart cavity region CR. In the raw data RD, the histogram OH of the luminance values ​​after output from the contrast improvement process shows the histogram SROH of the luminance values ​​in the septum region SR, the histogram WROH of the luminance values ​​in the heart wall region WR, and the histogram CROH of the luminance values ​​in the heart cavity region CR. The histogram SRIH, histogram SROH, histogram WRIH, and histogram WROH show biological information. Moreover, the histograms CRIH and CROH show artifacts in the cardiac cavity region.

[0065] As shown in histograms IH and OH in Fig. 12, the difference DOH between the peak value of the frequency of the luminance values ​​in histogram WROH and the peak value of the frequency of the luminance values ​​in histogram SROH is farther away than the difference DIH between the peak value of the frequency of the luminance values ​​in histogram WRIH and the peak value of the frequency of the luminance values ​​in histogram SRIH. That is, the peak value of the frequency of the luminance values ​​in histogram SROH is decreased from the peak value of the frequency of the luminance values ​​in histogram SRIH. As shown in histograms IH and OH in Fig. 12, the contrast improvement process reduces the luminance of artifacts and the like in the cardiac cavity region while maintaining the luminance of the biological structure. That is, due to this reduction SA of the peak value, the ratio of the artifacts (histogram CROH) to the biological information (histograms SROH and WRIH) is improved as shown in Fig. 12.

[0066] From these facts, it is possible to improve the visibility of the septum region SR and the heart wall region WR relative to the cardiac cavity region CR according to the ultrasonic diagnostic device 1. That is, according to the ultrasonic diagnostic device 1, contrast improvement processing is performed using spatial information of the ultrasonic data, so it is possible to improve the visibility of biological information of the ultrasonic data in which it is difficult to separate biological information from a virtual image using only signal intensity information.

[0067] Furthermore, according to the ultrasonic diagnostic device 1, contrast improvement processing can be performed on ultrasonic data acquired in real time, so that contrast improvement processing is performed according to the characteristics of the ultrasonic data. Therefore, according to the ultrasonic diagnostic device 1, it is not necessary to perform display settings for ultrasonic images every time ultrasonic data is acquired, and ultrasonic images with improved visibility of biological information in the ultrasonic images can be displayed, so that diagnostic throughput, operability, and diagnostic efficiency can be improved.

[0068] Moreover, according to the ultrasonic diagnostic device 1, a first weight W1 is assigned to the restored first sum data NRD according to the contrast of the structure, and the first sum data to which the first weight W1 is assigned is synthesized with the ultrasonic data to generate a synthetic image CI. At this time, the first weight W1 can be appropriately adjusted by a user's instruction via the input interface 13. As a result, according to the ultrasonic diagnostic device 1, the degree of artifact reduction by the contrast improvement process can be appropriately set according to the user's desire or default setting, and the synthetic image CI can be displayed on the display 15.

[0069] Furthermore, according to the ultrasonic diagnostic device 1, the luminance of the composite image CI is corrected based on the first average luminance value of the ultrasonic data and the second average luminance value of the composite image CI, and the luminance-corrected composite image CI is displayed. As a result, according to the ultrasonic diagnostic device 1, it is possible to reduce the darkening of the composite image CI due to the reduction in artifacts, and to display an ultrasonic image with improved visibility of biological information in the ultrasonic image.

[0070] (First application example) The first application example is to give weights (hereinafter referred to as second weights) to negative high-frequency data according to multiple hierarchical layers. For example, when the predetermined resolution is the maximum resolution, the extraction function 373 generates multiple negative high-frequency data corresponding to multiple resolutions based on high-frequency data of all stepwise resolutions related to the multi-resolution analysis. The multi-resolution restoration function 375 adds the negative high-frequency data to which the second weights have been given, adjusting the resolutions across the predetermined resolutions, to generate first added data. The technical idea regarding the generation of multiple high-frequency data and multiple negative high-frequency data is the same as that of the first embodiment, and therefore a detailed description will be omitted. In the following, for the sake of specificity, the predetermined resolution is the maximum resolution corresponding to the 0th hierarchical layer, and the hierarchical layer corresponding to the lowest resolution is the 5th hierarchical layer.

[0071] Fig. 13 is a diagram showing an example in which second weights are assigned to negative high-frequency data according to resolution. As shown in Fig. 13, multiple negative high-frequency data (ND0 to ND5) are extracted from the 0th layer to the 5th layer. The multiple second weights (0W2 to 5W2) in Fig. 13 are different for each layer corresponding to the resolution.

[0072] The weighting function 377 assigns second weights (0W2 to 5W2) to the negative high frequency data (ND0 to ND5) according to the hierarchical level to which the negative high frequency data belongs. The second weights (0W2 to 5W2) according to the hierarchical level, i.e., the multiple second weights (0W2 to 5W2) corresponding to the multiple hierarchical levels, are, for example, positive values ​​equal to or greater than 0, and are stored in advance in the memory 33. The multiple second weights (0W2 to 5W2) can be set, changed, or adjusted as appropriate by a user instruction via the input interface 13.

[0073] The multi-resolution restoration function 375 sequentially adds a plurality of negative high-frequency data, each of which is assigned a plurality of second weights (0W2 to 5W2), by adjusting the resolution from the lowest resolution to a predetermined resolution, to generate the first added data AD1. Specifically, the multi-resolution restoration function 375 expands the fifth negative high-frequency data ND5, which is assigned the second weight 5W2 in the fifth hierarchy, by the fifth Gaussian expansion GSE5. The multi-resolution restoration function 375 adds, in the fourth hierarchy, the negative high-frequency data expanded by the fifth Gaussian expansion GSE5 and the fourth negative high-frequency data ND4, which is assigned the second weight 4W2 in the fourth hierarchy.

[0074] The multi-resolution restoration function 375 expands the negative high-frequency data after addition in the fourth layer by the fourth Gaussian expansion GSE4, and adds the expanded negative high-frequency data and the third negative high-frequency data ND3 to which the second weight 3W2 in the third layer is assigned in the third layer in the third layer. The multi-resolution restoration function 375 expands the negative high-frequency data after addition in the third layer by the third Gaussian expansion GSE3, and adds the expanded negative high-frequency data and the second negative high-frequency data ND2 to which the second weight 2W2 in the second layer is assigned in the second layer in the second layer. The multi-resolution restoration function 375 expands the negative high-frequency data after addition in the second layer by the second Gaussian expansion GSE2, and adds the expanded negative high-frequency data and the first negative high-frequency data ND1 to which the second weight 1W2 in the first layer is assigned in the first layer in the first layer. The multi-resolution restoration function 375 expands the negative high-frequency data after addition in the first layer using a first Gaussian expansion GSE1, and adds the expanded negative high-frequency data to the 0th negative high-frequency data ND0 to which the second weight 0W2 in the 0th layer has been assigned in the 0th layer.

[0075] As a result, the multi-resolution restoration function 375 generates the first addition data AD1 based on the plurality of negative high-frequency data (ND0 to ND5) and the plurality of second weights (0W2 to 5W2) as shown in Fig. 13. As shown in Fig. 12, the first addition data AD1 in this application example corresponds to the negative restoration data NRD shown in Fig. 6.

[0076] For example, if the second weight 0W2 in the 0th hierarchy, the second weight 1W2 in the 1st hierarchy, and the second weight 2W2 in the 2nd hierarchy are all 0, and the second weight 3W2 in the 3rd hierarchy, the second weight 4W2 in the 4th hierarchy, and the second weight 5W2 in the 5th hierarchy are all 1, this application example will be the same as the first embodiment. That is, this application example assigns the second weight to the negative high frequency data according to the hierarchy, making it possible to appropriately adjust the negative high frequency data contributing to the first addition data AD1.

[0077] According to the ultrasonic diagnostic device 1 according to the first application example of the first embodiment described above, the negative high-frequency data is assigned a second weight W2 according to the layer to which the negative high-frequency data belongs, and the negative high-frequency data to which the second weight W2 is assigned is added over a predetermined resolution with the resolution adjusted to generate the first added data AD1. At this time, the second weight W2 can be appropriately adjusted by a user's instruction via the input interface 13. As a result, according to the ultrasonic diagnostic device 1, the second weight W2 can be set according to each of a plurality of layers, and the range of contrast adjustment in the composite image CI can be expanded. For these reasons, according to the ultrasonic diagnostic device 1, the degree of artifact reduction by the contrast improvement process can be more appropriately set according to the user's desire or default setting, and the composite image CI can be displayed on the display 15. For the above reasons, according to the ultrasonic diagnostic device 1, the visibility of biological information can be further improved. Other effects are the same as those of the first embodiment, and therefore will not be described.

[0078] (Second application example) The second application example is to extract positive high frequency data over a predetermined resolution, and generate a composite image CI based on the extracted positive high frequency data, negative high frequency data, and ultrasound data. The fifth positive high frequency data PD5 corresponds to, for example, the data shown in Fig. 6. In the following, for the sake of concrete explanation, the predetermined layer is assumed to be the third layer, as in the first embodiment.

[0079] FIG. 14 is a diagram showing an example of a process in which positive restoration data is generated based on the positive high-frequency data extracted by the extraction function 373. As shown in FIG. 14, the extraction function 373 extracts positive high-frequency data, also called a positive edge, from the high-frequency data, from the lowest resolution to a predetermined resolution. The positive high-frequency data corresponds to data having a positive luminance value (positive value) in the high-frequency data, as shown in FIG. 6. For example, the extraction function 373 replaces negative luminance values ​​in the high-frequency data with 0 to extract the positive high-frequency data from the high-frequency data. As shown in FIG. 14, the extraction function 373 extracts the fifth positive high-frequency data PD5 from the fifth high-frequency data DD5, extracts the fourth positive high-frequency data PD4 from the fourth high-frequency data DD4, and extracts the third positive high-frequency data PD3 from the third high-frequency data DD3.

[0080] The multi-resolution restoration function 375 adds a plurality of positive high-frequency data by adjusting the resolution over a predetermined resolution, and generates second addition data AD2. Next, the multi-resolution restoration function 375 restores the resolution of the second addition data AD2 to the same resolution as the resolution before the reduction of the ultrasound data. As shown in FIG. 14, the multi-resolution restoration function 375 adds the fifth positive high-frequency data PD5 expanded by the fifth Gaussian expansion GSE5 and the fourth positive high-frequency data PD4. Next, the multi-resolution restoration function 375 expands the added positive high-frequency data by the fourth Gaussian expansion GSE4, and adds the expanded positive high-frequency data to the third positive high-frequency data PD3. As a result, the multi-resolution restoration function 375 generates the second addition data AD2 based on the third positive high-frequency data PD3, the fourth positive high-frequency data PD4, and the fifth positive high-frequency data PD5, as shown in FIG. 14.

[0081] As shown in Fig. 14, the multi-resolution restoration function 375 restores the resolution of the second addition data AD1 to the same resolution as the resolution of the ultrasound data (original image OI) before reduction by using multiple Gaussian enlargements AGSE. The resolution of the ultrasound data (original image OI) before reduction corresponds to the resolution (512 x 256) of the resized image RI in Fig. 2. The multiple Gaussian enlargements AGSE corresponding to restoration by the Gaussian pyramid correspond to the Gaussian enlargement combining the third Gaussian enlargement GSE3, the second Gaussian enlargement GSE2, and the first Gaussian enlargement GSE1. Specifically, the multi-resolution restoration function 375 sequentially performs the third Gaussian enlargement, the second Gaussian enlargement, and the first Gaussian enlargement on the second addition data AD2 to generate the positive restoration data PRD shown in Fig. 14.

[0082] The weighting function 377 assigns a third weight to the restored second sum data (positive restored data PRD) according to the contrast of the biological structure in the original image OI. The third weight is set as a negative value, for example. The third weight can be input, set, and adjusted as appropriate by a user's instruction via the input interface 13.

[0083] The synthesis function 379 generates a synthetic image CI based on the negative restored data NRD, the positive restored data PRD, and the ultrasound data. Specifically, the synthesis function 379 synthesizes the first sum data NRD restored by applying a first weight, the second sum data PRD restored by applying a second weight, and the ultrasound data to generate a synthetic image CI.

[0084] The brightness correction function 381 corrects the brightness value of the composite image CI based on a first average brightness value related to the ultrasound data (original image OI) and a second average brightness value in the composite image CI so that the second average brightness value approaches the first average brightness value. The image generation circuit 29 executes scan conversion on the composite image CI whose brightness has been corrected. The display 15 displays the scan-converted composite image CI.

[0085] Hereinafter, the processing related to the weighting function 377, the synthesis function 379, and the brightness correction function 381 will be described with reference to FIG. 15. FIG. 15 is a diagram showing an example of the processing related to the weighting function 377, the synthesis function 379, and the brightness correction function 381. As shown in FIG. 15, the weighting function 377 assigns a first weight W1 to the negative restored data NRD, and assigns a third weight W3 to the positive restored data PRD. The synthesis function 379 executes a resize process RS on the negative restored data to which the first weight W1 has been assigned, and the positive restored data to which the third weight W3 has been assigned, respectively. Through the resize process, the image size of the negative restored data to which the first weight W1 has been assigned, and the image size of the negative restored data to which the third weight W3 has been assigned, become the same as the image size of the original image OI. The synthesis function 379 synthesizes the resized negative restored data, the resized positive restored data, and the original image OI to generate a synthetic image CI. The brightness correction function 381 performs brightness correction on the composite image CI. The composite image CI after the brightness correction is displayed on the display 15.

[0086] According to the ultrasonic diagnostic device 1 according to the second application example of the first embodiment described above, positive high-frequency data is extracted from high-frequency data of multiple stepped resolutions over a predetermined resolution, and the resolution of the second addition data AD2 obtained by adding the extracted positive high-frequency data over the predetermined resolution is restored to the same resolution as the resolution before the reduction of the ultrasonic data, and the restored second addition data PRD is given a third weight W3 according to the contrast of the structure, and the first addition data NRD to which the first weight W1 is given, the second addition data RPD to which the third weight W3 is given, and the ultrasonic data are synthesized to generate a synthetic image CI. At this time, the third weight W3 can be appropriately adjusted by a user's instruction via the input interface 13.

[0087] As a result, the ultrasonic diagnostic device 1 can appropriately set the brightness of the biological information by the contrast improvement process according to the user's desire or the default setting. As a result, the ultrasonic diagnostic device 1 can appropriately set the contrast between the biological information in the composite image CI and non-biological information such as the heart cavity, and can further improve the visibility of the biological information in the composite image CI. In addition, by appropriately adjusting the third weight W3, the biological information in the composite image CI can be emphasized.

[0088] Furthermore, according to the ultrasonic diagnostic device 1, the luminance value in the area showing biological information can be reduced in accordance with the reduction in the luminance value in the area showing non-biological information, so that it is possible to reduce the saturation of the luminance value (whiteout) in the area showing biological information due to the luminance correction, that is, to suppress the luminance saturation. As a result, according to the ultrasonic diagnostic device 1, it is possible to further improve the visibility of the biological information in the composite image CI. As other effects are similar to those of the first embodiment, the description will be omitted.

[0089] (Third application example) The third application example is to give weights (hereinafter referred to as fourth weights) to the positive high-frequency data according to a plurality of gradual resolutions. For example, when the hierarchical level corresponding to the predetermined resolution is the 0th hierarchical level, the extraction function 373 generates high-frequency data which are differences between the plurality of resolutions excluding the lowest resolution among all the gradual resolutions related to the multi-resolution analysis and the resolution before the first Gaussian reduction GSD1 is performed (the resolution of the resized image RI). The extraction function 373 generates a plurality of positive high-frequency data corresponding to the plurality of resolutions based on the plurality of high-frequency data. The technical idea regarding the generation of the plurality of high-frequency data and the plurality of positive high-frequency data is the same as that of the first embodiment and the second application example, and therefore a detailed description is omitted. Hereinafter, in order to make the description more specific, it is assumed that the predetermined resolution is the 0th hierarchical level corresponding to the maximum resolution, and the hierarchical level corresponding to the lowest resolution is the 5th hierarchical level.

[0090] Fig. 16 is a diagram showing an example in which a fourth weight is assigned to negative high-frequency data according to resolution. As shown in Fig. 16, multiple positive high-frequency data (PD0 to PD5) are extracted from the 0th layer to the 5th layer. The multiple fourth weights (0W4 to 5W4) in Fig. 16 are different for each layer indicating the size of the image.

[0091] The weighting function 377 assigns fourth weights (0W4 to 5W4) to the positive high frequency data (PD0 to PD5) according to the hierarchical level to which the positive high frequency data belongs. The fourth weights according to the hierarchical levels, i.e., the multiple fourth weights (0W4 to 5W4) corresponding to the multiple hierarchical levels, are, for example, negative values ​​less than or equal to 0, and are stored in advance in the memory 33. The multiple fourth weights (0W4 to 5W4) can be set, changed, or adjusted as appropriate by a user instruction via the input interface 13.

[0092] The multi-resolution restoration function 375 sequentially adds a plurality of negative high-frequency data, each of which is assigned a plurality of fourth weights (0W4 to 5W4), by adjusting the resolution across a predetermined resolution, to generate second added data AD2. Specifically, the multi-resolution restoration function 375 expands the fifth positive high-frequency data PD5, which is assigned the fourth weight 5W4 in the fifth hierarchy, by the fifth Gaussian expansion GSE5. The multi-resolution restoration function 375 adds, in the fourth hierarchy, the positive high-frequency data expanded by the fifth Gaussian expansion GSE5 and the fourth positive high-frequency data PD4, which is assigned the fourth weight 4W4 in the fourth hierarchy.

[0093] The multi-resolution restoration function 375 expands the positive high-frequency data after addition in the fourth layer by the fourth Gaussian expansion GSE4, and adds the expanded positive high-frequency data and the third positive high-frequency data PD3 in the third layer to which the fourth weight 3W4 is added in the third layer in the third layer. The multi-resolution restoration function 375 expands the positive high-frequency data after addition in the third layer by the third Gaussian expansion GSE3, and adds the expanded positive high-frequency data and the second positive high-frequency data PD2 in the second layer to which the fourth weight 2W4 is added in the second layer in the second layer. The multi-resolution restoration function 375 expands the positive high-frequency data after addition in the second layer by the second Gaussian expansion GSE2, and adds the expanded positive high-frequency data and the first positive high-frequency data PD1 in the first layer to which the fourth weight 1W4 is added in the first layer in the first layer. The multi-resolution restoration function 375 expands the positive high-frequency data after addition in the first layer using a first Gaussian expansion GSE1, and adds the expanded positive high-frequency data to the 0th positive high-frequency data PD0 to which the fourth weight 0W4 in the 0th layer has been assigned in the 0th layer.

[0094] As a result, the multi-resolution restoration function 375 generates the second addition data AD2 based on the plurality of positive high-frequency data (PD0 to PD5) and the plurality of fourth weights (0W4 to 5W4) as shown in Fig. 16. As shown in Fig. 13, the second addition data AD2 in this application example corresponds to the positive restoration data PRD in Fig. 14. Note that the luminance correction in this application example and the display of the luminance-corrected composite image CI are similar to those in the second application example, and therefore description thereof will be omitted.

[0095] For example, if the fourth weight 0W4 in the 0th hierarchy, the fourth weight 1W4 in the 1st hierarchy, and the fourth weight 2W4 in the 2nd hierarchy are all 0, and the fourth weight 3W4 in the 3rd hierarchy, the fourth weight 4W4 in the 4th hierarchy, and the fourth weight 5W4 in the 5th hierarchy are all 1, this application example will be the same as the second application example. That is, this application example assigns a fourth weight to the positive high frequency data according to the hierarchy, thereby making it possible to appropriately adjust the positive high frequency data contributing to the second added data AD2.

[0096] According to the ultrasonic diagnostic device 1 according to the third application example of the first embodiment described above, the positive high-frequency data is assigned a fourth weight W4 according to the layer to which the positive high-frequency data belongs, and the positive high-frequency data to which the fourth weight W4 has been assigned is added with the resolution adjusted from the lowest resolution to a predetermined resolution to generate the second added data PRD. At this time, the fourth weight W4 can be appropriately adjusted by a user's instruction via the input interface 13. As a result, according to the ultrasonic diagnostic device 1, the fourth weight W4 can be set according to each of a plurality of layers, and the range of contrast adjustment in the composite image CI can be expanded. From these points, according to the ultrasonic diagnostic device 1, the brightness of the biological information by the contrast improvement process can be more appropriately set according to the user's desire or default setting. From the above points, according to the ultrasonic diagnostic device 1, the contrast between the biological information in the composite image CI and non-biological information such as the heart cavity can be more appropriately set, and the visibility of the biological information in the composite image CI can be further improved. In addition, by appropriately adjusting the fourth weight W4, the biological information in the composite image CI can be emphasized.

[0097] Furthermore, according to the ultrasonic diagnostic device 1, the luminance value in the area showing biological information can be reduced in accordance with the reduction in the luminance value in the area showing non-biological information, so that the saturation of the luminance value (whiteout) in the area showing biological information due to the luminance correction can be further reduced, that is, the luminance saturation can be more appropriately suppressed. As a result, according to the ultrasonic diagnostic device 1, the visibility of the biological information in the composite image CI can be further improved. As other effects are similar to those of the first embodiment, the description will be omitted.

[0098] (Example 4) In this application example, when the ultrasound data is data related to a power Doppler image, a composite image CI is generated using the data related to the power Doppler image as the ultrasound data, a threshold value for blanking is determined based on the brightness value in the composite image CI corresponding to the power Doppler image, and the determined threshold value is used to execute blanking to generate a power Doppler image. The blanking is, for example, a pre-processing performed before generating a power Doppler image and a dispersion image. The blanking is a process of displaying an area in which the velocity value is equal to or greater than a threshold value in color in order to remove noise components. The contents of the blanking can be appropriately performed using known techniques, so a description thereof will be omitted.

[0099] The image generating circuit 29 determines a threshold value for blanking based on the luminance value in the composite image CI generated by the contrast improvement process. The image generating circuit 29 executes blanking using the determined threshold value to generate a power Doppler image.

[0100] According to the ultrasonic diagnostic device 1 according to the fourth application example of the first embodiment described above, when the ultrasonic data is data related to a power Doppler image, a threshold value related to blanking is determined based on the luminance value in the composite image CI, and the blanking is performed using the determined threshold value to generate a power Doppler image. As a result, according to the ultrasonic diagnostic device 1, a threshold value in blanking can be set using the composite image CI in which artifacts are reduced, so that the accuracy of removing noise components in the power Doppler image generated by blanking can be improved. Therefore, according to the ultrasonic diagnostic device 1, the visibility of biological information in the power Doppler image on which blanking has been performed can be improved. Other effects are similar to those of the first embodiment, so a description thereof will be omitted.

[0101] Second embodiment The difference between the second embodiment and the first embodiment is that the contrast improvement process realized in the first embodiment is performed by a medical image processing device. The medical image processing device is realized by, for example, a server device connected to a modality via a network. Note that the various functions executed by the medical image processing device may be realized by various servers within a hospital, such as a PACS (Picture Archiving and Communication Systems) server.

[0102] FIG. 17 is a diagram showing an example of the configuration of the medical image processing device 20. The processing circuit 37 in the medical image processing device 20 includes, for example, a multi-resolution decomposition function (multi-resolution decomposition unit) 371, an extraction function (extraction unit) 373, a multi-resolution restoration function (multi-resolution restoration unit) 375, a weighting function (weighting unit) 377, a synthesis function (synthesizing unit) 379, and a luminance correction function (luminance correction unit) 381. The multi-resolution decomposition function (multi-resolution decomposition unit) 371 generates a plurality of low-frequency data and a plurality of high-frequency data corresponding to a plurality of gradual resolutions from the medical image. The extraction function (extraction unit) 373 extracts negative high-frequency data from the high-frequency data over a predetermined resolution among the plurality of gradual resolutions. The multi-resolution restoration function (multi-resolution restoration unit) 375 restores the resolution of the first added data obtained by adding the negative high-frequency data together over a predetermined resolution to the same resolution as the resolution before the reduction of the medical image. A synthesis function (synthesis unit) 379 generates a synthetic image CI based on the restored first added data and the medical image.

[0103] In the contrast improvement process by the medical image processing device 20, the medical image to be processed is not limited to ultrasound data. For example, the contrast improvement process in this embodiment can appropriately use medical images acquired by various modalities. At this time, the medical image diagnostic device 5 acquires medical images corresponding to various modalities and used for the contrast improvement process. In this case, the communication interface 31 outputs the medical image acquired by the medical image diagnostic device 5 to the processing circuitry 37.

[0104] If the medical image input from the medical image diagnostic device 5 is volume data, the image processing circuit 21 may generate a two-dimensional image from the volume data by known three-dimensional image processing such as rendering processing and MPR processing. Then, the image processing circuit 21 outputs the two-dimensional image to the processing circuit 37. The processing circuit 37 executes contrast improvement processing on the two-dimensional image. The processing circuit 37 may execute contrast improvement processing using the volume data as the medical image.

[0105] The procedure and effects of the contrast improvement process in the second embodiment are similar to those in the first embodiment, and therefore the description will be omitted. Note that the various functions executed in the medical image processing device 20 may be mounted on the medical image diagnostic device 5 such as various modalities. Also, as a modified example of the second embodiment, the medical image processing device 20 may be realized by a workstation or cloud computing. In this case, the input interface 13 and the display 15 may be connected to a network as, for example, a client device. Also, the communication interface 31, the memory 33, and the processing circuit 87 may be mounted on a server on the network. The effects of the second embodiment are similar to those in the first embodiment, and therefore the description will be omitted.

[0106] When the technical ideas in the various embodiments and various modified examples are realized by a medical image processing program, the medical image processing program causes a computer to generate multiple low frequency data and multiple high frequency data corresponding to multiple graduated resolutions from a medical image, extract negative high frequency data from the high frequency data over a predetermined resolution among the multiple graduated resolutions, restore the resolution of first added data obtained by combining and adding the negative high frequency data over the predetermined resolution to the same resolution as the resolution of the medical image before it was reduced, and generate a composite image CI based on the restored first added data and the medical image.

[0107] For example, the index acquisition process can be realized by installing the medical image processing program in a computer in a PACS server or integrated server in a hospital information system, the ultrasound diagnostic device 1, or the like, and expanding the program in memory. In this case, the program that allows the computer to execute the method can be stored in a storage medium such as a magnetic disk (hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), or a semiconductor memory and distributed. The processing procedure and effects of the medical image processing program are similar to those in the first embodiment, so a description thereof will be omitted.

[0108] According to at least one of the embodiments and application examples described above, it is possible to improve the visibility of biological structures in medical images.

[0109] Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0110] 1. Ultrasound diagnostic equipment 11 Ultrasound probe 13 Input Interface 15 Display 19. Device body 20 Medical image processing device 21 Image processing circuit 23 Transmitting and receiving circuit 25 B-mode data generation circuit 27 Doppler data generation circuit 29 Image Generation Circuit 31 Communication Interface 33 Memory 35 Control circuit 37 Processing circuit 371 Multiresolution decomposition function 373 Extraction Function 375 Multi-resolution restoration function 377 Weighting function 379 Synthesis Function 381 Brightness correction function

Claims

[Claim 1] a multi-resolution decomposition unit that generates a plurality of low-frequency data and a plurality of high-frequency data corresponding to a plurality of stepped resolutions from the ultrasound data; an extractor for extracting negative high-frequency data from the plurality of high-frequency data over a predetermined resolution; a multi-resolution restoration unit that restores a resolution of first added data obtained by adding the negative high frequency data together over the predetermined resolution to a resolution equal to the resolution of the ultrasound data before reduction; a synthesis unit that generates a synthesis image based on the restored first added data and the ultrasound data; A display unit that displays the composite image; An ultrasound diagnostic device comprising:

Images