Optimization method for ultrasonic multi-mode image mixed display

Abstract

The invention provides an ultrasonic multi-mode image mixed display optimization method, which comprises the following steps: acquiring ultrasonic images of different modes, and jointly displaying the ultrasonic images of different modes in a single image; calculating the image gradient of each modal ultrasonic image, and solving the absolute value of the image gradient to obtain the gradient amplitude corresponding to each modal; performing gray value normalization operation on the ultrasonic images in different modes; converting the gradient amplitude corresponding to each modal ultrasonic image into a corresponding binary mask, and calculating a connected domain image of each modal ultrasonic image; calculating the average values of the gray values of the connected domain images in the ultrasonic images of the corresponding modals, adding the average values of the gray values and normalizing the average values to a preset range to obtain a new weight value of the ultrasonic image of each modal, and displaying the ultrasonic images of each modal in an overlapping manner according to the new weight value corresponding to the ultrasonic image of each modal. The method of mixing and displaying different mode images in a single image can effectively highlight the image characteristics between different modes.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image processing, in particular to an optimization method for mixed display of ultrasonic multi-mode images. BACKGROUND

[0002] At present, in ultrasonic images, multi-mode mixed display is a commonly used technical means, which can combine different types of ultrasonic imaging modes to provide more abundant and comprehensive information to help doctors make more accurate diagnoses. In the prior art, when two-dimensional ultrasonic, elastic imaging and color Doppler ultrasonic three modes are mixed displayed, the transparency of elastic imaging and color Doppler ultrasonic is manually adjusted respectively. In the operation process, the doctor finds the corresponding transparency adjustment slider or knob for the elastic imaging image and the color Doppler ultrasonic image on the operation interface of the ultrasonic device according to his own experience. For example, in a common ultrasonic diagnostic instrument, after the elastic imaging mode is turned on, there is a sliding bar marked with "elastic transparency" beside the image display area. The doctor can change the transparency of the elastic imaging image in the mixed display in real time by dragging the slider left and right, and steplessly adjust from complete opacity to complete transparency. Similarly, the color Doppler ultrasonic image also has a similar "Doppler transparency" adjustment control. By manually adjusting the transparency of the two, the doctor tries to clearly and reasonably superimpose the tissue hardness information reflected by the elastic imaging and the blood flow information displayed by the color Doppler ultrasonic on the basis anatomical structure presented by the two-dimensional ultrasonic, so as to facilitate the comprehensive judgment of the lesion at the same coordinate position.

[0003] However, this method has obvious disadvantages. Since manual adjustment is highly subjective, different doctors will have different results, and it is difficult to accurately balance the information presentation of the three mode images during the adjustment process, which may lead to some important information being excessively faded or some information being too prominent, affecting the accurate judgment of the lesion.

[0004] Therefore, in order to overcome the above technical problems, the present application provides an optimization method for mixed display of ultrasonic multi-mode images. SUMMARY

[0005] The present application provides an optimization method for mixed display of ultrasonic multi-mode images, which determines the display transparency of the mixed display of ultrasonic multi-mode images on a single image, so that the operator can more clearly and intuitively see the different modal states between different regions, and does not need to rely on single transparency to adjust the image full field. The method of mixing different modal images in a single image can effectively highlight the image characteristics between different modes.

[0006] An optimization method for mixed display of ultrasonic multi-mode images, comprising:

[0007] acquire the ultrasound images of different modalities, and display the ultrasound images of different modalities together in a single image;

[0008] calculate the image gradient of each modality ultrasound image, and obtain the gradient amplitude corresponding to each modality by taking the absolute value of the image gradient;

[0009] perform a gray value normalization operation on the ultrasound images of different modalities;

[0010] convert the gradient amplitude corresponding to each modality ultrasound image into a corresponding binary mask, and calculate the connected domain image of each modality ultrasound image;

[0011] calculate the average value of the gray value of the connected domain image in the ultrasound image of the corresponding modality, add the average values of the gray values and normalize them to a preset range to obtain a new weight value of each modality ultrasound image, and display each modality ultrasound image by overlapping according to the new weight value corresponding to each modality ultrasound image.

[0012] Preferably, an optimization method for ultrasound multi-modal image mixed display comprises: the ultrasound images of different modalities are two-dimensional data with a numerical range of [0, 255] respectively.

[0013] Preferably, an optimization method for ultrasound multi-modal image mixed display comprises calculating the image gradient of each modality ultrasound image, which comprises:

[0014] acquiring an ultrasound image I(x, y), wherein x represents the horizontal coordinate of the ultrasound image, and y represents the vertical coordinate of the ultrasound image;

[0015] calculating the partial derivative of any point in the ultrasound image in the horizontal direction and the vertical direction to obtain the image gradient ΔI of the ultrasound image;

[0016]

[0017] wherein ΔI represents the image gradient of the ultrasound image; represents the partial derivative of the ultrasound image in the x direction; represents the partial derivative of the ultrasound image in the y direction.

[0018] Preferably, an optimization method for ultrasound multi-modal image mixed display comprises performing a gray value normalization operation on the ultrasound images of different modalities, which comprises: normalizing the ultrasound images of different modalities to the range of (0, 1].

[0019] Preferably, an optimization method for ultrasound multi-modal image mixed display comprises converting the gradient amplitude corresponding to each modality ultrasound image into a corresponding binary mask, which comprises:

[0020] acquiring a preset threshold value;

[0021] Traverse the gradient amplitude value of each pixel point in the ultrasound image, and compare the gradient amplitude value with a preset threshold value;

[0022] According to the comparison result, the pixel point corresponding to the gradient amplitude value equal to or greater than the preset threshold value is marked as 1; according to the comparison result, the pixel point corresponding to the gradient amplitude less than the preset threshold value is marked as 0;

[0023] According to the marking result, a binary mask corresponding to each modal ultrasound image is obtained.

[0024] Preferably, an optimization method for ultrasound multi-modal image mixed display, when the gradient amplitude corresponding to each modal ultrasound image is converted into a corresponding binary mask, further comprises performing a closing operation on the binary mask corresponding to each modal ultrasound image, and calculating the connected domain image of each modal ultrasound image based on the closing operation result.

[0025] Preferably, an optimization method for ultrasound multi-modal image mixed display, calculating the connected domain image of each modal ultrasound image, comprises:

[0026] Based on the two-dimensional maximum inter-class variance method or the two-dimensional otsu method, the connected domain image of each modal ultrasound image is calculated.

[0027] Preferably, an optimization method for ultrasound multi-modal image mixed display, adding the average value of the gray value and normalizing it to a preset range to obtain a new weight value of each modal ultrasound image, comprises:

[0028] The preset range is [0, 1];

[0029] The calculation process is as follows:

[0030]

[0031] Wherein, coeff_i represents the new weight value of the ultrasound image corresponding to the i-th modality; i represents the serial number value of the modal ultrasound image; mean_i represents the average value of the gray value of the ultrasound image corresponding to the i-th modality; n represents the total number of modes; the mode corresponds to the ultrasound image one by one;

[0032] Traverse each pixel in each modal ultrasound image step by step until the traversal is completed.

[0033] Preferably, an optimization method for ultrasound multi-modal image mixed display, comprising: coeff_i represents the transparent channel value of the ultrasound image corresponding to the i-th modality at coordinates (x, y).

[0034] Preferably, an optimization method for ultrasound multi-modal image mixed display, after obtaining the new weight value of each modal ultrasound image, further comprising normalizing the new weight value of each modal ultrasound image, and the specific calculation process is as follows:

[0035]

[0036] wherein, h i represents the weight value of the i-th modality corresponding to the ultrasound image, and the numerical range of the weight value is [0, 1].

[0037] Compared with the prior art, the present application has the following beneficial effects:

[0038] By optimizing the display transparency judgment of the mixed display of the ultrasound multi-mode images on a single image, the operator can more clearly and intuitively see the different modality states between different regions, and does not need to rely on single transparency to adjust the image full field, and the method of mixed display of different modality images on a single image can effectively highlight the image characteristics between different modes.

[0039] Other features and advantages of the present application will be set forth in the following description, and in part will become apparent to those skilled in the art from the description, or can be learned by practice of the present application. The objects and other advantages of the present application can be realized and achieved by the structure particularly pointed out in the specification.

[0040] The technical solutions of the present application will be further described in detail below with the aid of the accompanying drawings and embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0041] The accompanying drawings are included to provide a further understanding of the present application, and constitute a part of the specification, and are used together with the embodiments of the present application to explain the present application, and do not constitute a limitation on the present application. In the drawings:

[0042] Figure 1 is a flow chart of an optimization method for ultrasound multi-mode image mixed display in an embodiment of the present application;

[0043] Figure 2 is a full flow schematic diagram of an optimization method for ultrasound multi-mode image mixed display in an embodiment of the present application;

[0044] Figure 3 is a contrast diagram of a mixed image obtained by using a conventional full field transparency control in an optimization method for ultrasound multi-mode image mixed display in an embodiment of the present application and a mixed display image obtained by determining a new weight in the present application. DETAILED DESCRIPTION

[0045] The preferred embodiments of the present application will be described below with reference to the accompanying drawings, and it should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application, and do not limit the present application.

[0046] In one embodiment, an optimization method for ultrasound multi-mode image mixed display is provided, as shown inFigure 1 As shown, comprising:

[0047] Step 1: Collecting ultrasound images of different modalities, displaying ultrasound images of different modalities together in a single image;

[0048] Step 2: Calculating the image gradient of each modality ultrasound image, taking the absolute value of the image gradient to obtain the gradient amplitude corresponding to each modality;

[0049] Step 3: Performing a gray value normalization operation on ultrasound images of different modalities;

[0050] Step 4: Converting the gradient amplitude corresponding to each modality ultrasound image into a corresponding binary mask, and calculating the connected domain image of each modality ultrasound image;

[0051] Step 5: Calculate the average value of the gray value of the connected domain image in the corresponding modality ultrasound image, add the average value of the gray value and normalize it to a preset range to obtain a new weight value of each modality ultrasound image, and overlap display each modality ultrasound image according to the new weight value corresponding to each modality ultrasound image.

[0052] In this embodiment, it is assumed that the superimposed image is three different modality ultrasound images a, ultrasound images b and ultrasound images c, and the system simultaneously acquires ultrasound images a, b and c and displays them together in a single image. Among them, ultrasound images a, b and c are two-dimensional data with a numerical range of [0-255];

[0053] Among them, the gray value normalization operation is performed on the different modality ultrasound images: the original images a, b and c are normalized in gray value, and the images are normalized to the range [0, 1] to obtain norm_a, norm_b and norm_c;

[0054] Convert the gradient amplitude corresponding to each modality ultrasound image into a corresponding binary mask, and calculate the connected domain image of each modality ultrasound image: for the image Convert to a binary mask, and the conversion method can be to set a threshold threshold_d, mark the values below threshold_d as 0, and vice versa. For the obtained binary masks mask_a, mask_b and mask_c, perform a closing operation, and calculate the connected domain in the image, where the method for calculating the connected domain can be two-dimensional maximum inter-class variance method or two-dimensional otsu method, and the calculated connected domain image connact_a, connact_b and connact_c.

[0055] The average value of the gray value of the calculated connected domain image in the ultrasound image of the corresponding mode is calculated, the average value of the gray value is added and normalized to a preset range, a new weight value of each modality ultrasound image is obtained, and each modality ultrasound image is displayed by overlapping according to the corresponding new weight value of each modality ultrasound image: the average value of the connected domain of the connact_a, connact_b, and connact_c images in the corresponding positions of the norm_a, norm_b, and norm_c images is calculated, and the average value of the corresponding area is obtained. The average value in the two-dimensional image is calculated point by point to obtain the normalized average value of the three images under a single coordinate. Assuming that the position under the coordinate (x, y) can obtain the average value mean_a, mean_b, and mean_c of the image norm_a; the mean_a, mean_b, and mean_c are added and normalized to the range [0, 1] to obtain new weight values coeff_a, coeff_b, and coeff_c, wherein: coeff_a=mean_a / (mean_a+mean_b+mean_c); coeff_b=mean_b / (mean_a+mean_b+mean_c); coeff_c=mean_c / (mean_a+mean_b+mean_c) and the obtained coeff_a is used as the alpha_a value of the ultrasound image a at the coordinate (x, y). The coeff_b and coeff_c are the same. And the whole image is traversed point by point until each pixel is calculated. And the obtained alpha_a, alpha_b, and alpha_c values are used to display the overlapped display image of the images a, b, and c. As shown in the following Figure Two ;

[0056] More preferably, the coeff_a, coeff_b, and coeff_c can be adjusted in weight, and given weights h1, h2, and h3. The value range of h1, h2, and h3 is [0, 1], and the normalization step in step 6 is increased to:

[0057] coeff_a=h1*mean_a / (h1*mean_a+h2*mean_b+h3*mean_c)

[0058] coeff_b=h2*mean_b / (h1*mean_a+h2*mean_b+h3*mean_c)

[0059] coeff_c = h3 * mean_c / (h1 * mean_a + h2 * mean_b + h3 * mean_c) can obtain the fine adjustment of the mixed display transparency value, wherein the weights h1, h2, h3 can be the values calculated by the algorithm or the weight values given according to the operator experience.

[0060] In this embodiment, the full process schematic diagram is shown in Figure 2 The contrast diagram of the mixed image obtained by using the traditional full-field transparency control and the mixed display image obtained by determining the new weight in the present application is shown in Figure 3

[0061] The working principle and beneficial effects of the above technical solutions are as follows: different modal ultrasound images are collected, and the different modal ultrasound images are displayed together in a single image; the image gradient of each modal ultrasound image is calculated, and the absolute value of the image gradient is calculated to obtain the gradient amplitude corresponding to each modal; the gray value of the different modal ultrasound images is normalized; the gradient amplitude corresponding to each modal ultrasound image is converted into a corresponding binary mask, and the connected domain image of each modal ultrasound image is calculated; the average value of the gray value of the connected domain image in the corresponding modal ultrasound image is calculated, the average values of the gray values are added and normalized to a preset range to obtain a new weight value of each modal ultrasound image, and each modal ultrasound image is displayed by overlapping according to the new weight value corresponding to each modal ultrasound image. By optimizing the display transparency judgment of the mixed display of the ultrasound multi-modal image on a single image, the operator can more clearly and intuitively see the different modal states between different regions without relying on single transparency for full-field image adjustment. The method of mixing and displaying different modal images in a single image can effectively highlight the image characteristics between different modes.

[0062] In one embodiment, an optimization method for ultrasound multi-modal image mixed display is provided, which includes: different modal ultrasound images are respectively two-dimensional data with a numerical range of [0, 255].

[0063] In one embodiment, an optimization method for ultrasound multi-modal image mixed display is provided, which includes calculating the image gradient of each modal ultrasound image, including:

[0064] An ultrasound image I(x, y) is obtained, wherein x represents the horizontal coordinate of the ultrasound image; y represents the vertical coordinate of the ultrasound image; the partial derivative of any point in the ultrasound image in the horizontal direction and the vertical direction is calculated to obtain the image gradient ΔI of the ultrasound image; wherein ΔI represents the image gradient of the ultrasound image; represents the partial derivative of the ultrasound image in the x direction; represents the partial derivative of the ultrasound image in the y direction. ​

[0065] In this embodiment, it is assumed that the superimposed image is an ultrasound image a, an ultrasound image b and an ultrasound image c of three different modalities, and the image gradients of the three images are calculated The absolute values of the image gradients are obtained to obtain three gradient amplitudes The gradient amplitude reflects the rate of brightness change of the image at the point, and the greater the value, the more intense the image change at the point, which generally corresponds to the edge of the image. The gradient direction indicates the vertical direction of the maximum brightness change direction, and generally, the area with intense image change is more likely to represent the lesion and is more concerned by the clinical operator (generally representing the edge or non-uniform area).

[0066] In one embodiment, an optimization method for ultrasound multi-modal image mixed display is provided, which performs a gray value normalization operation on ultrasound images of different modalities, including: normalizing ultrasound images of different modalities to the range of (0, 1].

[0067] In one embodiment, an optimization method for ultrasound multi-modal image mixed display is provided, which converts the gradient amplitude of each modality ultrasound image into a corresponding binary mask, including: obtaining a preset threshold; traversing the gradient amplitude value of each pixel point in the ultrasound image, and comparing the gradient amplitude value with the preset threshold; according to the comparison result, marking the pixel point corresponding to the gradient amplitude value equal to or greater than the preset threshold as 1; according to the comparison result, marking the pixel point corresponding to the gradient amplitude less than the preset threshold as 0; and obtaining the binary mask corresponding to each modality ultrasound image according to the marking result.

[0068] In one embodiment, an optimization method for ultrasound multi-modal image mixed display is provided, which, after converting the gradient amplitude of each modality ultrasound image into a corresponding binary mask, further includes performing a closing operation on the binary mask corresponding to each modality ultrasound image, and calculating the connected domain image of each modality ultrasound image based on the closing operation result. The shape and size of the connected domain of the image after the closing operation are more stable. Because of the repair of the target shape by the closing operation, the calculated connected domain can more accurately reflect the true properties of the target object in terms of area, perimeter and other characteristics.

[0069] In one embodiment, an optimization method for ultrasound multi-modal image mixed display is provided, which calculates the connected domain image of each modality ultrasound image, including: calculating the connected domain image of each modality ultrasound image based on the two-dimensional maximum inter-class variance method or the two-dimensional otsu method.

[0070] In one embodiment, an optimization method for ultrasound multi-modal image mixed display is provided, which adds the average values of the gray values and normalizes them to a preset range to obtain new weight values of each modality ultrasound image, including: the preset range is [0, 1]; and the calculation process is as follows: Wherein, coeff_i represents the new weight value of the i-th modality corresponding ultrasound image; i represents the serial number value of the modality ultrasound image; mean_i represents the average value of the gray value of the i-th modality corresponding ultrasound image; n represents the total number of modalities; the modality corresponds to the ultrasound image one by one; each pixel in each modality ultrasound image is traversed step by step until the traversal is completed.

[0071] In one embodiment, an optimization method for ultrasound multimodal mode image mixed display is provided, comprising: coeff_i represents the transparent channel value of the i-th modality corresponding ultrasound image at coordinates (x, y).

[0072] In one embodiment, an optimization method for ultrasound multimodal mode image mixed display is provided, after obtaining the new weight value of each modality ultrasound image, further comprising normalizing the new weight value of each modality ultrasound image, and the specific calculation process is as follows: Wherein, h i represents the weight value of the i-th modality corresponding ultrasound image, and the numerical range of the weight value is [0, 1]. The beneficial effects of the above technical solution are: the fine adjustment of the mixed display transparency value can be obtained.

[0073] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application belong to the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.

Claims

1. An optimization method for mixed display of ultrasound multi-mode images, characterized in that: include: Acquire ultrasound images of different modalities and display them together in a single image; Calculate the image gradient of each modality ultrasound image, calculate the absolute value of the image gradient, and obtain the gradient amplitude corresponding to each modality; Normalize the grayscale values ​​of ultrasound images of different modalities; Convert the gradient amplitude corresponding to each modality ultrasound image into a corresponding binary mask, and calculate the connected domain image of each modality ultrasound image; The average grayscale value of the connected domain image in the ultrasound image of the corresponding modality is calculated, the average grayscale value is added and normalized to the preset range, and a new weight value of each modality ultrasound image is obtained. Each modality ultrasound image is then overlapped and displayed according to the new weight value corresponding to each modality ultrasound image.

2. The method for optimizing ultrasound multi-mode image mixed display according to claim 1, characterized in that: include: Ultrasound images of different modalities are two-dimensional data with a value range of [0, 255].

3. The method for optimizing ultrasound multi-mode image mixed display according to claim 1, characterized in that: Calculate image gradients for each modality ultrasound image, including: Acquire an ultrasound image I(x,y), where x represents the horizontal coordinate of the ultrasound image; y represents the vertical coordinate of the ultrasound image; Calculate the partial derivatives of any point in the ultrasound image in the horizontal and vertical directions to obtain the image gradient ΔI of the ultrasound image; Wherein, ΔI represents the image gradient of the ultrasound image; represents the partial derivative of the ultrasound image in the x direction; represents the partial derivative of the ultrasound image in the y direction.

4. The method for optimizing the mixed display of ultrasound multi-mode images according to claim 1, characterized in that: The grayscale values ​​of ultrasound images of different modalities are normalized, including normalizing the ultrasound images of different modalities to a range of (0, 1).

5. The method for optimizing ultrasound multi-mode image mixed display according to claim 1, characterized in that: The gradient amplitude corresponding to each modality ultrasound image is converted into a corresponding binary mask, including: Get the preset threshold; Traversing the gradient amplitude value of each pixel in the ultrasound image and comparing the gradient amplitude value with a preset threshold; According to the comparison result, the pixel points corresponding to the gradient amplitude being equal to or greater than the preset threshold are marked as 1; according to the comparison result, the pixel points corresponding to the gradient amplitude being less than the preset threshold are marked as 0; The binary mask corresponding to each modality ultrasound image is obtained according to the labeling results.

6. The method for optimizing ultrasound multi-mode image mixed display according to claim 1, characterized in that: After the gradient amplitude corresponding to each modal ultrasound image is converted into a corresponding binary mask, the method further includes performing a closing operation on the binary mask corresponding to each modal ultrasound image, and calculating a connected domain image of each modal ultrasound image based on the closing operation result.

7. The method for optimizing ultrasound multi-mode image mixed display according to claim 6, characterized in that: Calculate the connected domain image of each modality ultrasound image, including: The connected domain image of each modality ultrasound image is calculated and output based on the two-dimensional maximum inter-class variance method or the two-dimensional OTSU method.

8. The method for optimizing ultrasound multi-mode image mixed display according to claim 1, characterized in that: The average values ​​of the grayscale values ​​are added and normalized to the preset range to obtain the new weight value of each modality ultrasound image, including: The default range is [0,1]; The calculation process is as follows: Among them, coeff_i represents the new weight value of the ultrasound image corresponding to the i-th modality; i represents the serial number of the modal ultrasound image; mean_i represents the average grayscale value of the ultrasound image corresponding to the i-th modality; n represents the total number of modalities; modalities correspond one to one with ultrasound images; Each pixel in each modality ultrasound image is traversed step by step until the traversal is completed.

9. The method for optimizing the mixed display of ultrasound multi-modal images according to claim 8, characterized in that: include: coeff_i represents the transparent channel value of the ultrasound image corresponding to the i-th mode at the coordinate (x, y).

10. The method for optimizing ultrasound multi-mode image mixed display according to claim 1, characterized in that: After obtaining the new weight value of each modality ultrasound image, the new weight value of each modality ultrasound image is normalized and adjusted. The specific calculation process is as follows: Among them, h i Represents the weight value of the ultrasound image corresponding to the i-th modality, and the numerical range of the weight value is [0,1].

Images