A method for optimizing vascular imaging images

Through the multi-head self-attention mechanism and Gaussian noise adjustment method, combined with the variational autoencoder and the mixed self-attention mechanism, the problems of low contrast and noise interference in the vascular imaging image data are solved, and high-quality enhanced vascular imaging images are generated, improving the diagnostic and detection effect.

CN119887547BActive Publication Date: 2025-08-19THE FIRST MEDICAL CENT CHINESE PLA GENERAL HOSPITAL +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411032094.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2025-08-19
Estimated Expiration
2044-07-30

AI Technical Summary

Technical Problem

There are problems in the vascular imaging image data with low contrast and severe noise interference, which makes it difficult to identify the small blood vessel structure, affecting the effectiveness of diagnosis and automatic target detection.

Method used

The first-stage feature encoding module is used to apply a multi-head self-attention mechanism and a feedforward neural network, combining the weight supplement module to adjust the feature weights through Gaussian noise and uniform noise, the second-stage feature encoding module uses the VAE encoder and decoder structure, and the third-stage feature enhancement module uses a mixed self-attention mechanism to finally generate high-quality enhanced vascular imaging images.

Benefits of technology

It significantly improves the contrast and clarity of vascular imaging images, enhances the visibility of tiny blood vessel structures, improves the quality and robustness of image data, and is suitable for complex image data processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119887547B_ABST
    Figure CN119887547B_ABST
Patent Text Reader

Abstract

The present invention proposes a vascular imaging image optimization method, which relates to the field of image enhancement. The present invention proposes a vascular imaging image data processing process, including vascular imaging image data collection, construction of a first-stage feature encoding module, construction of a weight supplementation module, construction of a second-stage feature encoding module, construction of a third-stage feature enhancement module, construction of a multi-stage image data enhancement module, construction of a vascular imaging image data processing model, training of the vascular imaging image data processing model, and vascular imaging image data processing. The present invention also proposes a vascular imaging image data processing model, wherein the first-stage feature encoding module effectively extracts high-level features, the weight supplementation module dynamically adjusts feature weights, the second-stage feature encoding module further compresses and reconstructs features, the third-stage feature enhancement module enhances feature interactivity and global representation capabilities, and the multi-stage image data enhancement module ultimately generates high-quality enhanced vascular imaging image data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the field of image enhancement, and in particular relates to a method for optimizing vascular imaging images. Background Art

[0002] Vascular imaging technology is an extremely important part of medical imaging and is widely used in the diagnosis and treatment of various diseases such as cardiovascular and cerebrovascular diseases, tumors, and diabetes. However, due to the limitations of imaging equipment and the environment, vascular imaging image data often suffers from problems such as low contrast and severe noise interference, posing great challenges to subsequent target detection and diagnosis. Image enhancement technology has emerged in this context. Through a series of algorithms and processing methods, it improves the quality of image data, thereby assisting doctors in making more accurate diagnoses.

[0003] In vascular imaging image data, improving contrast and clarity is the primary goal of image enhancement. In low-contrast image data, small vascular structures are often difficult to identify and may even be drowned out by background noise. Image enhancement technology can significantly improve image contrast, making small blood vessels and their branches more clearly visible. This processing not only makes it easier for doctors to identify and analyze vascular structures and their diseased areas during the diagnosis process, but also provides higher-quality input data for subsequent automatic target detection algorithms.

[0004] The latest ViT architecture usually combines the multi-scale feature fusion method. By fusing features of different scales, it can more comprehensively capture the multi-scale information in the image data. Multi-scale feature fusion helps to improve the detail retention and global information integration of the image data, making the image data enhancement effect more significant. In this way, the ViT architecture can better handle various complex situations in the image data and improve the overall quality of the image data. Summary of the Invention

[0005] The present invention provides a vascular imaging image optimization method, aiming to propose a vascular imaging image data processing model, wherein a first-stage feature encoding module applies a multi-head self-attention mechanism and a feedforward neural network to effectively extract high-level features of fuzzy vascular imaging image data. A weight supplementation module dynamically adjusts feature weights by introducing Gaussian noise and uniform noise to balance the distribution of samples of different categories. A second-stage feature encoding module, through the encoder, sampling, and decoder structure of VAE, can further compress and reconstruct features to capture the potential representation of image data. A third-stage feature enhancement module enhances the interactivity and global representation capability of features through a hybrid self-attention mechanism. A multi-stage image data enhancement module extracts and enhances features layer by layer to ultimately generate high-quality enhanced vascular imaging image data.

[0006] The present invention aims to propose a vascular imaging image data processing model and provide a vascular imaging image optimization method, comprising the following steps:

[0007] S1. Vascular imaging image data collection: collecting multiple clear vascular imaging images to form a vascular imaging image dataset;

[0008] S2, build a one-stage feature encoding module, including an adapted Transformer module;

[0009] S3. Build a weight supplement module, including weight supplement operations;

[0010] S4, construct a two-stage feature encoding module, including a weight supplement module;

[0011] S5. Build a three-stage feature enhancement module, including hybrid self-attention;

[0012] S6. Construct a multi-stage image data enhancement module, which includes a first-stage feature encoding module, a second-stage feature encoding module, a third-stage feature enhancement module, and image generation convolution;

[0013] S7. Constructing a vascular imaging image data processing model, including an input, a multi-stage image data enhancement module, and an output;

[0014] S8. Vascular imaging image data processing model training and vascular imaging image data processing: The vascular imaging image data set is used to train the vascular imaging image data processing model. After the training is completed, the vascular imaging image data to be processed is obtained and input into the vascular imaging image data processing model to obtain enhanced vascular imaging image data.

[0015] Preferably, in step S1, for the vascular imaging image dataset, a plurality of clear vascular imaging images are first collected, including obtaining a plurality of clear vascular imaging images from professional journals and conference proceedings, and obtaining a plurality of clear vascular imaging image data from a scientific image library. The plurality of clear vascular imaging images are blurred using Gaussian blur, defocus blur, motion blur, and noise addition to obtain a plurality of blurred vascular imaging images, and a plurality of training pairs are formed corresponding to the plurality of clear vascular imaging images, thereby forming a vascular imaging image dataset.

[0016] Preferably, in step S2, for the first-stage feature encoding module, a single fuzzy vascular imaging image data I is input. f , I f ∈R h×w×3 , h, w and 3 are single fuzzy angiography image data I f The height, width and channels of a single blurred vascular imaging image data I f Input into multiple series-connected adaptive Transformer modules to obtain feature F1, F1∈RH×W×C , H, W and C are the height, width and channel of feature F1. A single adaptive Transformer module consists of a Transformer module and an adapter layer. The Transformer module includes a multi-head self-attention mechanism and a feedforward neural network FFN. The adapter layer contains a dimensionality reduction linear layer, a nonlinear activation function, a dimensionality increase linear layer and a residual connection. The adapter layer is inserted into the middle position of the multi-head self-attention mechanism and the feedforward neural network FFN in a single Transformer module to form a single adaptive Transformer module.

[0017] Preferably, in step S2, for the one-stage feature encoding module, an adapted Transformer module is integrated, including a multi-head self-attention mechanism and a feedforward neural network FFN, and an adapter layer is introduced to enhance feature expression through a dimensionality reduction linear layer, a nonlinear activation function, a dimensionality increase linear layer and a residual connection. These adapter layers are inserted between the multi-head self-attention mechanism and the FFN of the Transformer module, so that the feature encoding module can more effectively extract and represent high-level features of the fuzzy vascular imaging image data.

[0018] Preferably, in step S3, for the weight supplementation module, the basic feature F is input WS1 and optimized feature F WS2 , F WS1 ∈R H×W×C , H, W and C are basic features F WS1 The height, width and channel of F WS2 ∈R H×W×C , optimize feature F WS2 and basic features F WS1 The dimensions are consistent, and then the supplementary optimization feature F is obtained through weight supplementation operation WS2+ , F WS2+ ∈R H×W×C , the weight supplement operation is specifically F WS2+ =F WS2 (gt==i)+=α·(μ·Noise1+(1-μ)·Noise2), gt represents the true mask, gt==i is used to determine whether the true category of each pixel is equal to category i, where α is the noise intensity control parameter, Noise1 is the Gaussian noise term, Noise2 is the uniform noise term, μ represents the parameter that controls the ratio of Gaussian noise term to uniform noise term, μ ranges from 0 to 1, and · represents the multiplication operation. N represents Gaussian noise, β is a balance term to prevent the denominator from being too small, γ is the confidence adjustment coefficient, Confidence(i) is the sample confidence of category i, var(i) is the inverse variance of the category sample frequency, U represents uniform noise, and then the feature F is obtained.WSO , F WSO ∈R H×W×C , F WSO =(FFN(SA(DW(F WS2 +)))+F WS2 )⊙F WS1 +F WS1 , where DW stands for deep convolution, SA stands for self-attention operation, FFN stands for feedforward neural network, + stands for element-by-element addition, ⊙ stands for element-by-element product, and feature F WSO is the output of the weight supplement module, feature F WSO , basic features F WS1 and optimized feature F WS2 The dimensions remain consistent.

[0019] Preferably, in step S3, for the weight supplementation module, Gaussian noise and uniform noise are combined to balance the distribution of samples of different categories by dynamically adjusting the feature weights, and the noise intensity is adjusted using the inverse variance of the class sample frequency and the sample confidence to enhance the feature representation of the sparse category. Through the noise injection mechanism, a richer and more robust feature expression is provided, thereby improving the performance and accuracy of the vascular imaging image data processing model when processing unbalanced data sets.

[0020] Preferably, in step S4, for the second-stage feature encoding module, the feature F1 output by the first-stage feature encoding module is obtained, F1∈R H×W×C , H, W and C are the height, width and channel of feature F1, then get feature F 1S , F 1S ∈R H×W×C , F 1S =DW(SA(F1)), SA represents the self-attention operation, DW represents the depth convolution, and then obtain the feature F 1V , F 1V ∈R H×W×C , F 1V =VAE(F1), VAE stands for variational autoencoder, which includes encoder, sampling and decoder, and then obtains the feature F 1M , F 1M ∈R H×W×C , F 1M =F 1S ⊙F 1V ⊙ represents the element-by-element product, and takes feature F1 as the basic feature F WS1 , the feature F 1M As the optimized feature F WS2 , the basic feature F WS1 and optimized feature F WS2 Input into the weight supplement module to obtain feature F WSO , the feature FWSO As feature F2, F2∈R H×W×C , feature F2, feature F 1V and feature F 1M is the output of the two-stage feature encoding module.

[0021] Preferably, in step S4, for the two-stage feature encoding module, a variational autoencoder VAE structure is combined to further compress and reconstruct features through encoders, sampling and decoders, and combined with self-attention operations and deep convolutions, the potential representation of image data is captured through VAE, the diversity and representation ability of features are enhanced, and the feature weights are dynamically adjusted using a weight supplementation module to optimize the representation of features, so that the vascular imaging image data processing model is more robust and accurate when processing samples of different categories.

[0022] Preferably, in step S5, for the three-stage feature enhancement module, the features F2 and F2 output by the two-stage feature encoding module are obtained. 1V and feature F 1M , first obtain the feature F 3V , F 3V ∈R H×W×C , F 3V =VAE(F 1V +F2), VAE stands for variational autoencoder, + stands for element-by-element addition, and then the feature F is obtained by mixing self-attention 3M , F 3M ∈R H×W×C , the mixed self-attention is calculated as F 3M =FFN(Conv(F 1M ⊙SoftMax(QK T ))V), where Conv represents 3×3 convolution, FFN represents feedforward neural network, ⊙ represents element-wise product, SoftMax represents SoftMax activation function, and Q = F2W Q , K=F2W K , V=F2W V , Q stands for query, K stands for key, V stands for value, W Q is the weight matrix for generating query Q, W K is the weight matrix for generating key K, W V Is the weight matrix of the generated value V, and then obtain the enhanced feature F3, F3∈R H×W×C , F3=F 3M ⊙F 3V , ⊙ represents the element-wise product, and the enhanced feature F3 is the output of the three-stage feature enhancement module.

[0023] Preferably, in step S5, for the three-stage feature enhancement module, a hybrid self-attention mechanism is introduced, combined with a variational autoencoder (VAE) structure, to enhance the interactivity and global representation capabilities of features through the relationship between queries, keys, and values. VAE is used to further compress and reconstruct features, and the hybrid self-attention mechanism is used to perform global interaction and enhancement of features, ultimately generating a more robust and diverse feature representation, significantly improving the performance of the vascular imaging image data processing model in processing complex image data tasks.

[0024] Preferably, in step S6, the multi-stage image data enhancement module includes a first-stage feature encoding module, a second-stage feature encoding module, a third-stage feature enhancement module and an image generation convolution module. First, a single blurred vascular imaging image data I is input. f Go to the first-stage feature encoding module and get the feature F1, I f ∈R h×w×3 , h, w and 3 are single fuzzy angiography image data I f The height, width and channel of F1∈R H×W×C , G, W and C are the height, width and channel of feature F1, and then input feature F1 into the two-stage feature encoding module to obtain feature F2 and feature F 1V and feature F 1M , F2∈R H×W×C , F 1V ∈R H×W×C , F 1M ∈R H×W×C , then enter feature F2, feature F 1V and feature F 1M Go to the three-stage feature enhancement module to obtain the enhanced feature F3, F3∈R H×W×C Finally, the enhanced feature F3 is input into the image generation convolution to obtain a single enhanced vascular imaging image data I + , I + ∈R h×w×3 , the image generation convolution is implemented by 3×3 convolution.

[0025] Preferably, in step S6, for the multi-stage image data enhancement module, a one-stage feature encoding, a two-stage feature encoding and a three-stage feature enhancement module are integrated, and high-quality enhanced vascular imaging image data is finally generated through layer-by-layer feature extraction and enhancement. The module combines the adaptive Transformer, the self-attention mechanism, the variational autoencoder VAE and the weight supplementation operation, so that the features are fully extracted and optimized at each stage, thereby improving the details and clarity of the vascular imaging image, and ensuring that the finally generated vascular imaging image data has higher quality and interpretability.

[0026] Compared with the prior art, the present invention has the following technical effects:

[0027] The technical solution provided by the present invention proposes a vascular imaging image data processing model, in which the first-stage feature encoding module applies a multi-head self-attention mechanism and a feedforward neural network to effectively extract high-level features of fuzzy vascular imaging image data. The weight supplementation module dynamically adjusts feature weights by introducing Gaussian noise and uniform noise to balance the distribution of samples of different categories. The second-stage feature encoding module can further compress and reconstruct features through the encoder, sampling and decoder structure of VAE to capture the potential representation of vascular imaging image data. The third-stage feature enhancement module enhances the interactivity and global representation ability of features through a hybrid self-attention mechanism. The multi-stage image data enhancement module extracts and enhances features layer by layer to ultimately generate high-quality enhanced vascular imaging image data. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a flow chart of vascular imaging image data processing provided by the present invention.

[0029] Figure 2 This is a structural diagram of the multi-stage image data enhancement module provided by the present invention.

[0030] Figure 3 This is a single blurred blood vessel imaging image provided by the present invention.

[0031] Figure 4 This is a single enhanced vascular imaging image provided by the present invention. DETAILED DESCRIPTION

[0032] The present invention aims to propose a vascular imaging image optimization method and a vascular imaging image data processing model, wherein the first-stage feature encoding module applies a multi-head self-attention mechanism and a feedforward neural network to effectively extract high-level features of fuzzy vascular imaging image data. The weight supplementation module dynamically adjusts feature weights by introducing Gaussian noise and uniform noise to balance the distribution of samples of different categories. The second-stage feature encoding module can further compress and reconstruct features through the encoder, sampling and decoder structure of VAE to capture the potential representation of vascular imaging image data. The third-stage feature enhancement module enhances the interactivity and global representation ability of features through a hybrid self-attention mechanism. The multi-stage image data enhancement module extracts and enhances features layer by layer to ultimately generate high-quality enhanced vascular imaging image data.

[0033] See Figure 1 As shown, a method for optimizing vascular imaging images in an embodiment of the present application:

[0034] S1. Vascular imaging image data collection: collect 200 clear vascular imaging images to form a vascular imaging image dataset;

[0035] S2, build a one-stage feature encoding module, including an adapted Transformer module;

[0036] S3. Build a weight supplement module, including weight supplement operations;

[0037] S4, construct a two-stage feature encoding module, including a weight supplement module;

[0038] S5. Build a three-stage feature enhancement module, including hybrid self-attention;

[0039] S6. Construct a multi-stage image data enhancement module, which includes a first-stage feature encoding module, a second-stage feature encoding module, a third-stage feature enhancement module, and image generation convolution;

[0040] S7. Constructing a vascular imaging image data processing model, including an input, a multi-stage image data enhancement module, and an output;

[0041] S8. Vascular imaging image data processing model training and vascular imaging image data processing: The vascular imaging image data set is used to train the vascular imaging image data processing model. After the training is completed, the vascular imaging image data to be processed is obtained and input into the vascular imaging image data processing model to obtain enhanced vascular imaging image data.

[0042] Furthermore, in step S1, for the vascular imaging image dataset, 200 clear vascular imaging images are first collected, including 100 clear vascular imaging images obtained from professional journals and conference proceedings, and 100 clear vascular imaging images obtained from the scientific image library. Gaussian blur, defocus blur, motion blur, and noise addition are used to blur the multiple clear vascular imaging images to obtain multiple blurred vascular imaging images, and 200 training pairs corresponding to the multiple clear vascular imaging images are formed, thereby forming a vascular imaging image dataset.

[0043] Furthermore, in step S2, for the first-stage feature encoding module, a single fuzzy vascular imaging image data I is input. f , I f ∈R h×w×3 , h, w and 3 are single fuzzy angiography image data I f The height, width and channels of a single blurred vascular imaging image data I f Input into multiple series-connected adaptive Transformer modules to obtain feature F1, F1∈R H×W×C, H, W and C are the height, width and channel of feature F1. A single adaptive Transformer module consists of a Transformer module and an adapter layer. The Transformer module includes a multi-head self-attention mechanism and a feedforward neural network FFN. The adapter layer contains a dimensionality reduction linear layer, a nonlinear activation function, a dimensionality increase linear layer and a residual connection. The adapter layer is inserted into the middle position of the multi-head self-attention mechanism and the feedforward neural network FFN in a single Transformer module to form a single adaptive Transformer module.

[0044] Furthermore, in step S3, for the weight supplement module, the basic feature F is input WS1 and optimized feature F WS2 , F WS1 ∈R H×W×C , H, W and C are basic features F WS1 The height, width and channel of F WS2 ∈R H×W×C , optimize feature F WS2 and basic features F WS1 The dimensions are consistent, and then the supplementary optimization feature F is obtained through weight supplementation operation WS2+ , F WS2+ ∈R H×W×C , the weight supplement operation is specifically F WS2+ =F WS2 (gt==i)+βα·(μ·Noise1+(1-μ)·Noise2), gt represents the true mask, gt==i is used to determine whether the true category of each pixel is equal to category i, where α is the noise intensity control parameter, Noise1 is the Gaussian noise term, Noise2 is the uniform noise term, μ represents the parameter that controls the ratio of Gaussian noise term to uniform noise term, μ ranges from 0 to 1, and · represents the multiplication operation.

[0045]

[0046] N represents Gaussian noise, β is a balance term to prevent the denominator from being too small, γ is the confidence adjustment coefficient, Confidence(i) is the sample confidence of category i, var(i) is the inverse variance of the category sample frequency, U represents uniform noise, and then the feature F is obtained. WSO , F WSO ∈R H×W×C , F WSO =(FFN(SA(DW(F WS2+ )))+F WS2 )⊙F WS1 +F WS1, where DW stands for deep convolution, SA stands for self-attention operation, FFN stands for feedforward neural network, + stands for element-by-element addition, ⊙ stands for element-by-element product, and feature F WSO is the output of the weight supplement module, feature F WSO , basic features F WS1 and optimized feature F WS2 The dimensions remain consistent.

[0047] Furthermore, in step S4, for the second-stage feature encoding module, the feature F1 output by the first-stage feature encoding module is obtained, F1∈R H×W×C , H, W and C are the height, width and channel of feature F1, then get feature F 1S , F 1S ∈R H×W×C , F 1S =DW(SA(F1)), SA represents the self-attention operation, DW represents the depth convolution, and then obtain the feature F 1V , F 1V ∈R H×W×C , F 1V =VAE(F1), VAE stands for variational autoencoder, which includes encoder, sampling and decoder, and then obtains the feature F 1M , F 1M ∈R H×W×C , F 1M =F 1S ⊙F 1V ⊙ represents the element-by-element product, and takes feature F1 as the basic feature F WS1 , the feature F 1M As the optimized feature F WS2 , the basic feature F WS1 and optimized feature F WS2 Input into the weight supplement module to obtain feature F WSO , the feature F WSO As feature F2, F2∈R H×W×C , feature F2, feature F 1V and feature F 1M is the output of the two-stage feature encoding module.

[0048] Furthermore, in step S5, for the three-stage feature enhancement module, the features F2 and F2 output by the two-stage feature encoding module are obtained. 1V and feature F 1M , first obtain the feature F 3V , F 3V ∈R H×W×C , F 3V =VAE(F 1V+F2), VAE stands for variational autoencoder, + stands for element-by-element addition, and then the feature F is obtained by mixing self-attention 3M , F 3M ∈R H×W×C , the mixed self-attention is calculated as F 3M =FFN(Conv(F 1M ⊙SoftMax(QK T ))V), where Conv represents 3×3 convolution, FFN represents feedforward neural network, ⊙ represents element-wise product, SoftMax represents SoftMax activation function, and Q = F2W Q , K=F2W K , V=f2W V , Q stands for query, K stands for key, V stands for value, W Q is the weight matrix for generating query Q, W K is the weight matrix for generating key K, W V Is the weight matrix of the generated value V, and then obtain the enhanced feature F3, F3∈R H×W×C , F3=F 3M ⊙F 3V , ⊙ represents the element-wise product, and the enhanced feature F3 is the output of the three-stage feature enhancement module.

[0049] Furthermore, in step S6, for the multi-stage image data enhancement module, its structure is as follows Figure 2 As shown, it includes a first-stage feature encoding module, a second-stage feature encoding module, a third-stage feature enhancement module and an image generation convolution module. First, a single blurred vascular imaging image data I is input. f Go to the first-stage feature encoding module and get the feature F1, I f ∈R 2000×2000×3 , 2000, 2000 and 3 are single fuzzy angiography image data I f The height, width and channel of F1∈R 512×512×64 , 512, 512 and 64 are the height, width and channel of feature F1, and then input feature F1 into the two-stage feature encoding module to obtain features F2 and F 1V and feature F 1M , F2∈R 512×512×64 , F 1V ∈R 512×512×64 , F 1M ∈R 512×512×64 , then input feature F2, feature f 1V and feature F 1M Go to the three-stage feature enhancement module to obtain the enhanced feature F3, F3∈R 512×512×64 , and finally enhance the features

[0050] Furthermore, in step S7, for the vascular imaging image data processing model, written in Python language, improved based on the ViT algorithm architecture, using the Pytorch framework, all trained from scratch for 300 times using the AdamW optimizer, with a learning rate of 0.001 and a total training batch size of 900.

[0051] Furthermore, taking a single blurry vascular imaging image with a height and width of 2000px as an example, its source is a larger vascular imaging image with a higher resolution, and it is magnified to view more detailed structures and lesion areas. This magnification will cause the vascular imaging image to be blurred, which may obscure important details. Therefore, it is necessary to perform image enhancement through the vascular imaging image data processing model. At the same time, the vascular imaging image data processing model has lower computational overhead than the traditional ViT architecture and is more suitable for use in real-world scenarios.

[0052] Further, in step S8, the vascular imaging image data processing effect of the vascular imaging image data processing model is as follows: Figure 3 and Figure 4 As shown, Figure 3 A single blurry angiography image is shown. Figure 4 It shows that a single blurred vascular imaging image is input into the vascular imaging image data processing model to obtain a single clear vascular imaging image.

[0053] The above are only preferred embodiments of the present invention. It should be pointed out that those skilled in the art can make several modifications and improvements without departing from the inventive concept of the present invention, and these all fall within the scope of protection of the present invention.

Claims

1. A method for optimizing vascular imaging images, characterized in that: The following steps are involved: S1. Vascular imaging image data collection: multiple clear vascular imaging images are collected to form a vascular imaging image dataset; the vascular imaging image dataset construction method is as follows: first, multiple clear vascular imaging images are collected, including multiple clear vascular imaging images obtained from professional journals and conference proceedings, and multiple clear vascular imaging image data obtained from a scientific image library; the multiple clear vascular imaging images are blurred using Gaussian blur, defocus blur, motion blur, and noise addition to obtain multiple blurred vascular imaging images; and multiple training pairs are formed corresponding to the multiple clear vascular imaging images, thereby forming a vascular imaging image dataset; S2. Construct a one-stage feature encoding module, including an adaptive Transformer module; specifically: for the one-stage feature encoding module, input a single blurred vascular imaging image data , , 、 and 3 are single blurred vascular imaging image data The height, width and channels of a single blurred vascular imaging image data Input into multiple series-connected adaptive Transformer modules to obtain features , , 、 and It is a feature The height, width and channels of a single adaptive Transformer module are composed of a Transformer module and an adapter layer. The Transformer module includes a multi-head self-attention mechanism and a feedforward neural network FFN. The adapter layer contains a dimensionality reduction linear layer, a nonlinear activation function, a dimensionality increase linear layer and a residual connection. The adapter layer is inserted into the middle position of the multi-head self-attention mechanism and the feedforward neural network FFN in a single Transformer module to form a single adaptive Transformer module. S3. Construct a weight supplement module, including weight supplement operations; specifically: for the weight supplement module, input basic features and optimization features , , 、 and Is the basic feature height, width and passage, , optimization features and basic features The dimensions are consistent, and then the weight supplement operation is performed to obtain the supplementary optimization features. , , the weight supplement operation is specifically: , represents the true mask, Used to determine whether the true category of each pixel is equal to the category ,in is the noise intensity control parameter, is the Gaussian noise term, is the uniform noise term, represents the parameter that controls the ratio of Gaussian noise term and uniform noise term, The value ranges from 0 to 1. represents the multiplication operation, , , represents Gaussian noise, It is a balancing term to prevent the denominator from being too small. is the confidence adjustment factor, is a category The sample confidence of is the inverse variance of the class sample frequency, Represents uniform noise, and then obtains the characteristics , , ,in represents depthwise convolution, represents the self-attention operation, represents a feedforward neural network, represents element-by-element addition, Represents element-wise product, feature is the output of the weight supplement module, feature , basic features and optimization features The dimensions remain consistent; S4, construct a two-stage feature encoding module, including a weight supplement module; specifically: for the two-stage feature encoding module, obtain the features output by the first-stage feature encoding module , , 、 and It is a feature The height, width and channel of , and then obtain the features , , , represents the self-attention operation, Represents deep convolution, and then obtains features , , , It stands for variational self-encoder, which includes encoder, sampling and decoder, and then obtains the feature , , , Represents element-wise product, which takes the feature As a basic feature , the features As an optimization feature , the basic features and optimization features Input into the weight supplement module to obtain the feature , the features As a feature , ,feature ,feature and features is the output of the two-stage feature encoding module; S5. Construct a three-stage feature enhancement module, including hybrid self-attention; specifically: for the three-stage feature enhancement module, obtain the features output by the two-stage feature encoding module ,feature and features , first obtain the features , , , represents variational autoencoder, Represents element-wise addition, and then obtains features by mixing self-attention , , the mixed self-attention is calculated as ,in represents 3×3 convolution, represents a feedforward neural network, represents element-wise product, represents the SoftMax activation function, , , , Representative query, Represents a key, Representative value, Generate a query The weight matrix, Is the generated key The weight matrix, Is a generated value The weight matrix of , and then obtain the enhanced features , , , Represents element-wise product, enhanced features is the output of the three-stage feature enhancement module; S6. Construct a multi-stage image data enhancement module, which includes a first-stage feature encoding module, a second-stage feature encoding module, a third-stage feature enhancement module, and image generation convolution; S7. Constructing a vascular imaging image data processing model, including an input, a multi-stage image data enhancement module, and an output; S8. Training of the vascular imaging image data processing model and processing of the vascular imaging image data: using the vascular imaging image dataset to train the vascular imaging image data processing model. After the training is completed, the vascular imaging image data to be processed is obtained and input into the vascular imaging image data processing model to obtain enhanced vascular imaging image data.

2. The method for optimizing vascular imaging images according to claim 1, wherein: In step S6, for the multi-stage image data enhancement module, which includes a first-stage feature encoding module, a second-stage feature encoding module, a third-stage feature enhancement module and image generation convolution, a single blurred vascular imaging image data is first input. Go to the first-stage feature encoding module and get the feature , , 、 and 3 are single blurred vascular imaging image data height, width and passage, , 、 and It is a feature The height, width and channels of , and then input the features Go to the second-stage feature encoding module to get the feature ,feature and features , , , , then enter the feature ,feature and features Go to the three-stage feature enhancement module to obtain enhanced features , , and finally enhance the features Input to the image to generate convolution and obtain a single enhanced vascular imaging image data , , the image generation convolution is implemented by 3×3 convolution.

Citation Information

Patent Citations

  • Multi-stage progressive underwater image enhancement method

    CN114445292A

  • Multi-layer subnet multi-task image restoration method in combination with spatial convergence attention

    CN118195960A