Chronic kidney disease pathological image recognition enhancement system

Abstract

The invention discloses a chronic kidney disease pathological image recognition enhancement system which integrates a data collection module, a kidney disease pathological modeling module, a pathological evolution enhancement module and an image recognition enhancement module, belongs to the technical field of pathological image enhancement, and particularly relates to the chronic kidney disease pathological image recognition enhancement system. Through multi-modal data acquisition, adaptive illumination compensation and image registration reconstruction, renal unit three-dimensional structure modeling is realized; a three-dimensional space-time diagram convolutional network is combined, space structure, time dynamic and clinical features are fused, and the stability and interpretability of pathology evolution prediction are improved; finally, based on the pre-training recognition model and the visual thermodynamic diagram, the precision and clinical availability of pathological image recognition are enhanced, and the intelligent and collaborative level of pathological recognition is effectively improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of pathological image enhancement, and specifically relates to a chronic kidney disease pathological image recognition and enhancement system. Background Art

[0002] The chronic kidney disease pathological image recognition and enhancement system is an auxiliary diagnosis technology that combines artificial intelligence and medical image processing. It can accurately identify and highlight key lesion areas (such as glomerular sclerosis, interstitial fibrosis, etc.) in renal tissue section images through a deep learning model, thereby improving the judgment efficiency and accuracy of pathologists on the progression degree of chronic kidney disease, and plays an important role in assisting decision-making, standardizing diagnosis, and reducing the burden of film reading.

[0003] However, in the existing chronic kidney disease pathological image recognition and enhancement systems, there are technical problems as follows: the traditional pathological image sources mainly rely on 2D slices from a single perspective, which are difficult to reflect the three-dimensional structural relationship of nephrons; image enhancement mainly relies on traditional image enhancement algorithms, lacking a deep enhancement mechanism based on the semantics of structure and pathological progression; and because the recognition module, structural modeling, and pathological evolution analysis are independent of each other, it is difficult to form a unified recognition and enhancement process; in the existing pathological modeling process of kidney disease, there are technical problems such as insufficient registration accuracy of pathological section images leading to obvious structural distortion in three-dimensional reconstruction; traditional modeling methods ignore the spatial relationship modeling of microscopic structures such as cell nuclei and nephrons, making it difficult to support subsequent pathological evolution analysis and spatial lesion tracking; in the existing pathological evolution enhancement process, there are technical problems such as the existing models not considering the spatio-temporal continuity of kidney disease evolution, lacking a mechanism to fuse structural changes and temporal dynamics, and lacking an effective modeling path when integrating clinical indicators; in the existing image recognition and enhancement process, there are technical problems such as the models generally adopting shallow feature extraction strategies, being difficult to obtain discriminative information of key lesion areas, lacking semantic fusion based on structural modeling and pathological evolution, resulting in the recognition task being insensitive to early changes, and at the same time having weak visualization ability, making it difficult to support the interpretable requirements of clinical auxiliary diagnosis. Summary of the Invention

[0004] In view of the above situation, to overcome the defects of the existing technology, the present invention provides a system for enhancing the recognition of chronic kidney disease pathological images. In the existing system for enhancing the recognition of chronic kidney disease pathological images, the traditional pathological image sources mainly rely on 2D slices from a single perspective, which are difficult to reflect the three-dimensional structural relationships of nephrons. Image enhancement mainly relies on traditional image enhancement algorithms, lacking a deep enhancement mechanism based on the semantics of structure and pathological progression. Moreover, since the recognition module, structure modeling, and pathological evolution analysis are independent of each other, it is difficult to form a unified recognition enhancement process. The present solution creatively adopts an overall recognition enhancement idea that combines nephropathy pathological modeling, pathological evolution enhancement, and image recognition enhancement, achieving multi-level collaboration of structure modeling, evolution prediction, and image recognition, significantly improving the accuracy, stability, and clinical interpretability of pathological recognition. In the existing nephropathy pathological modeling process, there are technical problems such as insufficient registration accuracy of pathological slice images leading to obvious structural distortion in three-dimensional reconstruction, and traditional modeling methods ignoring the spatial relationship modeling of microscopic structures such as cell nuclei and nephrons, making it difficult to support subsequent pathological evolution analysis and spatial lesion tracking. The present solution creatively adopts a kidney structure tracking modeling method combined with improved registration for nephropathy pathological modeling, thereby accurately expressing the spatial structure characteristics of nephrons. In the existing pathological evolution enhancement process, there are technical problems such as the existing models not considering the spatio-temporal continuity of nephropathy evolution, lacking a mechanism for fusing structural changes and time dynamics, and lacking an effective modeling path when fusing clinical indicators. The present solution creatively adopts a three-dimensional spatio-temporal graph convolutional network combined with non-deterministic quantization and multi-scale feature fusion enhancement for pathological evolution enhancement, achieving dynamic modeling of kidney structures over time, improving prediction stability under uncertainty perception enhancement, and embedding and fusing clinical-image bimodal features. In the existing image recognition enhancement process, there are technical problems such as the models generally adopting shallow feature extraction strategies, being difficult to obtain discriminative information of key lesion areas, lacking semantic fusion based on structure modeling and pathological evolution, resulting in the recognition task being insensitive to early changes, and having weak visualization ability, making it difficult to support the interpretability requirements of clinical auxiliary diagnosis. The present solution creatively adopts a pre-trained model recognition and analysis method for image recognition enhancement, achieving deep recognition that fuses local-global structure features, structure-evolution-recognition collaborative modeling driven by multi-source data, and interpretable image recognition output based on heatmaps and key region localization.

[0005] The technical solution adopted by the present invention is as follows: A system for enhancing the recognition of chronic kidney disease pathological images provided by the present invention includes a data collection module, a nephropathy pathological modeling module, a pathological evolution enhancement module, and an image recognition enhancement module;

[0006] The data collection module is used for data collection and optimization processing. Through data collection and optimization processing, an enhanced original dataset for pathological image recognition is obtained, and the enhanced original dataset for pathological image recognition is sent to the nephropathy pathological modeling module, the pathological evolution enhancement module, and the image recognition enhancement module;

[0007] The nephropathy pathological modeling module is used for nephropathy pathological modeling. Through nephropathy pathological modeling, renal topology modeling data is obtained, and the renal topology modeling data is sent to the pathological evolution enhancement module;

[0008] The pathological evolution enhancement module is used for pathological evolution enhancement. Through pathological evolution enhancement, comprehensive nephropathy pathological feature data is obtained and the comprehensive nephropathy pathological feature data is sent to the image recognition enhancement module;

[0009] The image recognition enhancement module is used for image recognition enhancement. Through image recognition enhancement, enhanced reference data for chronic nephropathy pathological image recognition is obtained.

[0010] Further, the data collection and optimization processing is used for collecting original data and performing optimization processing. Specifically, through multi-source data collection, original data of chronic nephropathy pathology is obtained, and through image preprocessing and data alignment, an enhanced original dataset for pathological image recognition is obtained, including the following steps: multi-modal data acquisition, adaptive illumination enhancement, data cleaning and optimization, and overall data optimization;

[0011] The multi-modal data acquisition is specifically to obtain original data of chronic nephropathy pathology through multi-source data collection. The original data of chronic nephropathy pathology includes original pathological image data, clinical biochemical data, and pathological text data; by sequentially performing time series data alignment, maximum inter-class variance threshold segmentation optimization processing, and manual data annotation on the original data of chronic nephropathy pathology, an optimized dataset of chronic nephropathy pathology is obtained;

[0012] The optimized dataset of chronic nephropathy pathology includes maximum inter-class variance threshold segmentation optimized images and time series alignment annotation data;

[0013] The adaptive illumination enhancement is specifically to construct an adaptive illumination compensation U-shaped network based on the optimized dataset of chronic nephropathy pathology for color correction and enhancement to obtain a color correction dataset;

[0014] The adaptive illumination compensation U-shaped network includes an encoder structure, a decoder structure, and an optimized loss function;

[0015] The optimized loss function includes a reconstruction loss and a perceptual loss;

[0016] The reconstruction loss specifically uses the L1 norm and is calculated based on the pixel difference between the input and the output;

[0017] The perception loss is specifically achieved by constructing a pre-trained 3D convolutional layer of VGG16, optimizing the images in the dataset according to the chronic kidney disease pathology, extracting perception features, and constructing the perception loss.

[0018] The data cleaning and optimization is specifically to, based on the color correction dataset, perform data cleaning through fuzzy slice detection and perform data sampling enhancement through geometric transformation to obtain a cleaned and optimized dataset.

[0019] The fuzzy slice detection calculates the clarity by setting a clarity metric threshold and a clarity metric matrix.

[0020] The geometric transformation includes rotation, scaling, and translation.

[0021] The overall data optimization is specifically to perform overall enhancement of the chronic kidney disease pathology optimized dataset through the adaptive light enhancement and the data cleaning and optimization to obtain a pathologically enhanced original dataset for image recognition.

[0022] The pathologically enhanced original dataset for image recognition includes enhanced image data, time-series alignment annotation data, unenhanced image data, and enhanced transformation record data.

[0023] Furthermore, the kidney disease pathology modeling is used for 3D reconstruction of the nephron-level model. Specifically, based on the pathologically enhanced original dataset for image recognition, a kidney structure tracking and modeling method combining improved registration is adopted to perform kidney disease pathology modeling to obtain kidney topology modeling data, including the following steps: slice feature matching, transformation matrix optimization, image deformation, nucleus center detection, node graph construction, and kidney 3D reconstruction.

[0024] The slice feature matching is specifically to, based on the pathologically enhanced original dataset for image recognition, take every two adjacent pathological slice images as the original data input, adopt the scale-invariant feature transform algorithm to extract slice feature points to obtain feature point feature descriptor data, based on the feature point feature descriptor data, adopt the standard fast robust binary descriptor algorithm to extract feature vectors, and through two-way consistent matching, obtain candidate feature point matching data.

[0025] The transformation matrix optimization is specifically to introduce the standard thin plate spline transformation algorithm to perform global non-linear deformation on the pathological slice images in the pathologically enhanced original dataset for image recognition, and based on the candidate feature point matching data, construct a minimized objective function for improved registration to perform slice registration optimization to obtain slice transformation matrix data.

[0026] The calculation formula of the minimized objective function for improved registration is:

[0027] ;

[0028] In the formula, F TRA is the minimization objective function for improved registration, T is the slice transformation matrix data output by the standard thin plate spline transformation algorithm, K is the total number of feature points in the candidate feature point matching data, k is the feature point index, FREAK(·) is the standard fast robust binary descriptor algorithm function, I i+1 (·) is the transformed pixel of the (i + 1)-th image, i is the pathological slice image index, T(·) is the standard thin plate spline transformation algorithm function, p k is the position parameter of the k-th feature point, SIFT(·) is the scale-invariant feature transform algorithm function, I i is the transformed pixel of the i-th image, ||·|| 2 is the L2 norm operator, is the regularization coefficient, is the gradient output by the standard thin plate spline transformation algorithm, ||·|| F is the sum of squared partial derivatives operator;

[0029] The image deformation is specifically to perform deformation processing on the pathological slice images in the original dataset for pathological image recognition enhancement according to the slice transformation matrix data to obtain three-dimensional reconstructed aligned pathological slice image data;

[0030] The nucleus center detection is specifically to construct a standard deep learning segmentation model and perform nucleus center detection according to the three-dimensional reconstructed aligned pathological slice image data to obtain nucleus center coordinate detection data;

[0031] The standard deep learning segmentation model specifically uses a pre-trained StarDist deep learning model;

[0032] The node graph construction is specifically to construct a graph structure according to the nucleus center coordinate detection data to obtain nephron node graph data;

[0033] The renal three-dimensional reconstruction is specifically to perform maximum weighted path search and three-dimensional curve fitting in sequence according to the nephron node graph data, and obtain renal topological modeling data through voxel volume construction;

[0034] The maximum weighted path search specifically uses the standard Dijkstra algorithm for path search;

[0035] The renal topological modeling data includes candidate feature point matching data, three-dimensional voxel modeling data of renal tubules, and nephron node graph data.

[0036] Furthermore, the pathological evolution is enhanced for dynamically analyzing the process of chronic kidney disease and performing feature fusion analysis. Specifically, based on the renal topological modeling data and the pathological images, the original dataset is identified and enhanced. A three-dimensional spatio-temporal graph convolutional network combined with non-deterministic quantization and multi-scale feature fusion enhancement is used to enhance the pathological evolution, obtaining comprehensive pathological feature data of kidney disease, including the following steps: spatio-temporal graph modeling, dynamic feature extraction, non-deterministic quantization enhancement, multi-scale feature fusion, and pathological evolution enhancement;

[0037] The spatio-temporal graph modeling is specifically to perform temporal graph modeling based on the renal topological modeling data and the nephron node graph data, constructing temporal nephron node graph data, and obtaining temporal nephron node edge weight data through edge weight calculation;

[0038] The dynamic feature extraction is specifically to construct a three-dimensional graph convolutional network and a temporal convolutional network based on the temporal nephron node graph data and the temporal nephron node edge weight data, performing modeling on the spatial and temporal features of chronic kidney disease, obtaining spatial pathological feature data and temporal pathological feature data of kidney disease;

[0039] The non-deterministic quantization enhancement is specifically to perform pathological progression prediction based on the spatial pathological feature data and the temporal pathological feature data of kidney disease, and through constructing an average prediction estimate and a non-deterministic prediction estimate, perform non-deterministic perception enhancement of pathological progression prediction, obtaining quantized enhanced pathological image feature data;

[0040] The multi-scale feature fusion is specifically to extract low-magnification features and high-magnification features from the quantized enhanced pathological image feature data, and through upsampling and splicing the low-magnification features, obtaining spliced feature data, and through constructing a standard multi-layer perceptron for serum creatinine value feature embedding, obtaining clinical embedded feature data. Through feature fusion of the spliced feature data and the clinical embedded feature data, multi-scale fused pathological feature data is obtained;

[0041] The calculation formula for the feature fusion is:

[0042] ;

[0043] where F final is the multi-scale fused pathological feature data, LayerNorm(·) is the layer normalization operation, Conv 1×1 (·) is the 1×1 feature fusion convolutional layer, Upsample(·) is the upsampling operation function, F 20x is the low-magnification feature, F 40x is the high-magnification feature, MLP(·) is the standard multi-layer perceptron function, sCr is the serum creatinine value feature, W cis the feature embedding weight;

[0044] The pathological evolution is enhanced. Specifically, based on the multi-scale fusion pathological feature data, a joint optimization loss function is constructed for model training to obtain a pathological evolution enhancement model, and the pathological evolution enhancement model is used for pathological process prediction to obtain comprehensive nephropathy pathological feature data.

[0045] Furthermore, the image recognition is enhanced for comprehensive nephropathy pathological image recognition by combining the fusion feature and the three-dimensional reconstruction feature. Specifically, based on the original dataset for enhanced pathological image recognition, the renal topological modeling data, and the comprehensive nephropathy pathological feature data, a pre-trained model recognition analysis method is adopted for image recognition enhancement to obtain reference data for enhanced recognition of chronic nephropathy pathological images, including the following steps: multi-feature joint embedding, visualization optimization, and image recognition enhancement;

[0046] The multi-feature joint embedding is specifically to adopt a pre-trained image recognition model based on the original dataset for enhanced pathological image recognition, the renal topological modeling data, and the comprehensive nephropathy pathological feature data to perform multi-scale feature extraction to obtain standardized image feature vector data;

[0047] The pre-trained image recognition model specifically adopts a pre-trained EfficientNetV2-S model to obtain local features through the block3a layer and global features through the top_conv layer;

[0048] The visualization optimization is specifically to generate feature heatmap data and a list of key area coordinate data by using a data visualization method based on the standardized image feature vector data;

[0049] The image recognition enhancement is specifically to generate a structured image recognition report based on the feature heatmap data and the list of key area coordinate data to obtain reference data for enhanced recognition of chronic nephropathy pathological images.

[0050] The beneficial effects achieved by the present invention by adopting the above solution are as follows:

[0051] (1) In the existing chronic kidney disease pathological image recognition and enhancement system, the traditional pathological image sources mainly rely on 2D slices from a single perspective, which are difficult to reflect the three-dimensional structural relationship of nephrons. Image enhancement mainly relies on traditional image enhancement algorithms, lacking a deep enhancement mechanism based on the semantics of structure and pathological progression. Moreover, since the recognition module, structure modeling, and pathological evolution analysis are independent of each other, it is difficult to form a unified recognition and enhancement process. To solve these technical problems, this solution creatively adopts an overall recognition and enhancement idea that combines kidney disease pathological modeling, pathological evolution enhancement, and image recognition enhancement, achieving multi-level collaboration among structure modeling, evolution prediction, and image recognition, and significantly improving the accuracy, stability, and clinical interpretability of pathological recognition.

[0052] (2) In the existing kidney disease pathological modeling process, there are technical problems such as insufficient registration accuracy of pathological slice images, resulting in obvious structural distortion in three-dimensional reconstruction; traditional modeling methods ignore the spatial relationship modeling of microscopic structures such as cell nuclei and nephrons, making it difficult to support subsequent pathological evolution analysis and spatial lesion tracking. To solve these problems, this solution creatively adopts a kidney structure tracking modeling method that combines improved registration for kidney disease pathological modeling, thereby accurately expressing the spatial structure characteristics of nephrons.

[0053] (3) In the existing pathological evolution enhancement process, there are technical problems such as the existing models not considering the spatio-temporal continuity of kidney disease evolution, lacking a mechanism to fuse structural changes and time dynamics, and lacking an effective modeling path when fusing clinical indicators. To solve these problems, this solution creatively adopts a three-dimensional spatio-temporal graph convolutional network that combines non-deterministic quantization and multi-scale feature fusion enhancement for pathological evolution enhancement, achieving dynamic modeling of kidney structures over time, improving prediction stability under uncertainty perception enhancement, and embedding and fusing clinical-image bimodal features.

[0054] (4) In the existing image recognition enhancement process, there are technical problems such as the models generally adopting shallow feature extraction strategies, making it difficult to obtain discriminative information in key lesion areas, lacking semantic fusion based on structure modeling and pathological evolution, resulting in the recognition task being insensitive to early changes, and having weak visualization ability, making it difficult to support the interpretable requirements of clinical auxiliary diagnosis. To solve these problems, this solution creatively adopts a pre-trained model recognition and analysis method for image recognition enhancement, achieving deep recognition that fuses local-global structure features, structure-evolution-recognition collaborative modeling driven by multi-source data, and interpretable image recognition output based on heatmaps and key region localization. Brief Description of the Drawings

[0055] Figure 1 It is a schematic structural diagram of a chronic kidney disease pathological image recognition and enhancement system provided by the present invention;

[0056] Figure 2Flow diagram of the steps performed by the data collection module;

[0057] Figure 3 Flow diagram of the steps performed by the nephropathy pathology modeling module;

[0058] Figure 4 Flow diagram of the steps performed by the pathology evolution enhancement module;

[0059] Figure 5 Flow diagram of the steps performed by the image recognition enhancement module;

[0060] Figure 6 Example diagram of the feature heat map data obtained by the image recognition enhancement module.

[0061] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation to the present invention. Detailed implementation manners

[0062] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0063] Embodiment 1, refer to Figure 1 , the technical solution adopted by the present invention is as follows: A chronic nephropathy pathology image recognition enhancement system provided by the present invention includes a data collection module, a nephropathy pathology modeling module, a pathology evolution enhancement module, and an image recognition enhancement module;

[0064] The data collection module is used for data collection and optimization processing. Through data collection and optimization processing, an original data set for pathology image recognition enhancement is obtained, and the original data set for pathology image recognition enhancement is sent to the nephropathy pathology modeling module, the pathology evolution enhancement module, and the image recognition enhancement module;

[0065] The nephropathy pathology modeling module is used for nephropathy pathology modeling. Through nephropathy pathology modeling, renal topology modeling data is obtained, and the renal topology modeling data is sent to the pathology evolution enhancement module;

[0066] The pathology evolution enhancement module is used for pathology evolution enhancement. Through pathology evolution enhancement, comprehensive nephropathy pathology feature data is obtained and the comprehensive nephropathy pathology feature data is sent to the image recognition enhancement module;

[0067] The image recognition enhancement module is used for image recognition enhancement. Through image recognition enhancement, reference data for enhanced recognition of chronic kidney disease pathological images is obtained.

[0068] By performing the above operations, in the existing chronic kidney disease pathological image recognition enhancement system, the traditional pathological image sources mainly rely on 2D slices from a single perspective, which are difficult to reflect the three-dimensional structural relationship of nephrons. Image enhancement mainly relies on traditional image enhancement algorithms and lacks a deep enhancement mechanism based on the semantics of structure and pathological progression. Also, because the recognition module, structure modeling, and pathological evolution analysis are independent of each other, it is difficult to form a unified recognition enhancement process. In view of these technical problems, this solution creatively adopts an overall recognition enhancement idea that combines nephropathy pathological modeling, pathological evolution enhancement, and image recognition enhancement, realizing multi-level collaboration among structure modeling, evolution prediction, and image recognition, and significantly improving the accuracy, stability, and clinical interpretability of pathological recognition.

[0069] Example 2. This example is based on the above example. Refer to Figure 2 The data collection and optimization processing is used to collect raw data and perform optimization processing. Specifically, through multi-source data collection, raw data of chronic kidney disease pathology is obtained, and through image preprocessing and data alignment, a raw dataset for enhanced recognition of pathological images is obtained, including the following steps: multi-modal data acquisition, adaptive illumination enhancement, data cleaning and optimization, and overall data optimization;

[0070] The multi-modal data acquisition is specifically to obtain raw data of chronic kidney disease pathology through multi-source data collection. The raw data of chronic kidney disease pathology includes raw pathological image data, clinical biochemical data, and pathological text data. By sequentially performing time series data alignment, maximum inter-class variance threshold segmentation optimization processing, and manual data annotation on the raw data of chronic kidney disease pathology, an optimized dataset of chronic kidney disease pathology is obtained;

[0071] The optimized dataset of chronic kidney disease pathology includes maximum inter-class variance threshold segmentation optimized images and time series alignment annotation data;

[0072] The adaptive illumination enhancement is specifically to construct an adaptive illumination compensation U-shaped network based on the optimized dataset of chronic kidney disease pathology, perform color correction and enhancement, and obtain a color correction dataset;

[0073] The adaptive illumination compensation U-shaped network includes an encoder structure, a decoder structure, and an optimized loss function;

[0074] The encoder adopts a 4-layer convolutional structure, with a stride set to 2 and the number of channels set to [32, 64, 128, 256];

[0075] The decoder adopts a 4-layer transposed convolution structure, specifically using a bilinear upsampling and skip connection structure;

[0076] The optimized loss function includes a reconstruction loss and a perceptual loss;

[0077] The reconstruction loss specifically uses the L1 norm and is calculated based on the pixel difference between the input and output;

[0078] The perceptual loss is specifically obtained by constructing a pre-trained 3D convolutional layer of VGG16, optimizing the images in the chronic kidney disease pathology optimization dataset, extracting perceptual features, and constructing a perceptual loss;

[0079] The calculation formula of the optimized loss function is:

[0080] ;

[0081] In the formula, L is the optimized loss function, y is the input pixel value, specifically extracted from the chronic kidney disease pathology optimization dataset, f(x) is the output pixel value of the adaptive illumination compensation U-shaped network, x is the original image input, is a regulation factor, is the feature data extracted from the input pixel value through the pre-trained 3D convolutional layer of VGG16, is the feature data extracted from the output pixel value of the adaptive illumination compensation U-shaped network through the pre-trained 3D convolutional layer of VGG16, ||·|| 1 is the L1 norm operator, ||·|| 2 is the L2 norm operator;

[0082] The data cleaning and optimization is specifically based on the color correction dataset, using data cleaning through fuzzy slice detection and data sampling enhancement through geometric transformation to obtain a cleaned and optimized dataset;

[0083] For the fuzzy slice detection, by setting a sharpness metric threshold and a sharpness metric matrix, the sharpness is calculated, and the calculation formula is:

[0084] ;

[0085] In the formula, FS is the sharpness calculation value, var(·) is the matrix element variance calculation function, C is the convolution kernel matrix, I is the pixel value of the case image slice in the color correction dataset, and C(·) is the convolution operation representation function;

[0086] The geometric transformation includes rotation, scaling, and translation;

[0087] The overall optimization of the data is specifically to perform the overall enhancement of the optimized data set of chronic kidney disease pathology through the adaptive light enhancement and the data cleaning optimization, so as to obtain the enhanced original data set for pathological image recognition;

[0088] The enhanced original data set for pathological image recognition includes enhanced image data, time-series alignment annotation data, unenhanced image data, and enhanced transformation record data.

[0089] Example 3, this example is based on the above example, refer to Figure 3 , the kidney disease pathology modeling is used to reconstruct the nephron-level model in three dimensions. Specifically, based on the enhanced original data set for pathological image recognition, a kidney structure tracking modeling method combined with improved registration is adopted to perform kidney disease pathology modeling, and kidney topology modeling data is obtained, including the following steps: slice feature matching, transformation matrix optimization, image deformation, nucleus center detection, node graph construction, and kidney three-dimensional reconstruction;

[0090] The slice feature matching is specifically to take every two adjacent pathological slice images in the enhanced original data set for pathological image recognition as the original data input, and use the scale-invariant feature transform algorithm to extract slice feature points to obtain feature point feature descriptor data. Based on the feature point feature descriptor data, use the standard fast robust binary descriptor algorithm to extract feature vectors, and through two-way consistent matching, obtain candidate feature point matching data;

[0091] The transformation matrix optimization is specifically to introduce the standard thin plate spline transformation algorithm to perform global non-linear deformation on the pathological slice images in the enhanced original data set for pathological image recognition, and based on the candidate feature point matching data, construct a minimized objective function for improved registration to perform slice registration optimization, and obtain slice transformation matrix data;

[0092] The calculation formula of the minimized objective function for the improved registration is:

[0093] ;

[0094] In the formula, F TRA is the minimized objective function for the improved registration, T is the slice transformation matrix data output by the standard thin plate spline transformation algorithm, K is the total number of feature points in the candidate feature point matching data, k is the feature point index, FREAK(·) is the standard fast robust binary descriptor algorithm function, I i+1 (·) is the pixel after transformation of the (i + 1)-th image, i is the index of the pathological slice image, T(·) is the standard thin plate spline transformation algorithm function, p k is the position parameter of the k-th feature point, SIFT(·) is the scale-invariant feature transform algorithm function, I iis the transformed pixel of the i-th image, ||·|| 2 is the L2 norm operator, is the regularization coefficient, is the gradient output by the standard thin plate spline transformation algorithm, ||·|| F is the sum of squared partial derivatives operator;

[0095] The image deformation is specifically to perform deformation processing on the pathological slice images in the original data set of pathological image recognition enhancement according to the slice transformation matrix data to obtain three-dimensional reconstructed aligned pathological slice image data;

[0096] The nucleus center detection is specifically to construct a standard deep learning segmentation model and perform nucleus center detection according to the three-dimensional reconstructed aligned pathological slice image data to obtain nucleus center coordinate detection data;

[0097] The standard deep learning segmentation model specifically uses a pre-trained StarDist deep learning model;

[0098] The node graph construction is specifically to perform graph structure construction according to the nucleus center coordinate detection data to obtain nephron node graph data;

[0099] The renal three-dimensional reconstruction is specifically to perform maximum weighted path search and three-dimensional curve fitting in sequence according to the nephron node graph data, and obtain renal topological modeling data through voxel volume construction;

[0100] The maximum weighted path search specifically uses the standard Dijkstra algorithm for path search;

[0101] The renal topological modeling data includes candidate feature point matching data, three-dimensional voxel modeling data of renal tubules, and nephron node graph data.

[0102] By performing the above operations, aiming at the technical problems existing in the existing nephropathy pathological modeling process, such as insufficient registration accuracy of pathological slice images leading to obvious structural distortion in three-dimensional reconstruction; traditional modeling methods ignoring the spatial relationship modeling of microscopic structures such as cell nuclei and nephrons, and being difficult to support subsequent pathological evolution analysis and spatial lesion tracking, this solution creatively adopts a renal structure tracking modeling method combined with improved registration to perform nephropathy pathological modeling, so as to accurately express the spatial structure characteristics of nephrons.

[0103] Example 4, this example is based on the above example, refer to Figure 4, the pathological evolution is enhanced for dynamically analyzing the process of chronic kidney disease and performing feature fusion analysis. Specifically, based on the renal topological modeling data and the pathological images, the original dataset is identified and enhanced. A three-dimensional spatio-temporal graph convolutional network combined with non-deterministic quantization and multi-scale feature fusion enhancement is used to perform pathological evolution enhancement to obtain comprehensive nephropathy pathological feature data, including the following steps: spatio-temporal graph modeling, dynamic feature extraction, non-deterministic quantization enhancement, multi-scale feature fusion, and pathological evolution enhancement;

[0104] The spatio-temporal graph modeling is specifically to perform temporal graph modeling based on the renal topological modeling data and the renal unit node graph data to construct temporal renal unit node graph data, and through edge weight calculation, obtain temporal renal unit node edge weight data;

[0105] The dynamic feature extraction is specifically to construct a three-dimensional graph convolutional network and a temporal convolutional network based on the temporal renal unit node graph data and the temporal renal unit node edge weight data to perform chronic kidney disease spatial feature and temporal feature modeling to obtain nephropathy pathological spatial feature data and nephropathy pathological temporal feature data;

[0106] The calculation formula of the three-dimensional graph convolutional network is:

[0107] ;

[0108] In the formula, is the feature vector representation of the temporal renal unit node v in the (l + 1)-th layer of the three-dimensional graph convolutional layer, which is used to represent the nephropathy pathological spatial feature data. ReLU(·) is a non-linear activation function, v is the temporal renal unit node index, u is the index of the neighboring node of the temporal renal unit node v, is the set of neighboring nodes, is the edge weight at time t, d v is the normalized degree matrix of the temporal renal unit node v, d u is the normalized degree matrix of the neighboring node u of the temporal renal unit node v, is the spatial weight of the l-th layer of the three-dimensional graph convolutional layer, is the feature vector representation of the neighboring node u of the temporal renal unit node in the l-th layer of the three-dimensional graph convolutional layer;

[0109] The calculation formula of the temporal convolutional network is:

[0110] ;

[0111] In the formula, H t+1 is the nephropathy pathological temporal feature data at time t + 1, is the size of the temporal convolution kernel, is the temporal convolution offset index, W t is the temporal convolution weight, is the node feature before the th time convolutional offset interval, where d is the time dilation step parameter;

[0112] The non-deterministic quantization enhancement is specifically to perform pathological progression prediction based on the nephropathy pathological spatial feature data and nephropathy pathological time feature data, and perform non-deterministic perception enhancement of pathological progression prediction by constructing an average prediction estimate and a non-deterministic prediction estimate to obtain quantized enhanced pathological image feature data;

[0113] The calculation formula of the average prediction estimate is:

[0114] ;

[0115] In the formula, is the average prediction estimate, M is the total number of predictions, m is the prediction number index, is the result of the m-th prediction;

[0116] Preferably, the total number of predictions M is set to 50;

[0117] The calculation formula of the non-deterministic prediction estimate is:

[0118] ;

[0119] In the formula, U is the non-deterministic prediction estimate;

[0120] The multi-scale feature fusion is specifically to extract low-magnification features and high-magnification features from the quantized enhanced pathological image feature data, and obtain spliced feature data by upsampling and splicing the low-magnification features, and perform serum creatinine value feature embedding by constructing a standard multi-layer perceptron to obtain clinical embedded feature data, and perform feature fusion on the spliced feature data and the clinical embedded feature data to obtain multi-scale fused pathological feature data;

[0121] The calculation formula of the feature fusion is:

[0122] ;

[0123] In the formula, F final is the multi-scale fused pathological feature data, LayerNorm(·) is the layer normalization operation, Conv 1×1 (·) is a 1×1 feature fusion convolutional layer, Upsample(·) is the upsampling operation function, F 20x is the low-magnification feature, F 40x is the high-magnification feature, MLP(·) is the standard multi-layer perceptron function, sCr is the serum creatinine value feature, W c is the feature embedding weight;

[0124] The pathological evolution is enhanced. Specifically, based on the multi-scale fusion pathological feature data, a joint optimization loss function is constructed for model training to obtain a pathological evolution enhancement model, and the pathological evolution enhancement model is used to predict the pathological process to obtain comprehensive pathological feature data of kidney disease;

[0125] The calculation formula of the joint optimization loss function is:

[0126] ;

[0127] In the formula, L c is the joint optimization loss function, Y is the true pathological progression label value, is the pathological progression value predicted by the model, is the balance factor, KL(·) is the KL divergence calculation function, is the encoded posterior distribution for the given input X, p(z) is the standard normal distribution, and X is the original data input, which is used to represent the multi-scale fusion pathological feature data.

[0128] By performing the above operations, aiming at the technical problems existing in the existing pathological evolution enhancement process, that is, the existing model does not consider the spatio-temporal continuity of kidney disease evolution, lacks a mechanism for fusing structural changes and time dynamics, and lacks an effective modeling path when fusing clinical indicators, this solution creatively adopts a three-dimensional spatio-temporal graph convolutional network combined with non-deterministic quantization and multi-scale feature fusion enhancement for pathological evolution enhancement, realizing dynamic modeling of the renal structure over time, improving the prediction stability under uncertainty perception enhancement, and embedding and fusing clinical-image bimodal features.

[0129] Example 5. Based on the above example, referring to Figure 5 and Figure 6 , the image recognition is enhanced to comprehensively recognize the pathological images of kidney disease by combining the fusion features and the three-dimensional reconstruction features. Specifically, based on the original dataset for enhanced pathological image recognition, the renal topology modeling data, and the comprehensive pathological feature data of kidney disease, a pre-trained model recognition and analysis method is adopted for image recognition enhancement to obtain reference data for enhanced recognition of chronic kidney disease pathological images, including the following steps: multi-feature joint embedding, visualization optimization, and image recognition enhancement;

[0130] The multi-feature joint embedding is specifically to adopt a pre-trained image recognition model based on the original dataset for enhanced pathological image recognition, the renal topology modeling data, and the comprehensive pathological feature data of kidney disease to perform multi-scale feature extraction to obtain standardized image feature vector data;

[0131] The pre-trained image recognition model specifically uses the pre-trained EfficientNetV2-S model to obtain local features through the block3a layer and global features through the top_conv layer;

[0132] The visualization optimization specifically generates feature heatmap data and key region coordinate list data by using a data visualization method based on the standardized image feature vector data;

[0133] The image recognition enhancement specifically generates a structured image recognition report based on the feature heatmap data and the key region coordinate list data to obtain reference data for enhanced recognition of chronic kidney disease pathological images.

[0134] By performing the above operations, in view of the technical problems existing in the existing image recognition enhancement process, such as the model generally adopting a shallow feature extraction strategy, it is difficult to obtain discriminative information of key lesion areas, lacking semantic fusion based on structural modeling and pathological evolution, resulting in the recognition task being insensitive to early changes, and at the same time having weak visualization ability and being difficult to support the interpretable requirements of clinical auxiliary diagnosis, this solution creatively uses a pre-trained model recognition and analysis method for image recognition enhancement, realizing deep recognition that fuses local-global structural features, collaborative modeling of structure-evolution-recognition driven by multi-source data, and interpretable image recognition output based on heatmaps and key region localization.

[0135] It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process and method comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or elements inherent to such a process and method.

[0136] Although the embodiments of the present invention have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions and variations can be made to these embodiments without departing from the principles and spirit of the present invention.

[0137] The above describes the present invention and its implementation manners. This description is not restrictive. What is shown in the drawings is only one of the implementation manners of the present invention, and the actual structure is not limited thereto. Generally speaking, if those of ordinary skill in the art are inspired by it and design similar structural manners and embodiments without creative efforts without departing from the purpose of the present invention, they shall fall within the protection scope of the present invention.

Claims

1. A chronic kidney disease pathology image recognition and enhancement system, characterized by: Data collection module, renal pathology modeling module, pathology evolution enhancement module and image recognition enhancement module; The data collection module is used for data collection and optimization processing, and obtains the pathological image recognition enhanced original data set through data collection and optimization processing, and sends the pathological image recognition enhanced original data set to the renal pathology modeling module, the pathology evolution enhancement module and the image recognition enhancement module; The renal pathology modeling module is used for renal pathology modeling, adopts a renal structure tracking modeling method combined with improved registration to perform renal pathology modeling, obtains renal topology modeling data, and sends the renal topology modeling data to the pathology evolution enhancement module, including the following steps: slice feature matching, transformation matrix optimization, image deformation, cell nucleus center detection, node graph construction and renal three-dimensional reconstruction; The transformation matrix optimization specifically introduces a standard thin plate spline transformation algorithm to perform full nonlinear deformation of the pathological slice image in the pathological image recognition and enhancement original data set, and constructs a minimization objective function for improved registration based on the candidate feature point matching data to perform slice registration optimization; The pathology evolution enhancement module is used for pathology evolution enhancement, and adopts a three-dimensional spatiotemporal graph convolutional network combined with non-deterministic quantization and multi-scale feature fusion enhancement to perform pathology evolution enhancement, obtain comprehensive feature data of renal pathology, and send the comprehensive feature data of renal pathology to the image recognition enhancement module, including the following steps: spatiotemporal graph modeling, dynamic feature extraction, non-deterministic quantization enhancement, multi-scale feature fusion and pathology evolution enhancement; The image recognition enhancement module is used for image recognition enhancement, and obtains chronic kidney disease pathology image recognition enhancement reference data through image recognition enhancement.

2. A chronic kidney disease pathology image recognition and enhancement system according to claim 1, characterized in that: The data collection and optimization processing is used to collect raw data and perform optimization processing, specifically to obtain chronic kidney disease pathology raw data through multi-source data collection, and to obtain pathology image recognition enhanced raw data set through image preprocessing and data alignment, including the following steps: multimodal data acquisition, adaptive lighting enhancement, data cleaning optimization and overall data optimization.

3. A chronic kidney disease pathology image recognition and enhancement system according to claim 2, characterized in that: The multimodal data acquisition specifically includes obtaining original chronic kidney disease pathology data through multi-source data collection, wherein the original chronic kidney disease pathology data includes original pathology image data, clinical biochemical data and pathology text data; obtaining an optimized chronic kidney disease pathology data set by sequentially performing time series data alignment, maximum inter-class variance threshold segmentation optimization processing and manual data labeling on the original chronic kidney disease pathology data; The chronic kidney disease pathology optimization dataset includes maximum inter-class variance threshold segmentation optimization images and time series alignment annotation data; The adaptive illumination enhancement is specifically to construct an adaptive illumination compensation U-type network based on the chronic kidney disease pathology optimization dataset, perform color correction enhancement, and obtain a color correction dataset; The adaptive illumination compensation U-type network includes an encoder structure, a decoder structure and an optimization loss function; The optimization loss function includes reconstruction loss and perception loss; The reconstruction loss is specifically calculated using the L1 norm based on the difference between input and output pixels; The perceptual loss is specifically achieved by constructing a pre-trained VGG16 three-dimensional convolutional layer, extracting perceptual features and constructing perceptual loss based on images in the chronic kidney disease pathology optimization dataset; The data cleaning and optimization is specifically to perform data cleaning by fuzzy slice detection based on the color correction data set, and to perform data sampling enhancement by geometric transformation to obtain a cleaned and optimized data set; The blur slice detection performs clarity calculation by setting a clarity measurement threshold and a clarity measurement matrix; The geometric transformation includes rotation, scaling and translation; The overall data optimization is specifically to perform overall enhancement of the chronic kidney disease pathology optimization data set through the adaptive illumination enhancement and the data cleaning optimization to obtain the pathology image recognition enhanced original data set; The pathological image recognition enhanced original data set includes enhanced image data, time-series alignment annotation data, unenhanced image data and enhanced transformation record data.

4. The chronic kidney disease pathology image recognition and enhancement system according to claim 3, characterized in that: The renal pathology modeling is used for three-dimensional reconstruction of the renal unit-level model. Specifically, based on the pathological image recognition enhanced original data set, a renal structure tracking modeling method combined with improved registration is used to perform renal pathology modeling to obtain renal topology modeling data, including the following steps: slice feature matching, transformation matrix optimization, image deformation, cell nucleus center detection, node graph construction and renal three-dimensional reconstruction.

5. The chronic kidney disease pathology image recognition and enhancement system according to claim 4, characterized in that: The slice feature matching is specifically to input every two adjacent pathological slice images as raw data according to the pathological image recognition enhanced original data set, and use a scale-invariant feature transformation algorithm to extract slice feature points to obtain feature point feature descriptor data, and use a standard fast and robust binary descriptor algorithm to extract feature vectors according to the feature point feature descriptor data, and obtain candidate feature point matching data through bidirectional consistent matching; The transformation matrix optimization specifically introduces a standard thin plate spline transformation algorithm, performs full-image nonlinear deformation on the pathological slice image in the pathological image recognition and enhancement original data set, and constructs a minimization objective function for improved registration based on the candidate feature point matching data, performs slice registration optimization, and obtains slice transformation matrix data; The calculation formula of the minimized objective function of the improved registration is: ； In the formula, F TRA is the minimization objective function of the improved registration, T is the slice transformation matrix data output by the standard thin plate spline transformation algorithm, K is the total number of feature points of the candidate feature point matching data, k is the feature point index, FREAK(·) is the standard fast robust binary descriptor algorithm function, I i+1 (·) is the transformed pixel of the i+1th image, i is the pathological slice image index, T(·) is the standard thin plate spline transformation algorithm function, p k is the position parameter of the kth feature point, SIFT(·) is the scale-invariant feature transformation algorithm function, I i is the transformed pixel of the ith image, ||·||2 is the L2 norm operator, is the regularization coefficient, is the gradient output by the standard thin plate spline transform algorithm, ||·|| F is the partial derivative square sum operator; The image deformation is specifically to deform the pathological slice image in the pathological image recognition and enhancement original data set according to the slice transformation matrix data to obtain three-dimensional reconstructed aligned pathological slice image data; The cell nucleus center detection is specifically to construct a standard deep learning segmentation model, perform cell nucleus center detection based on the three-dimensional reconstructed aligned pathological slice image data, and obtain cell nucleus center coordinate detection data; The standard deep learning segmentation model specifically adopts the pre-trained StarDist deep learning model; The node graph construction is specifically to construct a graph structure based on the cell nucleus center coordinate detection data to obtain the renal unit node graph data; The three-dimensional kidney reconstruction is specifically to perform maximum weighted path search and three-dimensional curve fitting in sequence according to the renal unit node graph data, and obtain renal topological modeling data through voxel volume construction; The maximum weighted path search specifically uses a standard Dijkstra algorithm to perform path search; The renal topology modeling data includes candidate feature point matching data, renal tubule three-dimensional voxel modeling data and renal unit node graph data.

6. The chronic kidney disease pathology image recognition and enhancement system according to claim 5, characterized in that: The pathological evolution enhancement is used to dynamically analyze the progress of chronic kidney disease and perform feature fusion analysis. Specifically, based on the renal topology modeling data and the pathological image recognition enhanced original data set, a three-dimensional spatiotemporal graph convolutional network combined with non-deterministic quantization and multi-scale feature fusion enhancement is used to perform pathological evolution enhancement to obtain comprehensive feature data of renal pathology, including the following steps: spatiotemporal graph modeling, dynamic feature extraction, non-deterministic quantization enhancement, multi-scale feature fusion and pathological evolution enhancement; The spatiotemporal graph modeling is specifically to perform time-series graph modeling based on the renal topology modeling data and the renal unit node graph data, construct the time-series renal unit node graph data, and obtain the time-series renal unit node edge weight data through edge weight calculation; The dynamic feature extraction is specifically to construct a three-dimensional graph convolution network and a time convolution network based on the time series renal unit node graph data and the time series renal unit node edge weight data, perform chronic kidney disease spatial feature and time feature modeling, and obtain renal pathology spatial feature data and renal pathology time feature data; The non-deterministic quantitative enhancement is specifically to predict the pathological progression based on the renal pathological spatial feature data and the renal pathological temporal feature data, and to perform non-deterministic perceptual enhancement of the pathological progression prediction by constructing an average prediction estimate and a non-deterministic prediction estimate, so as to obtain quantitatively enhanced pathological image feature data; The multi-scale feature fusion is specifically to extract low-magnification features and high-magnification features from the quantized enhanced pathological image feature data, and obtain spliced ​​feature data by upsampling and splicing the low-magnification features, and obtain clinical embedded feature data by constructing a standard multi-layer perceptron to embed serum creatinine value features, and obtain multi-scale fused pathological feature data by feature fusion of the spliced ​​feature data and the clinical embedded feature data; The calculation formula of the feature fusion is: ； In the formula, F final is the multi-scale fusion pathological feature data, LayerNorm(·) is the layer normalization operation, Conv 1×1 (·) is a 1×1 feature fusion convolutional layer, Upsample(·) is the upsampling operation function, and F 20x It is a low-magnification feature, F 40x is a high-rate feature, MLP(·) is a standard multilayer perceptron function, sCr is a serum creatinine value feature, W c is the feature embedding weight; The pathological evolution enhancement is specifically to construct a joint optimization loss function for model training based on the multi-scale fusion pathological feature data to obtain a pathological evolution enhancement model, and use the pathological evolution enhancement model to predict the pathological process to obtain comprehensive kidney disease pathology feature data.

7. The chronic kidney disease pathology image recognition and enhancement system according to claim 6, characterized in that: The image recognition enhancement is used to combine fusion features and three-dimensional reconstruction features to perform comprehensive renal pathology image recognition. Specifically, based on the pathology image recognition enhancement original data set, the renal topology modeling data and the renal pathology comprehensive feature data, a pre-trained model recognition and analysis method is used to perform image recognition enhancement to obtain chronic kidney disease pathology image recognition enhancement reference data, including the following steps: multi-feature joint embedding, visualization optimization and image recognition enhancement.

8. The chronic kidney disease pathology image recognition and enhancement system according to claim 7, characterized in that: The multi-feature joint embedding is specifically to extract multi-scale features using a pre-trained image recognition model based on the pathological image recognition enhanced original data set, the renal topology modeling data and the renal pathology comprehensive feature data to obtain standardized image feature vector data; The pre-trained image recognition model specifically adopts the pre-trained EfficientNetV2-S model, obtains local features through the block3a layer, and obtains global features through the top_conv layer; The visualization optimization is specifically to generate feature heat map data and key area coordinate list data using a data visualization method based on the standardized image feature vector data; The image recognition enhancement is specifically to generate a structured image recognition report based on the characteristic heat map data and the key area coordinate list data to obtain chronic kidney disease pathology image recognition enhancement reference data.

Images