Endoscope image intelligent evaluation method for ulcerative colitis

Abstract

The invention relates to an intelligent endoscope image evaluation method for ulcerative colitis, and the method comprises the steps: synchronously collecting video streams and three-dimensional point cloud data of a colonic mucosa through an endoscope system equipped with a structured light depth sensor, and constructing a three-dimensional coordinate system based on a colon anatomy trend; based on the three-dimensional point cloud data, constructing a complex topological structure on the surface of the colonic mucosa, and calculating a continuous homology feature set of the lesion area; and based on the persistent homology feature set, constructing a multi-scale graph neural network model of ulcerative colitis and Crohn disease specificity. By implementing the scheme, the structural and topological modeling of the colon mucosa lesion area can be realized, and the morphological characteristic difference between ulcerative colitis and Crohn's disease can be effectively captured. The multi-scale graph neural network fuses macroanatomical segmentation and micropathology features, efficient distinguishing of continuous and jumping lesions is achieved, finally, an intelligent and visual endoscope evaluation report is generated, and the accuracy and real-time performance of auxiliary diagnosis in an operation are improved.

Description

Technical Field

[0001] This application relates to the field of medical imaging, and particularly to an intelligent evaluation method for endoscopic images of ulcerative colitis. Background Art

[0002] Ulcerative Colitis (UC) is a chronic inflammatory bowel disease characterized by starting from the rectum and extending continuously proximally. Its typical pathological changes include extensive erosion, ulcers, crypt distortion, and pseudopolyp formation in the colonic mucosa. The clinical diagnosis of ulcerative colitis mainly relies on colonoscopy. However, traditional diagnostic methods are mostly based on manual observation of video images by doctors, which have significant subjectivity and limitations relying on experience.

[0003] In recent years, with the continuous deepening of the application of artificial intelligence technology in the field of medical image processing, endoscopic assisted diagnosis systems have gradually introduced deep learning algorithms and play an important role in lesion recognition, severity assessment, etc. However, existing AI evaluation methods mainly focus on ulcer recognition or regional grading of two-dimensional images, and rarely consider the three-dimensional spatial continuity structure of the colon. There are still significant deficiencies, especially in the full-segment continuity analysis of rectal segment lesions, the recognition of crypt structure distortion, and the topological structure difference modeling with other inflammatory bowel diseases such as Crohn's Disease (CD).

[0004] In addition, since both ulcerative colitis and Crohn's disease may present as mucosal erosion or atypical ulcers in the early stage, it is difficult to accurately distinguish them in terms of the surface morphology of the images. Traditional algorithms often ignore the anatomical extension law and homology continuity of pathological features of colonic lesions in the three-dimensional structure. At the same time, existing methods usually have difficulty effectively integrating the macroscopic anatomical scale and the microscopic structure scale, and also lack the ability to provide real-time and interpretable augmented reality prompts in a dynamic endoscopic environment. Summary of the Invention

[0005] The purpose of this application is to solve the problems that traditional endoscopic diagnosis relies on manual experience and has strong subjectivity in the recognition of colonic lesions, and that existing AI methods are difficult to express the three-dimensional spatial continuity, crypt microstructure distortion characteristics, and topological differences between ulcerative colitis and Crohn's disease, and to improve the accuracy and intelligent level of diagnosis.

[0006] According to one aspect of this application, there is provided an intelligent evaluation method for endoscopic images of ulcerative colitis, characterized by including: Synchronously collect the video stream and three-dimensional point cloud data of the colonic mucosa through an endoscopic system equipped with a structured light depth sensor, and construct a three-dimensional coordinate system based on the anatomical orientation of the colon. The three-dimensional coordinate system includes the images of the lesion area in multiple consecutive frames and their depth coordinates distributed along the taenia coli; Based on the three-dimensional point cloud data, construct a simplicial topological structure on the surface of the colonic mucosa, and calculate the persistent homology feature set of the lesion area; Based on the persistent homology feature set, construct a multi-scale graph neural network model specific to ulcerative colitis and Crohn's disease, including: Macro-scale graph: Divide the colon into several segments, and use the average number of connected components, ulcer density, and the probability of lesion spreading along the taenia coli in each segment as node features and edge weights; Micro-scale graph: Use individual ulcer lesions as graph nodes, and the graph nodes include the following structural pathological features: The depth-width ratio of a single ulcer, used to distinguish superficial ulcers from penetrating ulcers. When the depth-width ratio is lower than a preset depth-width ratio threshold, it indicates the superficial ulcer feature of ulcerative colitis; The sharpness of the ulcer edge, quantified by the boundary gradient amplitude and its standard deviation. When the sharpness is higher than a preset sharpness threshold, it indicates active inflammation; The minimum curvature similarity between ulcers, used to measure the spatial continuity of the ulcer surface morphology. When the minimum curvature similarity is higher than a preset similarity threshold, it is determined to be a continuous distribution.

[0007] Preferably, the persistent homology feature set includes: Total rectal continuity index: By analyzing the coverage ratio and spatial continuity of the lesions in the rectal segment along the taenia coli, quantify whether the lesions involve the entire rectal segment. When the coverage ratio exceeds a preset coverage threshold, it is determined to be a feature of ulcerative colitis; Number of connected components: Used to quantify the continuous distribution pattern of lesions along the taenia coli; Number of circular structures: Used to identify the closed-loop features of pseudopolyps formation.

[0008] Preferably, it further includes: Dynamically fuse the features of the macro-scale graph and the micro-scale graph through a deformable attention mechanism to generate a joint feature vector; Based on the joint feature vector, output an endoscopic evaluation report including the discrimination result of ulcerative colitis / Crohn's disease, lesion grading, and pseudopolyp risk warning.

[0009] Preferably, the calculation of the total rectal continuity index includes: Segment the three-dimensional point cloud data of the rectal segment, and calculate the proportion of the covered length of the lesion area to the total length of the rectum; Analyze the topological connectivity of the lesion boundary through the Alpha complex algorithm. When the number of connected components is 1 and the coverage ratio exceeds a preset coverage threshold, it is determined to be a feature of ulcerative colitis; The distortion rate of the rectal mucosal crypt structure in the microscopic scale map is calculated through the morphological parameters of the crypt openings. If the distortion rate exceeds the preset distortion threshold, it is marked as a typical pathological change of ulcerative colitis.

[0010] Preferably, in the macroscopic scale map, when the probability of the lesion spreading along the colonic bands exceeds the first preset threshold, it is determined as a continuous lesion; When the spreading probability is lower than the second preset threshold and the number of connected components exceeds the third preset threshold, it is determined as a skip lesion of Crohn's disease; The edge weight in the microscopic scale map is jointly determined by the minimum curvature similarity between ulcers and the correlation of the crypt distortion rate. If the correlation exceeds the fourth preset threshold, the determination of ulcerative colitis is strengthened.

[0011] Preferably, in the macroscopic scale map, the ulcer density is calculated by the product of the number of ulcers per unit area and the sectional weight coefficient to amplify the influence of the lesions in a specific section; The edge sharpness in the microscopic scale map is the standard deviation of the gradient amplitude in the ulcer boundary region. When the gradient amplitude exceeds the fifth preset threshold, it is marked as an active inflammation focus, and when the gradient amplitude is lower than the sixth preset threshold, it indicates fibrotic changes in Crohn's disease.

[0012] Preferably, the deformable attention mechanism includes: Rectum - priority attention module: Dynamically enhance the attention weight of the features in the rectal region based on the weight coefficient of the rectal segment; Cross - scale feature fusion module: Jointly optimize the macroscopic anatomical segments and microscopic crypt distortion features through the multi - head attention mechanism.

[0013] Preferably, the endoscopic evaluation report generates the differential diagnosis results of ulcerative colitis / Crohn's disease according to the following rules: If the continuity index of the entire rectal segment exceeds the preset coverage threshold and the crypt distortion rate exceeds the preset distortion threshold, it is determined as ulcerative colitis; If the lesions are distributed in a skip pattern and the crypt distortion rate is lower than the seventh preset threshold, it is determined as Crohn's disease; The endoscopic evaluation report presents the analysis results in combination with the heat map of the lesions in the rectal segment and the three - dimensional reconstruction map of the crypt structure.

[0014] Preferably, it further includes a model optimization step based on the pathological differences between ulcerative colitis and Crohn's disease, including: Generate adversarial samples that conform to the rectal continuity diffusion law of ulcerative colitis and the skip lesion characteristics of Crohn's disease, and the generation process is respectively restricted by rectal anatomical constraints or random spatial distribution constraints; Introduce a topological consistency loss function and a discrimination loss function into the discriminator to optimize the structural rationality and class discriminability of the generated lesions.

[0015] Preferably, the adversarial examples are generated by a generator, and the generator includes: Ulcerative colitis branch: Input the anatomical coding of the rectal segment and output the continuous lesion point cloud; Crohn's disease branch: Input the random position coding and output the skip lesion point cloud; The discriminator is a multi-scale convolutional network structure, and the generation effect is jointly optimized by a topological consistency loss function, an adversarial loss function, and a total loss function.

[0016] The present application has the following beneficial effects: A three-dimensional endoscopic image intelligent evaluation method integrating macroscopic and microscopic features is proposed. Aiming at the problem that it is difficult for existing two-dimensional image recognition to reflect the spatial continuity of colon lesions and the changes in crypt microstructures, a structured light depth sensor is used to obtain the video stream and three-dimensional point cloud data of the colon mucosa, and a three-dimensional coordinate system and a complex topological structure are constructed based on the anatomical orientation of the colon, so as to extract the persistent homology features of the lesion area. On this basis, a graph neural network model integrating macroscopic scales (such as lesion connectivity, diffusion probability) and microscopic scales (such as ulcer depth-width ratio, edge sharpness, crypt distortion rate) is constructed to realize the comprehensive expression of the typical features of ulcerative colitis. Through the introduction of three-dimensional structures and multi-scale graph modeling, ulcerative colitis and Crohn's disease can be distinguished more accurately, and the intelligence and accuracy levels of lesion recognition and disease typing are improved. This method effectively enhances the spatial continuity and structural interpretability of colon lesion analysis, and provides a more clinically valuable auxiliary decision-making basis for endoscopic diagnosis. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0018] Figure 1 It is a logic block diagram of the intelligent evaluation method for endoscopic images of ulcerative colitis according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0019] To facilitate the understanding of the present application, the present application will be described more comprehensively below with reference to the relevant drawings. The preferred embodiments of the present application are shown in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, these embodiments are provided to make the understanding of the disclosure of the present application more thorough and comprehensive.

[0020] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terms used in the description of this application herein are for the purpose of describing specific embodiments only and are not intended to limit this application. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.

[0021] Please refer to Figure 1 , an embodiment of this application provides an intelligent evaluation method for endoscopic images of ulcerative colitis, including: S10. Synchronously collect the video stream and three-dimensional point cloud data of the colonic mucosa through an endoscopic system equipped with a structured light depth sensor, and construct a three-dimensional coordinate system based on the anatomical direction of the colon. The three-dimensional coordinate system includes the images of the lesion area in multiple consecutive frames and their depth coordinates distributed along the taenia coli.

[0022] The purpose of this step is to introduce three-dimensional information on the basis of traditional two-dimensional endoscopic images to solve the problem of the lack of spatial structure caused by relying only on the image plane. Through the structured light depth sensor, the depth information corresponding to each frame of the image can be synchronously obtained to generate the three-dimensional point cloud of the colonic mucosa. These point cloud data combined with the video frame position can be used to reconstruct the three-dimensional surface topography of the colon, and a three-dimensional coordinate system can be constructed according to the anatomical structure direction (i.e., the taenia coli direction) to form a continuous spatial positioning framework, thus providing a spatial reference for subsequent topological modeling and input of the graph neural network.

[0023] S20. Based on the three-dimensional point cloud data, construct a simplicial complex topological structure on the surface of the colonic mucosa, and calculate the persistent homology feature set of the lesion area.

[0024] The purpose of this step is to introduce the means of topological data analysis to quantitatively model the spatial structure of the lesion area of the colonic mucosa. Through the three-dimensional point cloud data, a surface mesh or simplicial complex structure can be constructed to perform topological analysis on the morphology of the mucosa surface, such as depressions and protrusions. Persistent Homology is a tool in topology for characterizing high-order structures such as "holes" or "connected regions" in space. By analyzing the "persistence" of these features as the scale changes, the homology features of the lesion area can be stably extracted, such as the area, connectivity, and continuity of the spatial distribution of ulcers. These features are of great value in distinguishing the extensive, superficial, and continuous distribution of ulcerative colitis from the skip and penetrating lesions of Crohn's disease.

[0025] S30. Based on the persistent homology feature set, construct a multi-scale graph neural network model specific to ulcerative colitis and Crohn's disease. This step aims to further transform topological features into graph-structured data and achieve the classification and reasoning of high-order spatial features through a multi-scale graph neural network (GNN). Considering that inflammatory bowel disease has different manifestations at different scales (the entire colon vs. a single lesion), two graph models, macroscopic and microscopic, are designed, including: Macroscopic-scale graph: Divide the colon into several segments, and use the mean number of connected components, ulcer density, and the probability of lesion spread along the tenia coli in each segment as node features and edge weights.

[0026] At the macroscopic scale, divide the entire colon into continuous segments (such as the rectum, sigmoid colon, etc.) in anatomical order, and each segment forms a node in the graph. The features of the node include: Mean number of connected components: Reflects whether the distribution of lesions is jumpy or continuous; Ulcer density: Measures the ulcer burden within this segment; Probability of spread along the tenia coli: Describes whether the lesion spreads proximally along the anatomical path.

[0027] These features jointly describe the "breadth" and "distribution pattern" of the lesion and are representative for distinguishing the continuous expansion of UC from the skip lesions of CD.

[0028] Microscopic-scale graph: Use individual ulcer lesions as graph nodes. At the microscopic scale, the focus is on the morphological features of each ulcer itself for fine-grained identification of the nature of the lesion. Each ulcer is a node, and the graph nodes include the following structural pathological features: The depth-width ratio of a single ulcer, used to distinguish superficial ulcers from penetrating ulcers. When the depth-width ratio is lower than the preset depth-width ratio threshold, it indicates the superficial ulcer characteristics of ulcerative colitis. Used to distinguish the depth of ulcers. UC is usually a superficial ulcer with a small depth-width ratio; CD is mostly a penetrating deep ulcer with a large depth-width ratio.

[0029] The sharpness of the ulcer edge, quantified by the boundary gradient amplitude and its standard deviation. When the sharpness is higher than the preset sharpness threshold, it indicates active inflammation. Quantified by the boundary gradient intensity and its standard deviation, reflecting the degree of inflammation activity. Sharp edges are common in active UC.

[0030] The minimum curvature similarity between ulcers, used to measure the spatial continuity of the ulcer surface morphology. When the minimum curvature similarity is higher than the preset similarity threshold, it is determined to be a continuous distribution. Used to judge whether multiple ulcers are continuously distributed in three-dimensional space. A high similarity means a consistent morphology, indicating the extensive mucosal lesion characteristics of UC.

[0031] Implementing the technical solution of this embodiment, a three-dimensional endoscopic image intelligent evaluation method integrating macroscopic and microscopic features is proposed. Aiming at the problem that it is difficult for existing two-dimensional image recognition to reflect the spatial continuity of colonic lesions and the changes in crypt microstructures, a structured light depth sensor is used to obtain the video stream and three-dimensional point cloud data of the colonic mucosa, and a three-dimensional coordinate system and a complex topological structure are constructed based on the colonic anatomical orientation, so as to extract the persistent homology features of the lesion area. On this basis, a graph neural network model integrating macroscopic scales (such as lesion connectivity, diffusion probability) and microscopic scales (such as ulcer depth-width ratio, edge sharpness, crypt distortion rate) is constructed to achieve the comprehensive expression of the typical features of ulcerative colitis. Through the introduction of three-dimensional structures and multi-scale graph modeling, ulcerative colitis and Crohn's disease can be distinguished more accurately, and the intelligent and precise level of lesion recognition and disease typing can be improved. This method effectively enhances the spatial continuity and structural interpretability of colonic lesion analysis, and provides a more clinically valuable auxiliary decision-making basis for endoscopic diagnosis.

[0032] In this embodiment, the persistent homology feature set includes: Full-segment rectal continuity index: By analyzing the coverage ratio and spatial continuity of the lesions in the rectal segment along the tenia coli, it quantifies whether the lesions involve the entire rectal segment. When the coverage ratio exceeds the preset coverage threshold, it is determined as a feature of ulcerative colitis; Number of connected components: Used to quantify the continuous distribution pattern of the lesions along the tenia coli; Number of circular structures: Used to identify the closed-loop features of pseudopolyp formation.

[0033] It should be noted that the persistent homology feature set includes the following key indicators: Full-segment rectal continuity index, which is obtained by quantitatively analyzing the spatial coverage ratio and continuity of the lesions in the rectal segment along the tenia coli. The specific method is to calculate the proportion of the lesion area covered in the three-dimensional coordinate system and combine the topological structure to judge whether the lesions are continuously distributed. When the coverage ratio exceeds the preset coverage threshold, it is determined that the lesions involve the entire rectal segment, which conforms to the typical continuous and extensive distribution characteristics of ulcerative colitis (UC). This indicator helps to distinguish UC from Crohn's disease (CD) because CD usually does not show persistent extensive involvement of the rectum.

[0034] Number of connected components, which is used to quantify the continuous or discontinuous distribution of the lesion area on the tenia coli. A smaller and continuous number of connected components indicates that the lesion area is spatially connected completely, which conforms to the characteristics of UC continuous lesions. A larger number of connected components indicates that the lesions are discontinuously scattered, which is a typical manifestation of CD.

[0035] The number of circular structures, which is used to identify the closed-loop structures formed by pseudopolyps within the lesion area. The calculation of the number of circular structures is based on the detection of one-dimensional homology groups (loops or "holes") in persistent homology analysis. The closed loops formed by pseudopolyps appear as topological circular structures, and this feature can assist in judging the pathological type and severity of the lesion.

[0036] Implementing this technical solution, by introducing a persistent homology feature set and using three-dimensional point cloud data for topological structure analysis, it is possible to quantify the spatial distribution characteristics of colonic mucosal lesions, accurately reflect the continuity, discontinuity, and circular structure characteristics of the lesions. The whole-segment rectal continuity index effectively distinguishes the differences in the lesion scope and continuity between ulcerative colitis and Crohn's disease. The number of connected components further reveals the spatial distribution pattern of the lesions, while the number of circular structures improves the accuracy of pathological analysis for the identification of pseudopolyp formation. Overall, this method breaks through the limitations of traditional two-dimensional image analysis, enhances the three-dimensional spatial understanding and quantitative judgment ability of the lesions, thereby improving the accuracy of endoscopic image intelligent assessment and the reliability of clinical diagnosis.

[0037] This embodiment further includes: S40. Dynamically fuse the features of the macro-scale map and the micro-scale map through a deformable attention mechanism to generate a joint feature vector. The purpose of this step is to combine the macro and micro features extracted by the multi-scale graph neural network to achieve more accurate disease representation. The macro-scale map reflects the overall distribution pattern of the lesion, and the micro-scale map focuses on the detailed features of individual ulcer lesions. By introducing a deformable attention mechanism, the system can dynamically adjust the important weights of the two types of features according to specific cases, enhancing the flexibility and pertinence of information fusion. This mechanism adaptively learns to identify the relationships between key nodes and edges, highlights the key features related to disease diagnosis, and at the same time suppresses irrelevant or noisy information, thereby generating a joint feature vector with rich semantics, providing a solid foundation for subsequent classification and risk prediction.

[0038] S50. Based on the joint feature vector, output an endoscopic assessment report including the differential diagnosis results of ulcerative colitis / Crohn's disease, lesion grading, and pseudopolyp risk warning. This step relies on the joint feature vector generated by S40 and uses pre-trained classification and regression models to comprehensively analyze the spatial distribution characteristics and pathological details of the patient's lesions to achieve multi-task output. Specifically, it includes: Differential diagnosis results: Determine whether the lesion is more likely to be ulcerative colitis (UC) or Crohn's disease (CD) to assist doctors in making accurate diagnoses; Lesion grading: Evaluate the severity of the lesion based on comprehensive indicators such as the number, size, depth, and inflammation activity of ulcers to assist in formulating treatment plans; Pseudopolyps Risk Warning: By detecting indicators such as the number of circular structures, the risk of pseudopolyps formation can be identified in advance, reminding doctors to pay attention to potential complications.

[0039] Finally, the system generates a structured endoscopic evaluation report, which is convenient for doctors to understand the characteristics of the lesions and improves the efficiency of clinical diagnosis and decision-making.

[0040] Implementing this technical solution, by integrating multi-dimensional spatial features at the macroscopic and microscopic scales, and using the deformable attention mechanism to dynamically integrate the overall distribution and detailed morphology of the lesions, high-precision discrimination between ulcerative colitis and Crohn's disease is achieved. Based on the multi-task evaluation of the joint feature vector, not only the accuracy of lesion grading is improved, but also the risk of pseudopolyps can be warned in advance, greatly enhancing the comprehensiveness and clinical guiding value of endoscopic image evaluation, and improving the diagnostic efficiency and reliability.

[0041] In this embodiment, the calculation of the full-segment rectal continuity index includes: S21. Segment the three-dimensional point cloud data of the rectal segment and calculate the proportion of the length covered by the lesion area in the total length of the rectum. This step includes, first, spatially partitioning the collected three-dimensional point cloud data of the colon to locate a specific anatomical segment of the rectum. In the three-dimensional point cloud of this rectal segment, identify the point set of the lesion area. Calculate the length covered by the lesion area along the direction of the tenia coli, that is, the spatial length of the continuous distribution of the lesion. Divide the lesion coverage length by the total length of the entire rectal segment to obtain the lesion coverage ratio. This ratio reflects the spatial expansion range of the lesion in the rectal segment and is an important indicator for judging the extent of the lesion.

[0042] S22. Analyze the topological connectivity of the lesion boundary through the Alpha complex algorithm. When the number of connected components is 1 and the coverage ratio exceeds the preset coverage threshold, it is determined as a characteristic of ulcerative colitis. In this step, the Alpha complex algorithm is used to construct a topological structure for the three-dimensional boundary point cloud of the lesion area, and the number of connected components is mainly calculated, that is, the number of continuous lesion areas in space. If the number of connected components is 1, it means that the lesion is spatially continuous and not segmented in the rectal segment, forming a complete area. When the coverage ratio of this continuous lesion area exceeds the preset threshold at the same time, it indicates that the lesion has a wide and continuous coverage range, and this manifestation conforms to the typical characteristics of ulcerative colitis. This step helps to distinguish ulcerative colitis from other skip lesions through the joint determination of topological connectivity and coverage ratio.

[0043] S23. The distortion rate of the rectal mucosal crypt structure in the microscopic-scale image is calculated using morphological parameters of the crypt openings. If the distortion rate exceeds a preset distortion threshold, it is marked as a typical pathological change of ulcerative colitis. At the microscopic scale, a graph neural network model is used to analyze the morphological characteristics of the rectal mucosal crypts, especially the morphological parameters of the crypt openings (such as size, shape, symmetry, etc.). The distortion rate of the crypt structure is calculated to reflect the degree of subtle pathological changes in the mucosa. If the distortion rate is higher than the preset threshold, it indicates that the crypt structure is significantly abnormal, which is usually a typical pathological manifestation in the active stage of ulcerative colitis. This step provides a quantitative index for the activity and severity of the lesion at the microscopic level, assisting in the overall diagnosis.

[0044] Implementing this technical solution, through the introduction of three-dimensional point cloud data and topological analysis methods, precise spatial positioning and continuous quantification of the lesion area in the rectal segment are achieved. The Alpha complex algorithm is used to determine the lesion connectivity, and the coverage ratio is combined to effectively distinguish the continuous extensive lesion characteristics of ulcerative colitis from other skip lesions. In addition, based on the calculation of the distortion rate of the crypt structure at the microscopic scale, an assessment index of pathological activity at the cellular level is provided. The overall solution improves the diagnostic accuracy and disease grading ability of endoscopic images for ulcerative colitis, enhances the comprehensive understanding of the spatial distribution and microscopic pathological changes of the lesions, and has high clinical application value.

[0045] In a specific embodiment, in the macroscopic-scale image, when the probability of the lesion spreading along the colonic bands exceeds the first preset threshold, it is determined as a continuous lesion; when the spreading probability is lower than the second preset threshold and the number of connected components exceeds the third preset threshold, it is determined as a skip lesion of Crohn's disease; the edge weight in the microscopic-scale image is jointly determined by the minimum curvature similarity between ulcers and the correlation of the crypt distortion rate. If the correlation exceeds the fourth preset threshold, the determination of ulcerative colitis is strengthened.

[0046] In the macroscopic-scale image, the ulcer density is calculated by multiplying the number of ulcers per unit area by the segment weight coefficient to amplify the impact of the lesion in a specific segment; the edge sharpness in the microscopic-scale image is the standard deviation of the gradient amplitude in the ulcer boundary region. When the gradient amplitude exceeds the fifth preset threshold, it is marked as an active inflammatory lesion, and when the gradient amplitude is lower than the sixth preset threshold, it indicates fibrotic changes in Crohn's disease.

[0047] The deformable attention mechanism includes: a rectum-priority attention module: based on the weight coefficient of the rectal segment, dynamically enhancing the attention weight of the rectal region features; a cross-scale feature fusion module: jointly optimizing the macroscopic anatomical segments and microscopic crypt distortion features through a multi-head attention mechanism.

[0048] In this embodiment, it should be noted that this technical solution realizes the accurate identification and differentiation of the morphological, distribution characteristics and pathological states of ulcerative colitis (UC) and Crohn's disease (CD) by constructing macroscopic and microscopic scale maps and integrating multi-dimensional structural indicators and attention mechanisms. Specifically: At the macroscopic scale map level: The lesion diffusion probability is used to quantify the degree of lesion propagation along the colonic bands. A high continuity indicates a tendency towards UC, while a high jumpiness indicates a tendency towards CD; The number of connected components combined with a low diffusion probability indicates the typical jumping lesion characteristics of CD; After introducing a sectional weight coefficient, the ulcer density can dynamically enhance the judgment sensitivity for specific high-risk areas (such as the rectal segment), which helps to highlight the key points of clinical concern.

[0049] At the microscopic scale map level: The edge weight comprehensively considers the minimum curvature similarity between ulcers and the correlation of crypt distortion rate, making the model more discriminative in cell-level structure relationship modeling; The edge sharpness characterizes the degree of inflammation activity or fibrosis trend through the standard deviation of the gradient, supporting the classification judgment of the active phase of UC and the chronic phase of CD.

[0050] Optimization of the attention mechanism: The rectum-priority attention module dynamically enhances the feature expression of the rectum segment through weights, fully considering the typical onset site of UC; The cross-scale feature fusion module uses multi-head attention to fuse the macroscopic topological features of the lesions and the microscopic structure indicators of the crypts, thereby improving the accuracy and robustness of the overall assessment.

[0051] In a specific embodiment, the endoscopic evaluation report generates the differential diagnosis results of ulcerative colitis / Crohn's disease according to the following rules: If the continuity index of the entire rectal segment exceeds the preset coverage threshold and the crypt distortion rate exceeds the preset distortion threshold, it is determined to be ulcerative colitis; If the lesions are distributed in a jumping pattern and the crypt distortion rate is lower than the seventh preset threshold, it is determined to be Crohn's disease; The endoscopic evaluation report combines the heat map of the rectal segment lesions and the three-dimensional reconstruction map of the crypt structure to display the analysis results.

[0052] It also includes model optimization steps based on the pathological differences between ulcerative colitis and Crohn's disease, including: Generating adversarial samples that conform to the rectal continuity diffusion law of ulcerative colitis and the jumping lesion characteristics of Crohn's disease. The generation process is respectively restricted by rectal anatomy or random spatial distribution; Introducing a topological consistency loss function and a discrimination loss function into the discriminator to optimize the structural rationality and class discrimination of the generated lesions.

[0053] Adversarial samples are generated by a generator, and the generator includes: Ulcerative colitis branch: Input the anatomical coding of the rectal segment and output the continuous lesion point cloud; Crohn's disease branch: Input the random position coding and output the skip lesion point cloud; The discriminator is a multi-scale convolutional network structure, and the generation effect is jointly optimized through the topological consistency loss function, adversarial loss function, and total loss function.

[0054] It should be noted that through the introduction of a rule-based discrimination logic and adversarial learning model optimization mechanism, the following key technological innovations and effect guarantees are achieved in endoscopic image evaluation: The rule-driven diagnostic logic has interpretability and clinical comparability: The combined judgment of the two indicators of the full-segment rectal continuity index and crypt distortion rate not only maps the pathological features of continuous and extensive distribution of ulcerative colitis (UC) and crypt structure damage, but also has clear physical significance, which is convenient for clinicians to verify and refer to; the skip distribution and intact crypts are consistent with the discontinuous lesions and tissue retention of Crohn's disease (CD), and the logical judgment conforms to pathological evidence.

[0055] Visualization of evaluation results enhances doctors' cognition and trust: The heat map of rectal lesions and the three-dimensional reconstruction map of crypt structure integrated in the endoscopic evaluation report can intuitively present the lesion range and microscopic tissue changes, improve the intuitiveness and comprehensibility of auxiliary diagnosis, and enhance the credibility and operability of the AI-assisted system.

[0056] The model optimization mechanism combines medical prior knowledge and deep learning capabilities: Using the adversarial sample generation mechanism with specific distribution characteristics, respectively simulate the continuous diffusion of UC and the skip characteristics of CD, effectively enrich the distribution form of training samples, and improve the model's recognition generalization ability; Taking the rectal anatomical coding as the input to ensure that the UC simulation process conforms to the physiological and anatomical laws; controlling the generation of the CD branch by random spatial perturbation to strengthen the model's learning ability for complex spatial structures.

[0057] The topological consistency loss function strengthens the structure recognition ability: By introducing the topological consistency loss function (such as Betti number difference, homology structure constraint, etc.), ensure that the generated lesion area is consistent with the real case in terms of spatial connectivity, closed-loop structure, etc., and improve the topological rationality of the model-generated lesion; The multi-scale convolutional discriminator combines the adversarial loss and the class discrimination target, effectively distinguishes the morphological structures of UC and CD, and optimizes the authenticity of the lesion structure and the clarity of the class boundary.

[0058] Finally, an auxiliary evaluation model with high robustness, high interpretability, and high visibility is achieved: This embodiment not only ensures the stable performance of the diagnostic model under complex lesion structures but also integrates the dual advantages of deep learning and medical logic, forming a comprehensive solution suitable for endoscopic intelligent evaluation, providing strong support for intraoperative auxiliary decision-making in ulcerative colitis and Crohn's disease.

[0059] The following is a complete embodiment of using this technical solution to distinguish Crohn's disease (CD) from ulcerative colitis (UC). Specifically: Step S10: Structural light point cloud acquisition and lesion extraction Device: Structured light endoscope system Data acquisition: Acquire the point cloud of the rectum and colon segments, with a total data volume of approximately 500,000 points Point cloud processing: Use the DBSCAN clustering algorithm to extract the lesion point cloud

[0060] Table 1 As shown in Table 1, the point cloud quantity refers to the total number of points contained in the three-dimensional point cloud data. A point cloud is a three-dimensional data form used to represent the surface or spatial structure of an object. Each "point" contains at least position coordinates (x, y, z), and sometimes additional information such as color, normal vector, reflectivity, etc.

[0061] In the structured light depth endoscope system involved in this application, the point cloud quantity directly reflects the spatial sampling density and fineness of the scanning area (such as the surface of the colon mucosa). For example: the more the point cloud quantity, the more detailed the restoration of the spatial structure, and the higher the accuracy of extracting topological features (such as crypt distortion, lesion edge morphology, curvature change, etc.); if the point cloud quantity is too small, it may lead to incomplete analysis of lesion continuity, unstable topological connectivity or homology features, affecting the discriminant effect of the model.

[0062] The lesion coverage length refers to the cumulative length along the colon axis of the continuous segment detected as the lesion area (such as ulcers, inflammation) in the colon three-dimensional point cloud or image, and is an important indicator for measuring the spatial distribution range and continuity of the lesion.

[0063] Step S20: Topological homology analysis, using the Alpha complex algorithm to extract the topological structure:

[0064] Table 2 Step S21: Continuity index calculation Coverage ratio > 85%, number of connections = 1, initially diagnosed as ulcerative colitis.

[0065] Step S22: Crypt structure distortion rate assessment 350 crypts were sampled, 312 abnormal crypts, average opening deviation of 15.4°, distortion rate reached 89.1%, exceeding the 75% threshold, further supporting the UC diagnosis.

[0066] Step S30: Macro-scale graph modeling, nodes represent colon anatomical segments, edge weights are ulcer diffusion probabilities;

[0067] Table 3 Judgment: Rectal diffusion probability > 0.85 (the first preset threshold), high connectivity → UC.

[0068] Skip distribution in the ascending colon and terminal ileum → Possibility of CD.

[0069] Step S31: Edge weight W of micro-scale graph modeling = × minimum curvature similarity + × crypt distortion correlation, = 0.4, = 0.6, total correlation score 0.82 > 0.75, strengthening the UC judgment.

[0070] Step S40: Attention mechanism fusion includes: Rectum-priority attention module (boosting the weight of rectal features to 0.95); Cross-scale fusion module (combining the macro-anatomical graph and the micro-distortion graph, outputting a 128-dimensional feature vector).

[0071] Step S50: Diagnostic result output Discrimination result: UC Grade: Severe Visualization graph: Heat map + three-dimensional crypt structure graph Step S60: Adversarial sample training generator:

[0072] Table 4 Discriminator: Topological consistency loss Ltopo = 0.043, adversarial loss Ladv = 0.217, total loss Ltotal = 0.260.

[0073] Implement this solution, utilize point cloud topological structure analysis and homology features to improve the connectivity recognition ability and enhance the recognition accuracy of UC; the multi-scale graph model combines macroscopic segmentation and microscopic crypt features to enhance the model's discriminative ability for jumping lesions; introduce a deformable attention mechanism to focus on key anatomical regions and strengthen feature expression; the adversarial sample training introduces a topological consistency loss function to improve the generation and recognition stability of the model for complex-shaped lesions; the system supports heatmap and three-dimensional visualization output to enhance the doctor's intraoperative auxiliary decision-making ability.

[0074] The above-described embodiments merely represent several embodiments of the present application, and the description thereof is relatively specific and detailed, but it should not be construed as a limitation to the scope of the patent application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the appended claims.

Claims

1. An intelligent evaluation method for endoscopic images of ulcerative colitis, characterized in that, Comprising: Synchronously acquiring a video stream and three-dimensional point cloud data of the colonic mucosa through an endoscopic system equipped with a structured light depth sensor, and constructing a three-dimensional coordinate system based on the colonic anatomical orientation. The three-dimensional coordinate system includes images of the lesion area in multiple consecutive frames and their depth coordinates distributed along the taenia coli; Based on the three-dimensional point cloud data, constructing a simplicial topological structure on the surface of the colonic mucosa and calculating the persistent homology feature set of the lesion area; Based on the persistent homology feature set, constructing a multi-scale graph neural network model specific to ulcerative colitis and Crohn's disease, including: Macro-scale graph: Dividing the colon into several segments, and using the mean number of connected components, ulcer density, and the probability of lesion spreading along the taenia coli in each segment as node features and edge weights; Micro-scale graph: Using individual ulcer lesions as graph nodes, and the graph nodes include the following structural pathological features: The depth-width ratio of a single ulcer, used to distinguish superficial ulcers from penetrating ulcers. When the depth-width ratio is lower than a preset depth-width ratio threshold, it indicates the superficial ulcer feature of ulcerative colitis; The sharpness of the ulcer edge, quantified by the boundary gradient amplitude and its standard deviation. When the sharpness is higher than a preset sharpness threshold, it indicates active inflammation; The minimum curvature similarity between ulcers, used to measure the spatial continuity of the ulcer surface morphology. When the minimum curvature similarity is higher than a preset similarity threshold, it is determined to be a continuous distribution.

2. The endoscopic image intelligent evaluation method for ulcerative colitis according to claim 1, characterized in that, The persistent homology feature set includes: Full-segment rectal continuity index: By analyzing the coverage ratio and spatial continuity of the lesions in the rectal segment along the taenia coli, quantifying whether the lesions involve the entire rectal segment. When the coverage ratio exceeds a preset coverage threshold, it is determined to be a feature of ulcerative colitis; Number of connected components: Used to quantify the continuous distribution pattern of the lesions along the taenia coli; Number of circular structures: Used to identify the closed-loop features of pseudopolyps formation.

3. The endoscopic image intelligent evaluation method for ulcerative colitis according to claim 2, characterized in that, Also including: Dynamically fusing the features of the macro-scale graph and the micro-scale graph through a deformable attention mechanism to generate a joint feature vector; Based on the joint feature vector, outputting an endoscopic evaluation report including the discrimination results of ulcerative colitis / Crohn's disease, lesion grading, and pseudopolyp risk warning.

4. The intelligent endoscopic image evaluation method for ulcerative colitis according to claim 3, wherein The calculation of the full-segment rectal continuity index includes: Segmenting the three-dimensional point cloud data of the rectal segment and calculating the proportion of the covered length of the lesion area in the total length of the rectum; Analyzing the topological connectivity of the lesion boundary through the Alpha complex algorithm. When the number of connected components is 1 and the coverage ratio exceeds a preset coverage threshold, it is determined to be a feature of ulcerative colitis; The distortion rate of the rectal mucosal crypt structure in the micro-scale graph is calculated through the morphological parameters of the crypt opening. If the distortion rate exceeds a preset distortion threshold, it is marked as a typical pathological change of ulcerative colitis.

5. The intelligent endoscopic image evaluation method for ulcerative colitis according to claim 4, wherein In the macro-scale graph, when the probability of the lesion spreading along the taenia coli exceeds a first preset threshold, it is determined to be a continuous lesion; When the spreading probability is lower than a second preset threshold and the number of connected components exceeds a third preset threshold, it is determined to be a skip lesion of Crohn's disease; The edge weights in the micro-scale map are jointly determined by the minimum curvature similarity between ulcers and the correlation of crypt distortion rate. If the correlation exceeds the fourth preset threshold, the determination of ulcerative colitis is strengthened.

6. The endoscopic image intelligent evaluation method for ulcerative colitis according to claim 5, wherein In the macro-scale map, the ulcer density is calculated by the product of the number of ulcers per unit area and the sectional weight coefficient to amplify the lesion influence of a specific section; The edge sharpness in the micro-scale map is the standard deviation of the gradient amplitude in the ulcer boundary region. When the gradient amplitude exceeds the fifth preset threshold, it is marked as an active inflammation lesion, and when the gradient amplitude is lower than the sixth preset threshold, it indicates fibrotic changes in Crohn's disease.

7. The endoscopic image intelligent evaluation method for ulcerative colitis according to claim 6, wherein The deformable attention mechanism includes: Rectum-priority attention module: Dynamically enhance the attention weight of the features in the rectal region based on the weight coefficient of the rectal section; Cross-scale feature fusion module: Jointly optimize the macro-anatomical section and micro-crypt distortion features through the multi-head attention mechanism.

8. The endoscopic image intelligent evaluation method for ulcerative colitis according to claim 7, wherein The endoscopic evaluation report generates the differential diagnosis results of ulcerative colitis / Crohn's disease according to the following rules: If the whole-segment rectal continuity index exceeds the preset coverage threshold and the crypt distortion rate exceeds the preset distortion threshold, it is determined as ulcerative colitis; If the lesions are distributed in a skip pattern and the crypt distortion rate is lower than the seventh preset threshold, it is determined as Crohn's disease; The endoscopic evaluation report combines the thermal map of the lesions in the rectal section and the three-dimensional reconstruction map of the crypt structure to display the analysis results.

9. The endoscopic image intelligent evaluation method for ulcerative colitis according to claim 8, characterized in that, It also includes a model optimization step based on the pathological differences between ulcerative colitis and Crohn's disease, including: Generate adversarial samples that conform to the rectal continuity diffusion law of ulcerative colitis and the skip lesion characteristics of Crohn's disease, and the generation process is respectively constrained by rectal anatomy or random spatial distribution; Introduce a topological consistency loss function and a discrimination loss function in the discriminator to optimize the structural rationality and class discrimination of the generated lesions.

10. The endoscopic image intelligent evaluation method for ulcerative colitis according to claim 9, wherein The adversarial samples are generated by a generator, and the generator includes: Ulcerative colitis branch: Input the anatomical coding of the rectal section and output the continuous lesion point cloud; Crohn's disease branch: Input the random position coding and output the skip lesion point cloud; The discriminator is a multi-scale convolutional network structure, and the generation effect is jointly optimized by the topological consistency loss function, the adversarial loss function, and the total loss function.

Images