Papillary thyroid carcinoma lymph node metastasis prediction method based on Transform-MIL

A technology for lymph node metastasis and papillary carcinoma, which is applied in image data processing, medical automated diagnosis, medical informatics, etc., can solve the problems that extreme examples cannot represent WSI well, and the number of positive and negative patches is unbalanced, so as to improve Effects of prediction accuracy, training and inference time savings

Pending Publication Date: 2022-03-15
ZHONGSHAN HOSPITAL XIAMEN UNIV
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, effective deployment of MIL in the field of histopathology images is still a challenging problem nowadays, and currently proposed MIL methods usually select multiple instances with the highest and lowest scores based on instance prediction, but in the histopathology image analysis task , the number of positive and negative patches is extremely unbalanced, which leads to the fact that the standard multiple instance (SMI) assumption cannot be satisfied, and the extreme instances selected according to the prediction score cannot represent WSI well

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Papillary thyroid carcinoma lymph node metastasis prediction method based on Transform-MIL
  • Papillary thyroid carcinoma lymph node metastasis prediction method based on Transform-MIL
  • Papillary thyroid carcinoma lymph node metastasis prediction method based on Transform-MIL

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0061] Such as Figure 1 to Figure 8 As shown, the present invention discloses a method for predicting lymph node metastasis of papillary thyroid carcinoma based on Transformer-MIL, the method comprising the following steps:

[0062] S1. Using the lightweight ViT network to extract the features of the patch in the WSI;

[0063] The specific process of step S1 is:

[0064] S11. Cut the WSI into non-overlapping patches of 512×512, and remove patches without tissue cells;

[0065] S12. Reduce the depth and dimension of the ViT feature extractor to obtain a lightweight feature extractor Tiny-ViT and train it;

[0066] S13, using the trained feature extractor Tiny-ViT to extract the patches with a size of 512×512 into a 312-dimensional feature vector;

[0067] S2. Using a clustering-based strategy to select key patches;

[0068] The specific process of step S2 is:

[0069] S21. Clustering all patch-level features in the WSI into 10 categories through the K-means clustering alg...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a papillary thyroid carcinoma lymph node metastasis prediction method based on Transform-MIL. The method comprises the following steps: S1, extracting the characteristics of patch in WSI by using a lightweight ViT network; s2, selecting a key path by adopting a clustering-based strategy; s3, constructing a Transform-MIL model, learning relationships among instances from multiple aspects through a multi-head self-attention mechanism, and embedding instance-level features into packet representation; s4, combining a thyroid papillary set and a lymph node metastasis data set, and helping a Transform-MIL model to learn and predict lymph node metastasis through mutual knowledge distillation; according to the method, the Transform-MIL model is constructed, the instance-level features are better embedded into the packet representation, the morphological similarity between the tumor cells and the lymph node metastasis cells is fully utilized, and the knowledge of the relationship between the two data sets is transmitted by taking the attention map as a medium, so that the prediction accuracy of the lymph node metastasis histopathology image is improved.

Description

technical field [0001] The invention relates to the field of biotechnology, in particular to a method for predicting lymph node metastasis of thyroid papillary carcinoma based on Transformer-MIL. Background technique [0002] For cancer patients, lymph node metastasis determines the extent of their lymph node dissection and is one of the main independent prognostic factors. Accurately predicting the status of lymph nodes in cancer patients before surgery is of great significance to avoid overtreatment and reduce postoperative complications. Many studies have shown that preoperative CT radiomics can help realize individualized prediction of lymph node status in cancer patients, but these studies often use tumor radiomics features or combine a small number of clinicopathological features, such as lymph node status in CT reports , serum biomarkers, TNM staging, etc. [0003] As histopathological image analysis has become an important means of tumor diagnosis, more and more hi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G16H50/20G16H30/00G06T7/00G06T7/11G06K9/62G06V10/46G06V10/762G06V10/764
CPCG16H50/20G16H30/00G06T7/0012G06T7/11G06T2207/20081G06T2207/20084G06T2207/30096G06T2207/10081G06F18/23213G06F18/214G06F18/2415
Inventor 丁鑫廖雪洪余淑琦王连生王志华
Owner ZHONGSHAN HOSPITAL XIAMEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products