Whole Slide Image Encoder Training With Weighted Negative Samples
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image encoder training methods using contrastive learning incorrectly classify positive and negative samples, leading to inaccurate feature extraction and low precision in downstream search tasks for whole slide images.
Innovation Solution
The method involves clustering image feature vectors, assigning weights to negative samples based on their similarity to the anchor image, and using weighted loss functions to accurately distinguish between anchor and negative samples, thereby improving the training of the image encoder.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional contrastive learning is used to train the image encoder, then the training process is simple, but the precision of extracted image features is low due to wrong positive and negative sample selection
Solution Approach 1:
The patent applies preliminary action by performing clustering analysis on negative samples before the contrastive learning training process. The method pre-calculates similarity metrics and identifies high-similarity negative samples that should be treated as positive samples, then adjusts the training data accordingly. This preliminary preparation ensures that the image encoder receives correctly labeled training data from the start, preventing the propagation of errors throughout the training process while maintaining relatively simple implementation.
2Measurement precision
If all negative samples are treated equally in contrastive learning, then the training process is straightforward, but the distinction between different negative samples is lost leading to inaccurate feature extraction
Solution Approach 1:
The patent applies local quality by differentiating the treatment of negative samples based on their individual characteristics. Instead of uniformly processing all negative samples, the method calculates similarity metrics for each negative sample relative to the anchor image, identifies high-similarity samples through clustering, and applies different weights or treatments accordingly. This localized differentiation ensures that high-similarity negative samples (which should be positive samples) receive appropriate attention, improving feature extraction precision while adding manageable complexity to the training process.
Data Source
AI summary
Provided is a method for searching for a whole slide image performed by a computer device, which relate to the field of artificial intelligence. The method includes: cropping a whole slide image into a plurality of tissue images; generating, through an image encoder, image feature vectors respectively corresponding to the plurality of tissue images; clustering the image feature vectors respectively corresponding to the plurality of tissue images, to determine at least one key image from the plurality of tissue images; querying, based on image feature vectors respectively corresponding to the at least one key image, a database to obtain at least one target image package corresponding to the at least one key image; and determining a whole slide image to which at least one candidate tissue image comprised in the at least one target image package respectively belongs as a final search result.


