Whole Slide Image Encoder Training With Weighted Negative Samples

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image encoder training methods using contrastive learning incorrectly classify positive and negative samples, leading to inaccurate feature extraction and low precision in downstream search tasks for whole slide images.

Innovation Solution

The method involves clustering image feature vectors, assigning weights to negative samples based on their similarity to the anchor image, and using weighted loss functions to accurately distinguish between anchor and negative samples, thereby improving the training of the image encoder.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional contrastive learning is used to train the image encoder, then the training process is simple, but the precision of extracted image features is low due to wrong positive and negative sample selection

Engineering Contradiction:
Improveprecision of extracted image featureVSAvoidcomplexity of training process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by performing clustering analysis on negative samples before the contrastive learning training process. The method pre-calculates similarity metrics and identifies high-similarity negative samples that should be treated as positive samples, then adjusts the training data accordingly. This preliminary preparation ensures that the image encoder receives correctly labeled training data from the start, preventing the propagation of errors throughout the training process while maintaining relatively simple implementation.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If all negative samples are treated equally in contrastive learning, then the training process is straightforward, but the distinction between different negative samples is lost leading to inaccurate feature extraction

Engineering Contradiction:
Improveprecision of extracted image featureVSAvoidease of training process
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies local quality by differentiating the treatment of negative samples based on their individual characteristics. Instead of uniformly processing all negative samples, the method calculates similarity metrics for each negative sample relative to the anchor image, identifies high-similarity samples through clustering, and applies different weights or treatments accordingly. This localized differentiation ensures that high-similarity negative samples (which should be positive samples) receive appropriate attention, improving feature extraction precision while adding manageable complexity to the training process.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12499150B2Image encoder training method and apparatus, device, and medium
Publication Date: 2025.12.16 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12499150B2 patent drawing
  • US12499150B2 patent drawing
  • US12499150B2 patent drawing

AI summary

Provided is a method for searching for a whole slide image performed by a computer device, which relate to the field of artificial intelligence. The method includes: cropping a whole slide image into a plurality of tissue images; generating, through an image encoder, image feature vectors respectively corresponding to the plurality of tissue images; clustering the image feature vectors respectively corresponding to the plurality of tissue images, to determine at least one key image from the plurality of tissue images; querying, based on image feature vectors respectively corresponding to the at least one key image, a database to obtain at least one target image package corresponding to the at least one key image; and determining a whole slide image to which at least one candidate tissue image comprised in the at least one target image package respectively belongs as a final search result.