Multi-Level Feature Extraction for Digital Pathology Image Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current digital pathology image retrieval systems face challenges in effectively representing images as feature vectors that capture key information relevant for retrieval, particularly in integrating low-level color, middle-level texture, and high-level diagnostic information.

Innovation Solution

A unified framework is developed to extract and integrate features from different levels by using color quantization through Gaussian Mixture Models, texture quantization via texton approaches, and diagnostic quantization using automatic cancer grading analysis, generating feature vectors through histograms and co-occurrence matrices across multiple resolutions and scales.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple quantization modes (color, texture, diagnostic) are applied to extract comprehensive features, then the completeness of information capture is improved, but the system complexity increases

Engineering Contradiction:
Improvecompleteness of information captureVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent divides the feature extraction process into three independent quantization modes (color quantization, texture quantization, diagnostic quantization), each handling a specific level of information. This segmentation allows comprehensive information capture while maintaining modular system architecture, where each mode can be implemented and optimized independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a unified framework that integrates multiple quantization modes into a single feature extraction system. The common GMM-based quantization approach and the integration mechanism provide universality, allowing the system to handle diverse information types (color, texture, diagnostic) through a consistent methodology, thereby reducing overall system complexity despite the multi-functional capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If features are extracted at multiple resolutions using image pyramids, then the robustness to geometric variations is improved, but the computational time increases

Engineering Contradiction:
Improverobustness to geometric variationsVSAvoidcomputational time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent introduces the resolution dimension by constructing image pyramids with multiple resolution levels. This dimensional approach allows the system to capture geometric invariance by processing features at different scales, thereby improving robustness to geometric variations while maintaining a systematic computational framework.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent performs feature extraction at multiple resolutions in a hierarchical manner, where coarser resolution features are computed first and used to guide finer resolution processing. This preliminary action strategy reduces redundant computations and optimizes the balance between robustness and computational efficiency.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If a unified framework integrates features from all quantization levels, then the retrieval accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improveretrieval accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges features from all three quantization levels (color, texture, diagnostic) into a unified feature representation. By combining these multi-level features, the system achieves comprehensive information integration that improves retrieval accuracy while maintaining a cohesive processing framework that manages complexity through structured integration.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9535928B2Combining information of different levels for content-based retrieval of digital pathology images
Publication Date: 2017.01.03 SONY GROUP CORP
  • US9535928B2 patent drawing
  • US9535928B2 patent drawing
  • US9535928B2 patent drawing

AI summary

Content-based retrieval of digital pathology images (DPI) is a fundamental component in an intelligent DPI processing and management system. One key issue of content-based DPI retrieval is how to represent an image as a feature vector, capturing its key information that is most relevant to the goal of retrieval. A unified framework of extracting information of different levels for DPI, namely low level color information, middle level texture information and high level diagnostic information is described herein. Such information from all the levels are integrated to the end of content-based DPI retrieval.