Medical Imaging Sensor Navigation with Contrastive Reinforcement Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing medical imaging technologies, such as ultrasound, require skilled operators for proper navigation and positioning, and there is a shortage of trained sonographers, while existing AI navigation systems lack generalizability and are not suitable for interventional cases.

Innovation Solution

A contrastive reinforcement learning (CRL) framework is used to train an AI system for medical sensor navigation, utilizing simulated trajectories from different patients to enhance generalization and enable navigation to various anatomical landmarks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional ultrasound scanning is performed by skilled operators, then scan quality is maintained, but there is a shortage of skilled sonographers to meet increasing demand

Engineering Contradiction:
Improvescan qualityVSAvoidscan throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system enables self-service navigation where the ultrasound system automatically guides the transducer to target anatomical views using AI-based image recognition and navigation algorithms, eliminating the need for continuous manual operator intervention while maintaining scan quality

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical skill-based operation with an automated computer vision system that uses machine learning models to interpret ultrasound images and guide transducer positioning, substituting human operator expertise with algorithmic decision-making

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If AI navigation systems are trained on single-view data, then navigation to that specific view is accurate, but the system lacks generalizability for interventional cases requiring multiple views

Engineering Contradiction:
Improvenavigation accuracyVSAvoidgeneralizability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system implements a universal navigation framework that can handle multiple anatomical views and interventional scenarios simultaneously through a single trained model, enabling the AI to generalize across different clinical cases rather than requiring separate specialized models for each view

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent extends navigation from 2D single-view imaging to 3D multi-view spatial understanding by training the AI model on volumetric data and teaching it to navigate through three-dimensional anatomical space, enabling comprehensive interventional guidance

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If navigation data is collected from actual clinical procedures, then training data quality is high, but the process is time-consuming and may require additional tracking hardware

Engineering Contradiction:
Improvetraining data qualityVSAvoiddata collection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system creates synthetic copies of clinical navigation data through simulation environments that generate virtual ultrasound images and transducer trajectories, providing abundant training data without requiring actual clinical procedure recording or additional hardware

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary data preparation by pre-processing and simulating navigation scenarios before actual clinical use, creating a comprehensive training dataset in advance that eliminates the need for time-consuming real-time data collection during procedures

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250248684A1Contrastive reinforcement learning-based navigation in medical imaging
Publication Date: 2025.08.07 SIEMENS MEDICAL SOLUTIONS USA INC
  • US20250248684A1 patent drawing
  • US20250248684A1 patent drawing
  • US20250248684A1 patent drawing

AI summary

For movement of medical sensors for medical imaging, an artificial intelligence (AI) is trained using a contrastive reinforcement learning (CRL) framework. Simulation may be used to provide the training data. For training, the sampling for a given input instance in CRL may use trajectories simulated from different patients for better contrast. CRL, with or without the simulation feature and/or the sampling feature, may provide more generalized navigation, such as in interventional or diagnostic settings.