Microscope Image Fusion With Neural Backup for Low-Latency Reliability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods for surgical microscopes suffer from high latency and unreliability, which can compromise surgical precision and decision-making during procedures.

Innovation Solution

A method and apparatus that utilize two input images, one processed using a neural network and the other unprocessed, allowing for reliable image generation by combining them based on a reliability criterion, with the unprocessed image serving as a backup if the processed image fails, and employing different wavelength ranges and specialized circuitry for enhanced processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep learning models and advanced image processing techniques are used to enhance image quality and detect features, then measurement precision and manufacturing precision are improved, but computational complexity and processing time increase significantly

Engineering Contradiction:
Improveimage processing accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing task into two independent pipelines: a first pipeline using deep learning models for high-precision feature detection, and a second pipeline using traditional image processing techniques for real-time processing. This segmentation allows each pipeline to be optimized for its specific requirements without compromising the other, resolving the contradiction between precision and complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by using deep learning models only for specific critical features detection rather than processing the entire image through complex algorithms. The system selectively applies advanced techniques only where needed, reducing overall computational complexity while maintaining high precision for important measurements.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If deep learning models are used for real-time image analysis in surgery, then measurement precision is improved, but latency increases and reliability decreases due to system failures

Engineering Contradiction:
Improvefeature detection accuracyVSAvoidsystem reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements beforehand cushioning by having a backup second pipeline ready that can immediately take over if the first deep learning pipeline fails. This redundancy ensures that system failures in the complex first pipeline do not compromise surgical procedures, significantly improving reliability while maintaining the ability to perform high-precision analysis when the first pipeline is operational.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The patent applies local quality by allowing different processing pipelines to serve different functional requirements: the first pipeline provides high-precision feature detection for critical measurements, while the second pipeline ensures continuous operation and reliability. Each pipeline can be optimized for its specific local function without compromising the other.

Inventive Principle:
Principle #3Local quality

3Device complexity

If single image processing pipeline is used to simplify the system, then device complexity is reduced, but reliability decreases because there is no backup when processing fails

Engineering Contradiction:
Improveprocessing pipeline complexityVSAvoidimage generation reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent merges two independent image processing pipelines into a unified system where the first pipeline (deep learning-based) and second pipeline (traditional processing) operate in parallel and can both contribute to the final output. This merging provides redundancy and reliability while maintaining manageable complexity through modular architecture, as each pipeline can be independently optimized and maintained.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP4671846A1A method and an apparatus for generating an image for a microscope and a microscopy system
Publication Date: 2025.12.31 LEICA INSTRUMENTS (SINGAPORE) PTE LTD
  • EP4671846A1 patent drawingFigure 1~2
  • EP4671846A1 patent drawingFigure 3~4
  • EP4671846A1 patent drawing

AI summary

A method for generating an image (100) for a microscope, comprises receiving (102) a first image (210) and receiving (104) a second image (220). The method further comprises generating (106) a processed second image (240, 214) based on the second image (220) and generating the image (204) using the first image (210) and the processed second image (240, 214).