Microscopy Panorama Generation via Perspective Alteration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current microscopy panoramic representation methods either require expensive digital slide scanners or manual systems that cannot visualize panoramas in real time, leading to difficulties in recognizing complete images and correcting merging errors, especially in manual microscopes without automated stages.

Innovation Solution

A method that involves arranging a three-dimensional sample on a positioner, recording initial and altered perspective images using an imaging device, determining change information between these images, and merging them to generate a microscopy panoramic representation, allowing for interactive digitalization of large areas without motorized microscopes or automatic scanners.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a digital slide scanner or automated microscope is used to generate microscopy panoramas, then the quality and completeness of panoramic representations are improved, but the costs increase significantly

Engineering Contradiction:
Improvepanorama qualityVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent replaces expensive, complex automated digital slide scanners with inexpensive manual microscopy equipment combined with mobile computing devices. The system uses standard manual microscopes with digital cameras and smartphones or tablets to capture and process images, eliminating the need for costly specialized scanning equipment while achieving comparable panorama quality

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent replaces the mechanical automation systems (motorized stages, automated focusing) of digital slide scanners with software-based solutions running on mobile devices. The image capture, stitching, and panorama generation are handled by algorithms on smartphones or tablets rather than dedicated automated hardware systems

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of manufacture

If stitching software is used to generate microscopy panoramas from digitalized images, then the system cost is reduced, but real-time visualization and correction capability are lost

Engineering Contradiction:
Improvesystem costVSAvoidreal-time interaction
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The patent transforms the static offline stitching process into a dynamic real-time interactive system. The mobile device continuously captures images, processes them, and updates the panorama display in real-time, allowing users to interact with the system during the panorama generation process, make corrections, and verify completeness as images are being stitched

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system provides real-time visual feedback during panorama creation by displaying the evolving panoramic representation on mobile devices. Users can immediately see the results of their actions, identify missing areas or stitching errors, and make corrections in real-time rather than waiting for offline processing to complete

Inventive Principle:
Principle #23Feedback

3Device complexity

If manual microscopes without automated stages are used, then the system complexity and cost are reduced, but the ability to capture complete panoramas and perform corrections is impaired

Engineering Contradiction:
Improvemicroscope automationVSAvoidpanorama completeness
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent introduces a mobile computing device as an intermediary between the manual microscope and the panorama generation process. The mobile device captures images through the microscope, performs automated stitching algorithms, and provides real-time feedback to the user, bridging the gap between simple manual hardware and complex automated panorama creation

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables the manual microscope setup to perform panorama creation autonomously through software automation on mobile devices. The stitching algorithms automatically align and merge images, detect overlapping regions, and generate complete panoramas without requiring automated mechanical stages, allowing the simple hardware to achieve complex functionality through intelligent software

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10582126B2Method and device for generating a microscopy panoramic representation
Publication Date: 2020.03.03 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US10582126B2 patent drawing
  • US10582126B2 patent drawing
  • US10582126B2 patent drawing

AI summary

Embodiments of the present invention relate to a method for generating a microscopy representation of a three-dimensional sample having a lateral extension in the x and y directions. The method has the following steps: a) arranging the flat three-dimensional sample on a positioner; b) recording the sample by means of an imaging device to obtain a first microscopy picture of the sample having a first section; c) altering the perspective onto the two-dimensional sample in the z direction; d) recording the sample by means of the imaging device to obtain a second microscopy picture of the sample having a second section; e) determining change information which allows drawing conclusions as to the change in perspective in the z direction, using a difference between the first and second microscopy pictures; and f) merging the first and second microscopy pictures while considering the change information to obtain the microscopy panoramic representation.