Split Screen Display for Biological Specimen Biomarker Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for visualizing biomarkers in biological specimens are limited in their ability to simultaneously and efficiently display multiple aspects of a field of view, such as biomarker expression levels and morphological features, across different regions of interest, often requiring full image loading and lacking seamless alignment of sub-panels.

Innovation Solution

A computer-implemented method and system that provides a split screen display of a biological specimen's field of view, using a graphical user interface with image sub-panels for displaying biomarker expression levels and morphological features, allowing for seamless alignment and efficient data access through tiled multi-resolution data structures, enabling flexible and user-friendly visualization of biomarker data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If full image loading is used to display biomarker expression data, then complete image information is available, but loading time and memory consumption increase significantly

Engineering Contradiction:
Improveimage information completenessVSAvoidimage loading time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The image data is divided into multiple tiles at different resolution levels, forming a pyramid structure. Only the necessary tile portions are loaded and displayed based on the current field of view and zoom level, rather than loading the entire image. This segmentation approach maintains complete image information availability while significantly reducing loading time and memory consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image are loaded at different resolution qualities based on their importance and the current display context. High-resolution tiles are loaded for regions of interest or currently visible areas, while lower-resolution tiles are used for less critical regions. This local quality differentiation ensures that the most important image information is displayed with high fidelity while minimizing overall data loading.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If multiple sub-panels are displayed simultaneously to show different biomarkers, then comprehensive comparison is enabled, but alignment precision and display complexity increase

Engineering Contradiction:
Improvemulti-biomarker comparison capabilityVSAvoidsub-panel alignment precision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

Multiple sub-panels are arranged in a grid layout with defined spatial relationships. The system uses coordinate transformation and tiling index calculations to map positions across different sub-panels, enabling precise alignment through mathematical relationships rather than physical positioning. This dimensional approach to alignment allows multiple biomarkers to be displayed simultaneously with accurate spatial correspondence.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If high resolution display is used for detailed biomarker visualization, then image quality is improved, but data transmission and processing load increase

Engineering Contradiction:
Improvebiomarker visualization qualityVSAvoiddata transmission energy
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

Instead of loading and transmitting complete high-resolution image data, the system loads only the partial tile portions that are currently visible or likely to be viewed. The tiling structure allows selective loading of image segments at the appropriate resolution level, providing sufficient visualization quality for diagnostic purposes while minimizing data transmission and processing energy requirements.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP2929420B1Systems and methods for split screen display of a biological specimen and for capturing records thereof
Publication Date: 2022.03.02 LEICA MICROSYSTEMS CMS GMBH
  • EP2929420B1 patent drawingFigure 1A~1C
  • EP2929420B1 patent drawingFigure 2
  • EP2929420B1 patent drawingFigure 3

AI summary

Embodiments provide a split screen display for simultaneously viewing different portions of a field of view corresponding to an image, or a portion of an image, of a biological specimen. An image panel in the split screen display may include or be split into two or more sub-panels for displaying two or more contiguous portions of the field of view, so that each sub-panel displays a different portion of the field of view and so that the collection of sub-panels cooperatively displays the entire field of view. The portions of the field of view seamlessly and contiguously aligned at boundaries of the sub-panels. Different display types may be used to display the portions of the field of view in the sub-panels. Images may be recorded on a local or remote storage device or storage media for use in a report.