Surgical Imaging GUI With 3D Probe Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for visualizing multiple medical device images during surgical procedures, such as laparoscopic cameras and ultrasound probes, rely on simple picture-in-picture technology, which can be cumbersome and limit the operator's ability to make precise operational decisions.

Innovation Solution

A graphical user interface that integrates ultrasound and laparoscopic images with dynamic 3D avatar guidance, allowing for real-time orientation and control of an ablation probe through a split-screen display with interactive controls and 3D visualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If simple picture-in-picture technology is used to display multiple medical device images, then the system complexity is reduced, but the operational precision and visualization quality deteriorate

Engineering Contradiction:
Improvesystem complexityVSAvoidoperational precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The display screen is segmented into multiple regions, each dedicated to showing different medical imaging data (ultrasound images, laparoscopic camera images, 3D avatar visualizations). This segmentation allows each type of data to be displayed with appropriate size and clarity, improving operational precision without requiring a completely complex integrated system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from traditional 2D picture-in-picture display to a multi-dimensional visualization approach by incorporating dynamic 3D avatar guidance that shows probe orientation and position in three-dimensional space. This dimensional enhancement provides better spatial understanding for surgical operations

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If simple picture-in-picture technology is used to display multiple medical device images, then the device complexity is reduced, but the ease of operation deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidease of operation
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

Multiple medical imaging data sources (ultrasound, laparoscopic camera, 3D avatar) are merged into a single integrated display interface. This consolidation allows the operator to view all relevant information in one location, improving ease of operation without requiring multiple separate display systems

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

A graphical user interface acts as an intermediary between the multiple medical devices and the operator. This GUI consolidates and organizes data from various sources, making it easier to interpret and act upon without directly managing each device separately

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If simple picture-in-picture technology is used, then the system remains simple, but information completeness and operational decision-making capability are limited

Engineering Contradiction:
Improvesystem simplicityVSAvoidinformation completeness
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The display system is designed to universally accommodate multiple types of medical imaging data and visualization modes within a single interface. This multi-functional capability ensures complete information presentation without requiring separate specialized display systems for each data type

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12539097B2System for visualization and control of surgical devices utilizing a graphical user interface
Publication Date: 2026.02.03 HOLOGIC INC
  • US12539097B2 patent drawing
  • US12539097B2 patent drawing
  • US12539097B2 patent drawing

AI summary

A system for visualizing and guiding a surgical device having a first imaging device of a first type and has a first image output. The first imaging device is positioned to image an area being subject to surgery. A second imaging device of a second type has a second image output. The second imaging device is positioned to image an area being subject to surgery. A computer is coupled to receive the first and second image outputs and a computer software program, resident in the computer receives and displays information received from the surgical device and/or for guiding the operation of the surgical device and for generating a graphic user interface including selectable menu and submenu items. The surgical device is coupled to the computer.