Surgical Zoom Context Awareness via Non-Linear Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During medical procedures using optical zoom endoscopes, the zoomed-in region of interest occludes important details in the wide-field view, limiting contextual awareness for surgeons.

Innovation Solution

The implementation of non-linear compression techniques to generate a compressed region around the zoomed-in area of interest, allowing the occluded and surrounding areas to be compressed, thereby maintaining contextual awareness by updating the visual output to include both the zoomed-in and compressed regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the zoomed region of interest is overlaid on the wide-field view, then high resolution imaging of the region of interest is achieved, but a portion of the wide-field view is occluded resulting in loss of contextual information

Engineering Contradiction:
Improveimage resolutionVSAvoidcontextual information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The display is segmented into multiple regions: the wide-field view and the zoomed region of interest. The zoomed ROI is displayed in a separate designated area rather than being overlaid on the wide-field view, allowing both the high-resolution zoomed image and the contextual wide-field information to be simultaneously visible without occlusion.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If the zoomed region of interest occupies additional space in the wide-field view, then detailed inspection of the region of interest is enabled, but the surrounding contextual area becomes occluded

Engineering Contradiction:
Improveinspection detailVSAvoidvisible contextual area
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The zoomed region of interest is positioned in a separate spatial dimension (designated display area) rather than occupying space within the wide-field view. This dimensional separation allows the full wide-field contextual area to remain visible while the zoomed ROI is displayed with full resolution in its own designated space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20230118522A1Maintaining neighboring contextual awareness with zoom
Publication Date: 2023.04.20 NVIDIA CORP
  • US20230118522A1 patent drawing
  • US20230118522A1 patent drawing
  • US20230118522A1 patent drawing

AI summary

An area of interest within a visual output of a surgical site is identified. An area of interest within a visual output of a surgical site is identified. A zoom operation on the area of interest to generate a magnified area of interest is performed. An occluded region around the area of interest within the visual output is determined based on an amount of zoom associated with the zoom operation. The occluded region is a region of the visual output that becomes occluded by placing a magnified area of interest over the area of interest within the visual output. A non-linear compression to the occluded region of the visual output to generate a compressed occluded region is applied. The magnified area of interest to include the compressed occluded region is updated.