Alert Indicators in Surgical Environment Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing teleoperational medical systems do not effectively display alerts within the surgical environment image, making it difficult for clinicians to associate alerts with anatomical structures or instruments, which can lead to errors or misunderstandings during minimally invasive procedures.

Innovation Solution

A method and system that alter a portion of the surgical environment image to provide alert indications within the image itself, using a processing unit to receive alert information and visually deform specific parts of the image, such as animating or modulating the appearance of instruments or anatomical structures to draw attention to critical information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If alerts are displayed in message windows outside the surgical environment image, then the display area for alerts is increased, but the association between alerts and anatomical structures or instruments becomes difficult

Engineering Contradiction:
Improvedisplay area for alertsVSAvoidassociation between alerts and anatomical structures
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent transitions alert display from a two-dimensional external message window to a three-dimensional spatial integration within the surgical environment image. By projecting alert indicators directly onto the anatomical structures or instruments in the endoscopic view, the system creates a spatial relationship that preserves contextual association while maintaining adequate alert visibility through layered overlay techniques.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent merges the alert display function with the surgical environment image by overlaying alert indicators directly onto relevant anatomical structures or instruments. This integration combines the informational content of alerts with the visual context of the surgical field, eliminating the separation between alert presentation and anatomical reference that exists in external message windows.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If alerts are displayed in discrete indicator overlays on the endoscopic image, then the association with anatomical structures is improved, but the visual clarity and context of the surgical environment may be compromised

Engineering Contradiction:
Improveassociation between alerts and anatomical structuresVSAvoidvisual interference with surgical environment
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by making alert indicators visually distinct only in the specific regions where they are needed, rather than uniformly altering the entire surgical image. The alert indicators are localized to specific anatomical structures or instruments, maintaining the natural appearance and clarity of the rest of the surgical environment while providing targeted alert information.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent utilizes color changes to differentiate alert indicators from the surgical environment. By applying distinct color coding to alert indicators (such as highlighting anatomical structures in red or orange tones), the system conveys alert information clearly without permanently altering the visual properties of the surgical field, allowing clinicians to distinguish between normal anatomical features and alert conditions.

Inventive Principle:
Principle #32Color changes

3Loss of information

If the surgical environment image is altered to provide alert indications, then the contextual relevance of alerts is enhanced, but the complexity of the display system increases

Engineering Contradiction:
Improvecontextual relevance of alertsVSAvoidcomplexity of image processing system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent creates simplified visual copies or representations of alert information that are overlaid onto the surgical environment image. Rather than fundamentally transforming the image processing system, the method generates alert indicators that replicate the essential information needed (such as highlighting specific anatomical structures or instruments) and superimposes them onto the existing video feed, thereby maintaining system simplicity while enhancing contextual relevance.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12011236B2Systems and methods for rendering alerts in a display of a teleoperational system
Publication Date: 2024.06.18 INTUITIVE SURGICAL OPERATIONS INC
  • US12011236B2 patent drawing
  • US12011236B2 patent drawing
  • US12011236B2 patent drawing

AI summary

A method comprises displaying a surgical environment image. The surgical environment image includes a field of view image obtained by a first imaging system. The method also includes receiving alert information and providing an alert indication, based upon the alert information, within the surgical environment image by altering a portion of the surgical environment image.