Surgical Display Control Using Visual Gaze and Context Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Surgical imaging systems often fail to recognize and convey crucial three-dimensional spatial information, such as concealed structures and dimensions, limiting clinician awareness during operations.
Innovation Solution
A surgical hub and/or medical instrument equipped with a processor and memory, capable of determining user, instrument, and location context, to control displays based on situational awareness, including visual focus and instrument exchange, to prioritize and display relevant surgical data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional imaging systems are used to view the surgical site, then the system structure remains simple, but crucial three-dimensional spatial information and concealed structures cannot be recognized or conveyed to the clinician
Solution Approach 1:
The patent combines multiple imaging modalities (2D camera, 3D imaging device, depth sensor) into a unified imaging system that captures both conventional visual information and three-dimensional spatial data simultaneously, resolving the contradiction by merging simple and complex imaging capabilities
Solution Approach 2:
The patent transitions from traditional 2D imaging to 3D imaging by introducing depth information and spatial dimensions. The 3D imaging device and depth sensor add the z-dimension to the conventional x-y plane imaging, enabling recognition of concealed structures and spatial relationships that were previously invisible
2Loss of information
If multiple displays are used to show comprehensive surgical data, then information completeness is improved, but it becomes difficult to prioritize and convey the most critical information to the clinician
Solution Approach 1:
The surgical hub continuously monitors contextual data from multiple sources (imaging devices, instrument status, user identity) and dynamically adjusts display content based on this feedback. The system prioritizes information presentation by analyzing the surgical context and determining which data is most relevant at each moment, resolving the contradiction between completeness and prioritization
Solution Approach 2:
The display system transitions from static information presentation to dynamic adaptation. The surgical hub continuously updates display content based on changing surgical conditions, instrument usage, and contextual factors, ensuring that the most critical information is always prioritized while maintaining overall data completeness
3Productivity
If the surgical system continuously monitors and adapts displays based on contextual data, then clinician awareness and surgical efficiency are improved, but the system complexity and processing requirements increase
Solution Approach 1:
The surgical system performs self-monitoring and self-adjustment through automated contextual analysis. The surgical hub automatically tracks instrument usage, identifies user identity, analyzes spatial relationships, and adjusts display priorities without requiring manual intervention, resolving the contradiction by making the system self-sufficient in its adaptive capabilities
Solution Approach 2:
The surgical hub serves multiple functions simultaneously: it acts as a central processing unit for contextual data, a display controller for prioritizing information, an instrument tracker for monitoring surgical progress, and a spatial analyzer for 3D reconstruction. This multi-functionality consolidates complexity into a single universal system rather than requiring separate specialized devices
Data Source
AI summary
A surgical hub for displaying information on a display based on a visual focus of a user may be provided. A display that is within a visual focus of the user may be determined. A surgical task that may use a medical instrument during a medical procedure may be determined. A display data that may be relevant to the user may be determined based on the contextual data and the surgical task. A message may be sent that may instruct the display to display the data.