Surgical Display Control Using Visual Gaze and Contextual Priority
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Surgical imaging systems often fail to recognize and convey crucial three-dimensional spatial information and concealed structures intraoperatively, limiting clinician awareness during procedures.
Innovation Solution
A surgical hub and medical instrument equipped with a processor and memory determine contextual data based on user, instrument, and location to control displays, prioritizing and displaying relevant information using situational awareness, including visual focus and user gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional surgical imaging systems are used, then the system structure remains simple, but the system fails to recognize and convey crucial three-dimensional spatial information and concealed structures
Solution Approach 1:
The patent transforms two-dimensional camera images into three-dimensional spatial representations by integrating data from multiple imaging modalities (optical, infrared, ultrasound) and applying computational algorithms to reconstruct depth and spatial relationships, enabling clinicians to visualize concealed structures in 3D space
Solution Approach 2:
The system merges multiple imaging systems (camera, depth sensor, infrared imager, ultrasound probe) into an integrated surgical imaging platform that combines their respective strengths to provide comprehensive three-dimensional spatial information and reveal concealed structures that no single modality could capture alone
2Loss of information
If multiple displays show all available information, then information completeness is maximized, but clinician awareness is reduced due to information overload
Solution Approach 1:
The system applies local quality by customizing display content based on each clinician's role, position, and current task. Different users receive tailored information sets - the surgeon sees critical spatial relationships and concealed structures, while the assistant sees instrument status and workflow information, ensuring each clinician receives only the most relevant data for their specific needs
Solution Approach 2:
The patent segments the information stream into priority levels and spatial zones, dividing the comprehensive data set into hierarchical layers (critical alerts, important spatial information, supplementary details) and distributing them across multiple displays according to their importance and relevance to different users, preventing information overload while maintaining completeness
3Loss of information
If the system displays all contextual data, then information availability is maximized, but the system fails to prioritize critical information for specific users
Solution Approach 1:
The system implements feedback mechanisms that continuously monitor clinician interactions with the display system, tracking which information elements are viewed, ignored, or acted upon. This feedback loop allows the system to dynamically adjust information prioritization and filtering, refining its understanding of each user's information needs and improving the precision of information delivery over time
Data Source
AI summary
A surgical hub comprising a processor. The processor configured to perform a number of actions. A surgical task may that uses a medical instrument during a medical procedure may be determined based on contextual data. A technique employed by a user during the surgical task may be determined. A performance of the technique employed by the user relative to a baseline may be analyzed using the contextual data. A corrective action may be determined when the performance of the technique deviates from the baseline. A data priority based on the corrective action may be determined. A first message for a display may be generated based on the data priority. A second message for the medical instrument may be generated to cause an adjustment of one or more operational parameters when the performance of the technique deviates from the baseline.