Surgical Theater GUI Using 3D Point Clouds for Nonoperative Period Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current graphical user interfaces (GUIs) for hospitals and surgical theaters are unreliable, inaccurate, and outdated, failing to provide efficient discovery of relevant information and are overly complex, leading to inefficiencies and potential harm during surgical and nonoperative periods.
Innovation Solution
The development of systems and methods that utilize theater-wide sensor data to create intuitive GUIs for analyzing nonoperative periods in surgical theaters, enabling automated data processing and feedback generation to improve team performance and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional GUIs are used for hospital procedures, then information is provided through system events and logs, but the information is unreliable, inaccurate, outdated, and overly complicated requiring steep learning curves
Solution Approach 1:
The patent replaces manual review of system events and logs with automated computer vision analysis of video feeds from surgical cameras. The system automatically detects objects, actions, and events in the surgical field, substituting mechanical/manual information gathering with automated optical detection and processing.
Solution Approach 2:
The system enables self-service by automatically generating structured information about surgical procedures without requiring manual intervention. The computer vision system autonomously captures, processes, and structures surgical data, eliminating the need for operators to manually review and interpret system events and logs.
2Productivity
If manual review of system events and logs is performed, then information can be obtained, but the process is passive, slow, and inefficient for discovering relevant information
Solution Approach 1:
The patent replaces manual information discovery with automated computer vision processing. The system continuously analyzes video feeds in real-time, automatically detecting and structuring surgical events, actions, and objects without requiring manual review, thereby dramatically improving information discovery efficiency.
Solution Approach 2:
The system implements continuous automated analysis of surgical video feeds throughout the procedure. Rather than periodic manual reviews, the computer vision system operates continuously to detect and record all relevant surgical events, ensuring no information is missed and providing real-time insights.
3Productivity
If automated data acquisition via in-theater sensors is used, then the number of nonoperative periods that can be reviewed increases, but the same data or type of data available during operative periods may no longer be available during nonoperative periods
Solution Approach 1:
The patent employs a universal data acquisition system using surgical cameras that capture video feeds during both operative and nonoperative periods. This multi-functional approach allows the same hardware to collect relevant data throughout the entire surgical workflow, not just during active procedures, ensuring continuous information availability.
Solution Approach 2:
The system captures and stores video data during nonoperative periods in advance of the actual surgical procedure. This preliminary data collection ensures that when the procedure begins, all relevant visual information is already recorded and available for analysis, eliminating gaps in data availability.
Data Source
AI summary
Data streams of information of medical procedures are received. The information includes case metadata of the medical procedures, a timeline of phases and tasks within each phase determined for each medical procedure, and three-dimensional point cloud data for each medical procedure during at least portions of phases and tasks within each phase. At least a portion of the information is provided for display using a hierarchical user interface structure. The hierarchical user interface structure includes a first level of a user interface to display, based at least on the three-dimensional point cloud data, a three-dimensional point cloud representation of a task of a phase selected from a timeline of a second level of user interface. The hierarchical structure includes the second level of the user interface to display the timeline and a portion of the case metadata associated with the timeline.