Surgical Hub AR Overlay for Role-Based Data Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing surgical imaging systems are limited in their ability to recognize and convey three-dimensional structural information and may fail to provide relevant data to clinicians intraoperatively, leading to potential distractions and inefficiencies in surgical procedures.
Innovation Solution
A surgical hub system that integrates augmented reality (AR) devices with multiple displays, allowing tailored AR content delivery based on user roles and display types, enabling real-time adjustment and overlay of surgical data, including anatomical information and procedural guidance, directly to relevant team members.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If surgical imaging systems display information on traditional monitors, then all team members can view the same information, but irrelevant information distracts team members who do not need it
Solution Approach 1:
The system delivers customized information to different users based on their roles and needs. Each user receives only the information relevant to their specific function in the surgical procedure, eliminating distractions from irrelevant data while ensuring all necessary information is provided to the appropriate team members.
Solution Approach 2:
The information display is segmented and distributed selectively to different users through individual AR devices rather than broadcasting the same information to all. This segmentation allows each user to receive a tailored information set appropriate to their role, improving overall information delivery efficiency.
2Reliability
If AR content is delivered to all users, then everyone receives comprehensive information, but information overload reduces surgical efficiency
Solution Approach 1:
The system provides locally optimized information delivery where each user receives a customized subset of information based on their specific needs and role. This ensures information completeness for each individual without creating overall information overload, thereby maintaining surgical efficiency.
Solution Approach 2:
The information delivery is dynamic and adaptive, adjusting the content and volume of information based on real-time surgical context and individual user needs. This dynamic approach ensures that each user receives appropriate information without overload, balancing completeness with efficiency.
3Adaptability or versatility
If multiple displays are used to show different information, then information can be tailored to user roles, but system complexity increases
Solution Approach 1:
Instead of using multiple physical displays, the system creates virtual copies of the information delivery interface through AR devices. Each user receives a personalized information stream that appears to be from a dedicated display, but is actually delivered through a unified digital platform, reducing physical complexity while maintaining customization capabilities.
Solution Approach 2:
The surgical hub system serves multiple functions through a single integrated platform: it manages multiple information streams, customizes content for different users, tracks user positions, and delivers information through AR devices. This multi-functionality reduces the need for separate specialized systems while maintaining high adaptability.
4Productivity
If AR devices are used for targeted information delivery, then distractions are reduced, but setup and operation complexity increases
Solution Approach 1:
The AR devices and surgical hub automatically perform tasks such as user identification, information customization, and content delivery without requiring manual configuration. The system self-adjusts based on user roles and surgical context, reducing the operational burden on surgical team members while maintaining high efficiency.
Solution Approach 2:
The surgical hub acts as an intermediary that manages the complexity of AR device coordination, information customization, and user tracking. This central mediator handles the sophisticated operations in the background, presenting a simplified interface to users while enabling advanced functionality.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A surgical hub may be in communication with at least one augmented reality device, at least one display and at least one smart surgical device. The surgical hub may provide interactive overlay of a display, such as a surgical display or a display on a smart surgical device. For example, surgical hub may generate augmented reality (AR) content for superimposing onto the display. The AR device may overlay or superimpose additional datasets or data streams received from the hub onto a display. This interactive overlay may enable the user of the AR device to layer data on a screen when the user is looking at the screen. The surgical hub may adjust the AR content based on the display the user is viewing via the AR device. For example, the hub may adjust the AR content when the user looks from one display to another display.