Customizable Surgical AR Overlays for Role-Based Information Delivery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge during surgical procedures is the overwhelming amount of information that surgical teams face, which can lead to spurious data for members not directly relevant to their specific roles, complicating coordination and efficiency.

Innovation Solution

An augmented reality-based surgical system that distributes data to team members based on their specific roles, using a modular control tower to integrate imaging data, device-dependent data, and functional roles to provide targeted, concise visual, auditory, and haptic feedback through display devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all surgical data is displayed to all team members, then complete information availability is achieved, but information overload and coordination complexity increase

Engineering Contradiction:
Improveinformation availabilityVSAvoidcoordination complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments surgical data distribution by creating role-specific display configurations for different surgical team members. The system divides the unified surgical data stream into customized subsets based on each member's functional role, allowing selective information delivery that maintains completeness while reducing individual information load and coordination complexity.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If role-specific data filtering is implemented, then information overload is reduced, but data distribution system complexity increases

Engineering Contradiction:
Improveinformation management easeVSAvoiddata distribution system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system implements self-service data filtering by automatically assigning functional roles to surgical team members and generating customized display configurations without manual intervention. The modular control tower autonomously manages data distribution based on detected roles and procedures, reducing the perceived complexity for users while the system handles the filtering complexity internally.

Inventive Principle:
Principle #25Self-service

3Loss of information

If multiple display configurations are maintained for different roles, then information relevance is improved, but system adaptability requirements increase

Engineering Contradiction:
Improveinformation relevanceVSAvoidsystem adaptability
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic display configurations that automatically adapt to changing surgical conditions. The system detects functional roles in real-time and adjusts data distribution and display configurations dynamically during procedures, allowing multiple role-specific configurations to be maintained and switched as needed without requiring manual reconfiguration, thereby improving information relevance while managing adaptability requirements through automation.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12354186B2Customization of overlaid data and configuration
Publication Date: 2025.07.08 CILAG GMBH INTERNATIONAL
  • US12354186B2 patent drawing
  • US12354186B2 patent drawing
  • US12354186B2 patent drawing

AI summary

A method of distributing data among members of a surgical team may include receiving imaging data, by a modular control tower, from a plurality of imaging devices, receiving device-dependent data, by the modular control tower, from each of a plurality of intelligent surgical instruments, associating, by the modular control tower, a display device with a member of the surgical team, defining, by the modular control tower, a functional role for the member of the surgical team, and displaying, by the modular control tower, a augmented reality display by the display device. The augmented reality display on the display device may include virtual objects based on the imaging data, the device-dependent data, the functional role of the member of the surgical team, and a surgical activity by the member of the surgical team. An interactive surgical system may implement this method.