Head-Mounted Surgical Workflow Deviation Detection Guidance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Surgical teams often deviate from pre-scripted workflows due to unforeseen operative intricacies, lacking suitable systems and methods to maintain seamless surgical procedures.

Innovation Solution

A head-mounted device (HMD) equipped with a camera, display, and controller that monitors surgical environments, detects deviations from workflow steps, and provides tailored instructions or recommendations to users through visual, auditory, or tactile feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If surgical teams rely on pre-scripted workflows, then procedural consistency is improved, but adaptability to unforeseen operative intricacies deteriorates

Engineering Contradiction:
Improveprocedural consistencyVSAvoidadaptability to unforeseen events
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The system continuously monitors surgical workflow through camera feeds and sensor data, comparing actual progress against the pre-scripted workflow plan. When deviations are detected, the system provides real-time feedback to the surgical team through the HMD display, enabling dynamic adaptation while maintaining overall procedural consistency. The feedback loop allows the system to adjust recommendations based on current surgical status and historical data.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The workflow system transitions from a static pre-scripted plan to a dynamic adaptive process. The system continuously updates workflow status, detects deviations in real-time, and adjusts recommendations based on current surgical conditions. This dynamic approach allows the surgical team to maintain procedural consistency while adapting to unforeseen events through real-time system guidance.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If surgical teams deviate from pre-scripted workflows to handle unforeseen events, then adaptability is improved, but procedural consistency and efficiency deteriorate

Engineering Contradiction:
Improveadaptability to unforeseen eventsVSAvoidsurgical efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system provides real-time feedback when deviations from the pre-scripted workflow are detected, helping the surgical team understand the nature and impact of the deviation. This feedback enables informed decision-making about whether to continue the deviation or return to the planned workflow, maintaining efficiency while allowing necessary adaptability.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system prepares multiple workflow scenarios and potential deviation pathways in advance. When unforeseen events occur, the system can quickly present pre-analyzed alternative workflows or corrective actions, reducing the time and efficiency loss associated with handling unexpected situations.

Inventive Principle:
Principle #10Preliminary action

3Difficulty of detecting and measuring

If comprehensive workflow monitoring is implemented, then deviation detection capability is improved, but system complexity increases

Engineering Contradiction:
Improvedeviation detection capabilityVSAvoidsystem complexity
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The monitoring system is divided into modular components: camera modules for visual monitoring, sensor modules for physiological and environmental monitoring, workflow analysis software for deviation detection, and HMD display for information presentation. Each module performs a specific function, making the overall complex system manageable and maintainable while achieving comprehensive monitoring capability.

Inventive Principle:
Principle #1Segmentation

4Reliability

If real-time workflow monitoring and deviation detection are implemented, then surgical coordination is improved, but information processing requirements and system resource consumption increase

Engineering Contradiction:
Improvesurgical coordinationVSAvoidsystem resource consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system implements periodic monitoring at strategically determined intervals rather than continuous full-scale analysis. The workflow monitoring checks for deviations at key surgical milestones and decision points, reducing computational resource consumption while maintaining reliable surgical coordination. The system adjusts monitoring frequency based on surgical phase and detected anomaly levels.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS12349988B2Surgical workflow deviation detection involving head-mounted device
Publication Date: 2025.07.08 MAKO SURGICAL CORP
  • US12349988B2 patent drawing
  • US12349988B2 patent drawing
  • US12349988B2 patent drawing

AI summary

A head-mounted device (HMD) and method for assisting a user during a surgical procedure. The HMD has a camera and display supported by a head-mountable structure. The display is positionable in front of eyes of the user. A controller accesses workflow data defining workflow steps associated with the surgical procedure. The controller obtains data from the camera related to an environment of the surgical procedure. The camera data is monitored to detect a deviation or a potential deviation from one or more of the workflow steps. The controller generates an instruction/recommendation to assist the user in taking action to address the deviation or the potential deviation. The instruction/recommendation is specifically tailored to workflow responsibilities of the user. A computer-generated image related to the instruction or the recommendation is provided on the display.