AR Headset Gaze Control for Sterile OR Scan Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Surgeons face difficulties in manipulating patient scans during surgical procedures due to the limitations of traditional OR displays, which are often cumbersome and non-sterile, requiring additional steps or assistance from non-sterile team members.

Innovation Solution

An augmented reality headset system that allows surgeons to control and manipulate patient scan information using gaze tracking, enabling hands-free and sterile interaction with scan planes and control objects, such as virtual joysticks or buttons, to adjust the display without leaving the surgical field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional OR displays are used to display patient scans, then scan information is visible to the surgeon, but the surgeon cannot easily manipulate the scan display while scrubbed in

Engineering Contradiction:
Improveease of manipulating patient scanVSAvoidcomplexity of manipulation steps
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical hand-operated controls with a voice-activated system. The surgeon uses spoken commands to manipulate patient scans on the OR display, eliminating the need for physical interaction with the display interface. This allows the surgeon to control scan navigation, zooming, and other manipulations while maintaining sterile technique without requiring complex manual操作步骤.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a voice recognition system as an intermediary between the surgeon and the OR display. This intermediary translates the surgeon's spoken instructions into control signals for the display system, enabling indirect but sterile manipulation of the patient scan interface without direct contact with the display or control mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the surgeon manipulates the OR monitor directly, then the scan can be controlled, but the surgeon must scrub out or use additional steps

Engineering Contradiction:
Improvesurgical procedure efficiencyVSAvoidtime for additional manipulation steps
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The voice-activated system allows the surgeon to manipulate patient scans during the surgical procedure without scrubbing out or performing additional manual steps. Spoken commands enable real-time control of the OR display, maintaining surgical flow and eliminating time loss associated with traditional manipulation methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables the surgeon to independently control the OR display without assistance from non-sterile team members. The voice recognition technology allows the surgeon to self-manage scan navigation and manipulation tasks while maintaining sterile technique, eliminating the need for additional personnel involvement and reducing procedural delays.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If non-sterile team members manipulate the display, then the scan can be adjusted, but sterility is compromised

Engineering Contradiction:
Improveability to manipulate scan displayVSAvoidsterility maintenance
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The voice-activated control system replaces physical contact with the display interface, allowing the surgeon to manipulate patient scans while maintaining sterile technique. Spoken commands transmit control signals without requiring the surgeon to touch non-sterile surfaces or equipment, thereby preserving sterility while enabling full display manipulation capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Facilitates easy, accurate, and sterile manipulation of patient scans, reducing the need for additional steps and minimizing disruption to the surgical procedure by providing direct, hands-free control over scan information, enhancing surgical efficiency and safety.

Implementation Method 1

monitoring a location of a focus of a user's gaze

Methodology Applied
Scientific EffectEye tracking:

Data Source

PatentUS11922581B2Systems and methods of controlling an operating room display using an augmented reality headset
Publication Date: 2024.03.05 COVIDIEN LP
  • US11922581B2 patent drawing
  • US11922581B2 patent drawing
  • US11922581B2 patent drawing

AI summary

Augmented reality (AR) systems and methods involve an interactive head-mounted device (HMD), an external display, and a medical image computer, which is in communication with the HMD and the external display. The external display displays one or more planes of a medical image or a 3D model provided by the medical image computer. A user wearing the HMD may manipulate a medical image or 3D model displayed on the external display by focusing the user's gaze on a control object and/or a portion of a medical image or 3D model displayed on a display of the interactive HMD.