Eye-Tracking Surgical Robot Control via Gaze Direction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic surgical systems require manual input devices for controlling robotic arms, which can be cumbersome and limit the surgeon's ability to focus on the surgical field, and there is a need for improved eye-tracking systems to enhance user interaction and collaboration during procedures.

Innovation Solution

The implementation of advanced eye-tracking systems that allow surgeons to control robotic surgical systems using gaze direction, enabling intuitive control of robotic arms, camera movements, and data input through eye-tracking technology integrated into consoles and wearable devices, with additional features for tracking multiple users and monitoring stress levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual input devices are used to control robotic arms, then the surgeon can directly manipulate the robotic arms, but the surgeon's hands are occupied and cannot focus on the surgical field

Engineering Contradiction:
Improvehands-free control capabilityVSAvoideye-tracking system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical input devices with an eye-tracking system that uses optical detection to control robotic arms. The eye-tracking system captures eye movements through cameras and processes them to generate control signals, eliminating the need for manual manipulation while maintaining precise control capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary system between the surgeon's intentions and the robotic arm control. This intermediary consists of eye-tracking hardware (cameras, processors) and software that translates gaze direction and eye movements into control commands, enabling hands-free operation without direct mechanical interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If eye-tracking systems are implemented for control, then hands-free control is achieved, but the system complexity increases

Engineering Contradiction:
Improveautomatic control based on gaze directionVSAvoideye-tracking hardware and software complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The eye-tracking system enables the surgeon to control the robotic arms through natural eye movements without requiring additional manual input devices. The system automatically detects gaze direction and translates it into control commands, making the control process self-service oriented and reducing the need for complex manual interfaces.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent describes a multi-functional eye-tracking system that can perform various tasks including control of robotic arms, camera positioning, and interaction with display systems. This universal approach consolidates multiple control functions into a single eye-tracking infrastructure, potentially reducing overall system complexity despite the advanced nature of the technology.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If multiple eye trackers are added to track multiple users, then collaboration capability is enhanced, but the device complexity and cost increase

Engineering Contradiction:
Improvemulti-user tracking capabilityVSAvoidnumber of eye trackers required
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent describes eye-tracking systems that can be configured to track multiple users, enabling collaborative surgical procedures where multiple surgeons or surgical staff can control different robotic arms or functions simultaneously. The system uses multiple eye trackers or a single multi-user eye tracker to detect gaze directions from different individuals, providing versatile control capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent segments the control system into separate eye-tracking modules, each responsible for tracking a specific user's eye movements. This segmentation allows independent tracking of multiple users while maintaining modular architecture, making it easier to manage complexity and cost by adding only the necessary number of eye trackers for the specific surgical team size.

Inventive Principle:
Principle #1Segmentation

4Reliability

If eye-tracking systems monitor stress levels, then surgical safety is improved, but the system complexity and data processing requirements increase

Engineering Contradiction:
Improvesurgical safety monitoringVSAvoidstress monitoring system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent incorporates stress level monitoring into the eye-tracking system by analyzing eye movement patterns, gaze stability, and other physiological indicators that correlate with stress states. The system provides real-time feedback to surgical staff about stress levels, enabling proactive intervention to maintain surgical safety and prevent errors associated with high stress or fatigue.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces stress monitoring as an intermediary function within the existing eye-tracking infrastructure. By using the same eye-tracking hardware to detect stress-related eye behaviors and combining this with other physiological sensors, the system creates a comprehensive monitoring layer that enhances safety without requiring entirely separate complex monitoring systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11937891B2Systems and methods of controlling surgical robotic system using eye-tracking
Publication Date: 2024.03.26 KARL STORZ SE & CO KG
  • US11937891B2 patent drawing
  • US11937891B2 patent drawing
  • US11937891B2 patent drawing

AI summary

A surgical robotic system includes at least one eye tracking system positioned detect the direction of at least one user's gaze. Input derived from the eye tracking system may be used to enter commands to the surgical robotic system depending on the directions of the gaze detected or other aspects of the gaze such as pupil dilation or speed of eye movement.