Teleoperation Haptic Menu Feedback for Surgical GUI Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Teleoperational medical systems lack effective haptic feedback mechanisms when navigating graphical user interfaces, which can lead to user disorientation and reduced operational efficiency during minimally invasive procedures.

Innovation Solution

A method that applies haptic forces to control devices to simulate a nominal position, an engaged operational state, and a return to the nominal position, providing tactile feedback indicative of menu item selection and navigation through graphical user interfaces, enhancing user interaction and immersion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If graphical user interfaces are used to control teleoperated medical tools, then the functionality of the system is extended without adding structural controls, but the user experiences disorientation and reduced operational efficiency due to lack of haptic feedback

Engineering Contradiction:
Improvefunctionality extensionVSAvoiduser orientation
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system applies haptic feedback forces to the control device to provide tactile cues to the user during menu navigation. When a menu item is selected, a haptic force is applied to indicate the selection state, giving the user sensory feedback that confirms their input and reduces disorientation when using graphical interfaces.

Inventive Principle:
Principle #23Feedback

2Device complexity

If graphical user interfaces are used instead of additional structural controls, then the device complexity is reduced, but the user experiences reduced operational efficiency during menu navigation

Engineering Contradiction:
Improvecontrol structureVSAvoidoperational efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

Haptic feedback is applied to the control device to provide tactile confirmation during menu navigation. This feedback mechanism improves operational efficiency by giving users sensory confirmation of their selections and system state, enabling faster and more accurate interaction with the graphical interface without adding physical controls.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If haptic feedback is applied to indicate menu item selection, then user interaction is improved with clear tactile cues, but the system requires additional haptic control mechanisms

Engineering Contradiction:
Improveuser interactionVSAvoidhaptic control mechanism
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The haptic feedback functionality is merged with the existing control device that is already used to manipulate medical instruments. The same control device provides both instrument control and menu navigation with haptic feedback, eliminating the need for separate haptic feedback mechanisms and reducing overall system complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The control device is designed to serve multiple functions: it controls medical instruments during surgical procedures and also navigates graphical user interface menus with haptic feedback. This multi-functionality reduces the need for additional dedicated controls while improving user interaction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves user interaction with graphical user interfaces by providing clear tactile cues, reducing user disorientation and enhancing operational efficiency during teleoperational medical procedures.

Implementation Method 1

applying a haptic force to the control device

Methodology Applied
Scientific EffectHaptic feedback: Vibration

Data Source

PatentEP3648698B1Methods for haptic feedback in selection of menu items in a teleoperational system
Publication Date: 2024.11.20 INTUITIVE SURGICAL OPERATIONS INC
  • EP3648698B1 patent drawingFigure 1A
  • EP3648698B1 patent drawingFigure 1B
  • EP3648698B1 patent drawingFigure 1C

AI summary

A haptic feedback method comprises providing a teleoperational control system including a first operational mode for operating a teleoperational instrument in response to movement of a control device in a first degree of freedom and a second operational mode for controlling a graphical user interface. The method also includes engaging the second operational mode of the teleoperational control system. While in the second operational mode, the method includes tracking movement of the control device of in a second degree of freedom, different from the first degree of freedom. While in the second operational mode and responsive to the movement of the control device in the second degree of freedom, the method includes applying, by a teleoperational control system, a first haptic force to the control device.