Haptic Menu Navigation in Teleoperational Control Interfaces

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing teleoperational control systems lack effective haptic feedback mechanisms for navigating graphical user interfaces, which can hinder user interaction and immersion during minimally invasive medical procedures.

Innovation Solution

Implement a teleoperational control system with distinct operational modes for instrument control and graphical user interface navigation, providing haptic feedback through controlled haptic forces to guide the user's control device movements, enhancing user interaction and immersion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If graphical user interfaces are used to control teleoperational instruments, then the functionality of the system is extended without adding structural controls, but the user interaction and immersion are hindered due to lack of haptic feedback

Engineering Contradiction:

Improvefunctionality extensionVSAvoiduser interaction

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces haptic feedback mechanisms that provide tactile responses to users when interacting with graphical user interface menu items. The system detects when a control device is positioned over a menu item and applies haptic forces to indicate selection, confirmation, or dismissal states, creating a sensory feedback loop that enhances user interaction without adding physical controls

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent uses haptic feedback as an intermediary between the graphical user interface and the user's tactile sense. This intermediary translates digital menu states into physical sensations, allowing users to interact with virtual elements through tactile cues rather than direct physical contact, thus bridging the gap between graphical interfaces and human sensory perception

Inventive Principle:

Principle #24Intermediary (Mediator)

2Device complexity

If graphical user interfaces are used instead of additional structural controls, then the device complexity is reduced, but the user immersion and interaction quality deteriorate

Engineering Contradiction:

Improvecontrol structureVSAvoiduser immersion

Core Design Contradiction:

Device complexityVSEase of operation

Solution Approach 1:

The patent replaces additional mechanical controls with a haptic feedback system that works within the existing control device framework. Instead of adding more physical buttons, switches, or levers, the system uses controlled haptic forces applied to the existing control device to provide menu navigation feedback, substituting mechanical complexity with intelligent force application

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the operational parameters of the existing control device by introducing variable haptic forces that can be applied in different degrees of freedom. The system modulates the magnitude, direction, and timing of haptic feedback based on the user's interaction state with menu items, transforming a simple control device into a multi-functional interface without adding structural elements

Inventive Principle:

Principle #35Parameter changes

3Ease of operation

If haptic feedback is applied during graphical user interface navigation, then user interaction is enhanced, but the system complexity increases

Engineering Contradiction:

Improveuser interactionVSAvoidsystem structure

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent makes the existing control device multi-functional by enabling it to serve both as a teleoperational instrument controller and as a graphical user interface input device. The same control device that manipulates medical instruments also navigates menus through haptic feedback interactions, eliminating the need for separate control mechanisms and reducing overall system complexity despite the enhanced functionality

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces dynamic haptic feedback that adapts in real-time based on the user's interaction with menu items. The haptic forces are dynamically adjusted according to the selected menu item state (selection, confirmation, dismissal), creating a responsive and adaptive interface that enhances user interaction without requiring static additional controls

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS12484985B2Systems and methods for haptic feedback in selection of menu items in a teleoperational system

Publication Date: 2025.12.02 INTUITIVE SURGICAL OPERATIONS INC

AI summary

A teleoperational control system may comprise a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, may cause the system to engage a first operational mode of the teleoperational control system for controlling a teleoperational instrument in response to movement of a control device in a first degree of freedom and engage a second operational mode of the teleoperational control system for controlling a graphical user interface. While in the second operational mode, the system may track movement of the control device in a second degree of freedom, different from the first degree of freedom. While in the second operational mode and responsive to the movement of the control device in the second degree of freedom, the system may apply a first haptic force to the control device.