Master Controller UI With Haptic Feedback for Surgical Teleoperation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing teleoperated surgical systems face challenges in providing intuitive and precise control over user interfaces, particularly when transitioning between three-dimensional surgical environments and two-dimensional configuration modes, leading to potential inaccuracies and inefficiencies in user interaction.
Innovation Solution
Implementing a system where master controllers provide haptic feedback and constrained movement to simulate tactile user interface controls, allowing users to interact with graphical user interfaces through gestures and pinching motions, while maintaining alignment with the surgical environment's perspective, thereby enhancing precision and accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional two-dimensional user interface controls are used in teleoperated surgical systems, then the system structure remains simple, but the precision and accuracy of user interaction deteriorates when transitioning between 3D surgical environments and 2D configuration modes
Solution Approach 1:
The patent creates a virtual copy of the physical master controller within the graphical user interface. This virtual master controller replicates the tactile controls and geometry of the physical device, allowing users to interact with 2D interface elements using the same natural hand gestures and motions they use with the physical controller. This copying approach maintains precision without requiring complex additional hardware, as the virtual controller is rendered software that mirrors the physical controller's interface.
Solution Approach 2:
The patent overlays a two-dimensional virtual master controller interface onto the three-dimensional surgical visualization environment. By projecting 2D interface controls into the 3D surgical scene, the system allows users to access configuration modes and control interface elements without leaving the immersive 3D surgical environment. This dimensional integration enables precise 2D interactions while maintaining the 3D contextual awareness needed for surgical precision.
2Measurement precision
If master controllers provide haptic feedback and constrained movement, then precision and accuracy of user interaction improves, but the device complexity increases
Solution Approach 1:
The patent implements haptic feedback mechanisms in the master controller that provide tactile resistance and force feedback to the user's hand gestures. When users perform gestures in the air to interact with the virtual master controller, the haptic system provides realistic tactile feedback that simulates pressing physical buttons or sliding controls. This feedback loop enhances accuracy by giving users sensory confirmation of their input actions without requiring complex mechanical control systems.
Solution Approach 2:
The patent replaces traditional mechanical control systems with gesture-based control in three-dimensional space. Instead of requiring users to manipulate physical switches or buttons for interface control, the system detects hand gestures in 3D space and translates them into interface commands. This substitution reduces mechanical complexity while maintaining or improving precision, as gesture recognition provides more degrees of freedom and natural interaction compared to mechanical controls.
3Adaptability or versatility
If the system transitions between three-dimensional surgical environments and two-dimensional configuration modes, then user interface functionality improves, but false clicks and interaction errors increase
Solution Approach 1:
The patent requires users to perform specific preparatory gestures before interface elements become active or selectable. For example, users must first establish a gesture zone or activate a selection mode before clicking or selecting interface elements. This preliminary action prevents accidental or false clicks by ensuring intentional user input, while still maintaining full 2D interface functionality. The system prepares the interaction state in advance, reducing errors during mode transitions.
Solution Approach 2:
The patent implements dynamic adjustment of the virtual master controller's geometry and control sensitivity based on the current operational mode. When transitioning between 3D surgical environment and 2D configuration mode, the virtual controller dynamically adapts its size, position, and response characteristics to optimize for the current context. This dynamic adaptation maintains reliability by adjusting interaction thresholds and sensitivity to prevent false clicks, while preserving full interface versatility across different operational states.
Data Source
AI summary
A system for controlling a user interface of a teleoperated surgical system, the system comprises a first master controller communicatively coupled to the teleoperated surgical system; and a display device communicatively coupled to the teleoperated surgical system and configured to display a graphical user interface; and wherein the first master controller is configured to transmit a first input signal to an interface controller, the first input signal caused by manual manipulation of the first master controller, the interface controller to use the first input signal to update a graphical user interface presented by the display device.