Gesture Control Mode for Medical Procedure Error Mitigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Medical systems using gesture input for controlling procedures face errors due to inadvertent or unwanted gestures, which can lead to unintended actions with high consequences for patients, as they lack effective error mitigation mechanisms.

Innovation Solution

Implementing a gesture control mode that requires an indicator gesture to initiate, limits the rate of change and adjustment range for gesture inputs, and includes mechanisms to ensure only intended user inputs are recognized, such as using camera-based or presence-sensitive sensors to detect hand motions and configurations, and applying error mitigation techniques like requiring confirmation gestures and limiting gesture input accuracy based on error rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture input is used to control medical procedures, then ease of operation is improved, but reliability deteriorates due to inadvertent gestures

Engineering Contradiction:
Improvegesture input controlVSAvoiderror mitigation
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system requires a specific indicator gesture to be performed before the gesture control mode is activated. This preliminary action ensures that the user intentionally wants to use gesture control, preventing inadvertent activation and improving reliability while maintaining ease of operation when properly initiated.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides visual feedback by displaying an indicator when gesture control mode is active, and requires confirmation gestures for critical actions. This feedback mechanism allows users to verify that their gestures are being recognized as intended, improving reliability without compromising the ease of gesture-based operation.

Inventive Principle:
Principle #23Feedback

2Productivity

If gesture control mode is activated for all actions, then productivity is improved, but reliability worsens due to increased error risk

Engineering Contradiction:
Improvegesture control efficiencyVSAvoidgesture input accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system applies different levels of error mitigation to different types of actions. Routine actions can be controlled with simpler gestures for maintained productivity, while critical actions require additional confirmation gestures or have more stringent validation, improving reliability where needed without reducing overall gesture control efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system adjusts the threshold for gesture recognition and the required precision based on the context and type of action being performed. For critical actions, it increases the precision requirement and may require multiple gestures, while for routine actions it maintains lower thresholds to preserve productivity. This dynamic parameter adjustment resolves the contradiction between efficiency and reliability.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If multiple error mitigation mechanisms are implemented, then reliability is improved, but device complexity increases

Engineering Contradiction:
Improvegesture input accuracyVSAvoidcontrol system structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system dynamically adjusts which error mitigation mechanisms are applied based on the current context, type of action, and detected user intent. Rather than having all mechanisms always active, the system enables only those necessary for the current situation, improving reliability when needed while minimizing the perceived complexity for the user.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system introduces an intermediary confirmation step for critical actions, where a second gesture or visual confirmation is required before execution. This intermediary mechanism adds reliability without significantly increasing complexity, as it builds upon the existing gesture recognition framework rather than introducing entirely new control pathways.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11347316B2Systems and methods for mitigating gesture input error
Publication Date: 2022.05.31 MEDTRONIC INC
  • US11347316B2 patent drawing
  • US11347316B2 patent drawing
  • US11347316B2 patent drawing

AI summary

Devices, systems, and techniques for mitigating error from gesture input are disclosed. A system may receive an indication of a first gesture input, determine that the first gesture input is an indicator gesture input, and, responsive to the determination that the first gesture input is the indicator gesture input, enter a gesture control mode during which the system is configured to control one or more actions related to a medical procedure. Only during the gesture control mode, the system may receive an indication of a second gesture input associated with the medical procedure and, responsive to receiving the indication of the second gesture input, control, based on the second gesture input, at least a portion of the medical procedure. Additionally, or alternatively, the system may employ other error mitigation techniques for gesture input related to medical procedures.