Multi-Sensor Wearable for Gesture Control of Unmanned Vehicles

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Unmanned systems require specialized training for operators, which is impractical and can be fatal in battlefield situations due to delays in calibration and detection of operator commands using crude single-sensor systems.

Innovation Solution

A multi-sensor apparatus in a wearable device detects operator gestures using accelerometers, magnetometers, gyroscopes, and resistance strips to rapidly determine hand movements, allowing for remote signaling control of unmanned vehicles without complex calibration procedures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single-sensor system is used to detect operator gestures, then the device complexity is reduced, but the measurement precision and detection speed deteriorate

Engineering Contradiction:
Improvesensor system complexityVSAvoidgesture detection precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent combines multiple sensors (accelerometer, gyroscope, magnetometer, resistance strip) into a single wearable device to detect operator gestures. This merging of sensors allows the system to capture comprehensive motion data from different dimensions, improving measurement precision without requiring a complex array of separate devices.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The gesture detection function is segmented across multiple sensor types, each responsible for detecting specific aspects of hand movement. The accelerometer detects linear acceleration, the gyroscope detects rotational movement, the magnetometer detects orientation relative to earth, and the resistance strip detects finger movement. This segmentation allows each sensor to specialize in its measurement domain, improving overall precision.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If a single-sensor system is used to detect operator gestures, then the ease of operation is improved, but the detection speed and response time worsen

Engineering Contradiction:
Improvesystem operation simplicityVSAvoidgesture detection speed
Core Design Contradiction:
Ease of operationVSSpeed

Solution Approach 1:

The multi-sensor system continuously monitors operator gestures in real-time, with all sensors operating simultaneously to detect hand movements. This continuous multi-dimensional monitoring enables rapid detection of gesture changes without the calibration delays associated with single-sensor systems, improving response speed while maintaining ease of operation through standardized gesture recognition.

Inventive Principle:
Principle #20Continuity of useful action

3Reliability

If specialized training is provided for operating unmanned systems, then the reliability of operation is improved, but the loss of time for training and deployment worsens

Engineering Contradiction:
Improveoperational reliabilityVSAvoidtraining time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system uses natural hand gestures that operators can perform intuitively without specialized training. The wearable device automatically detects and interprets these gestures, eliminating the need for operators to learn complex control interfaces or undergo lengthy training programs, thereby reducing training time while maintaining operational reliability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The control interface is transformed from complex instrument-based controls to simple hand gesture parameters. By changing the control paradigm from requiring precise instrument manipulation to recognizing natural hand movements, the system reduces the skill level required while maintaining reliable control of unmanned vehicles.

Inventive Principle:
Principle #35Parameter changes

4Measurement precision

If calibration procedures are implemented for sensor systems, then the measurement precision is improved, but the loss of time for calibration and deployment worsens

Engineering Contradiction:
Improvesensor measurement precisionVSAvoidcalibration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary calibration actions automatically during initial setup and maintains calibration through continuous multi-sensor fusion. The combination of accelerometer, gyroscope, and magnetometer data provides inherent reference frames that reduce the need for manual calibration procedures, minimizing calibration time while ensuring measurement precision.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables rapid and accurate detection of operator gestures, reducing the need for extensive training and minimizing delays in command execution, thus enhancing operational safety and efficiency in dynamic environments.

Implementation Method 1

an accelerometer to detect motion and direction of the operator gestures with respect to operator hand movement

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

a magnetometer to detect operator hand movement with respect to the earth

Methodology Applied
Scientific EffectMagnetometer: Magnetometer

Implementation Method 3

a gyroscope to detect rotational movement of the operator hand

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Implementation Method 4

a resistance strip to detect finger movement on the operator hand

Methodology Applied
Scientific EffectElectrical Resistance: Electrical Resistance

Data Source

PatentUS10459524B2Multi-sensor control system and method for remote signaling control of unmanned vehicles
Publication Date: 2019.10.29 NORTHROP GRUMMAN SYSTEMS CORP
  • US10459524B2 patent drawing
  • US10459524B2 patent drawing
  • US10459524B2 patent drawing

AI summary

An apparatus includes a wearable device having a multi-sensor detector to sense operator gestures directed at an unmanned vehicle (UV). The multi-sensor detector includes at least two sensors to detect motion and direction of the operator gestures with respect to operator hand movement, operator hand movement with respect to the earth, rotational movement of the operator hand, and finger movement on the operator hand. A controller monitors the multi-sensor detector to determine the operator gesture based on input data received from the sensors. The controller generates a command to the UV based on the determined operator gesture.