UAV Gesture Control via Onboard Image Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current UAV control systems rely on data connectivity and software compatibility, which can expose private data and networks to unauthorized access, and may not allow for efficient control without continuous eye contact between the operator and the UAV, especially in scenarios where data connections are unreliable.

Innovation Solution

Implementing a gesture control system using an image sensor and an aircraft marshaling signal database within the UAV, allowing it to detect and authenticate authorized ground crew members' gestures, compare these gestures with standardized marshaling signals, and execute corresponding flight commands without requiring data connectivity or compatible software.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If UAV control systems use data connectivity and software compatibility for operation, then control functionality and software integration are improved, but network security and data privacy are compromised due to unauthorized access risks

Engineering Contradiction:
Improvecontrol functionalityVSAvoidunauthorized access risk
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The control system is segmented into multiple independent components: gesture recognition module, authentication module, and flight control module. This segmentation allows the UAV to process control inputs locally without requiring continuous network connectivity, thereby maintaining control functionality while reducing exposure to network-based unauthorized access risks.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An image sensor acts as an intermediary between the operator and the UAV control system. The sensor captures gestures and transmits them to the flight control system for processing, eliminating the need for direct network communication and software compatibility requirements while maintaining secure local processing of control commands.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If UAV control requires continuous data connectivity, then remote control capability is improved, but system reliability deteriorates in situations with unreliable network connections

Engineering Contradiction:
Improveremote control capabilityVSAvoidcontrol system reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The UAV is pre-equipped with an image sensor and gesture recognition algorithms stored in its flight control system. This preliminary configuration enables the UAV to independently process and respond to control gestures without requiring real-time network connectivity, ensuring reliable operation even when network connections are unavailable or unstable.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If UAV control systems require software compatibility and data connectivity, then control versatility is improved, but operational efficiency deteriorates due to continuous eye contact requirements between operator and UAV

Engineering Contradiction:
Improvecontrol method versatilityVSAvoidoperational efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The flight control system incorporates self-service capabilities by including an image sensor and gesture recognition functionality directly onboard. This allows the UAV to autonomously detect and interpret control gestures without requiring external software processing or continuous operator visual monitoring, thereby improving operational efficiency while maintaining control versatility.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables secure, efficient, and eyes-free control of UAVs by authorized personnel, even in situations without data connectivity, while maintaining network security and allowing for autonomous operation with backup control methods.

Implementation Method 1

an image sensor on the UAV... detect, with the image sensor, a gesture from a ground crew member

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10507917B2Apparatuses and methods for gesture-controlled unmanned aerial vehicles
Publication Date: 2019.12.17 WALMART APOLLO LLC
  • US10507917B2 patent drawing
  • US10507917B2 patent drawing
  • US10507917B2 patent drawing

AI summary

Systems, apparatuses, and methods are provided herein for unmanned aerial vehicle (UAV) control. A system for UAV control comprises a flight control system of a UAV, an image sensor on the UAV, an aircraft marshaling signal database, and a control circuit coupled to the flight control system, the image sensor, and the aircraft marshaling signal database. The control circuit being configured to: detect, with the image sensor, a gesture from a ground crew member, verify that the ground crew member is an authorized controller of the UAV, compare the gesture with marshaling signals in the aircraft marshaling signal database to determine a corresponding marshaling signal, determine a flight command based on the corresponding marshaling signal, and execute the flight command with the flight control system of the UAV.