UAV Gesture Recognition Control for Real-Time Tracking and Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current unmanned aerial vehicle (UAV) systems lack effective methods to interpret user gestures for real-time control and sensor adjustments, limiting their autonomy and remote operation capabilities.

Innovation Solution

A system comprising image sensors, remote controllers, and physical processors that recognize user gestures to control UAV flight and sensor operations, allowing for real-time adjustments of flight parameters and sensor settings based on user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If UAV systems use traditional remote control methods, then ease of operation is maintained, but extent of automation is limited

Engineering Contradiction:
ImproveautonomyVSAvoidcontrol complexity
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical remote control interfaces with gesture-based control. Image sensors capture gestures in the air, and processors interpret these gestures to generate flight control commands, substituting mechanical controllers with optical detection and computational interpretation systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces image sensors and gesture interpretation software as intermediaries between the user and the UAV control system. These intermediaries capture visual information about user gestures, process this information to determine control commands, and transmit commands to the flight control system, enabling natural gesture-based control.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If UAV systems add gesture recognition capabilities, then adaptability is improved, but device complexity increases

Engineering Contradiction:
Improvecontrol methodsVSAvoidsystem components
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent makes the UAV control system multi-functional by enabling it to accept both traditional remote control inputs and gesture-based inputs through the same flight control interface. The system can adaptively switch between control modes or process multiple control inputs simultaneously, enhancing versatility without requiring separate dedicated systems for each control method.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses image sensors to create visual copies of user gestures in digital form. These captured images are then processed by algorithms that interpret the gesture geometry and motion to generate control commands, effectively copying the physical gesture into a digital representation that can be processed and executed as control input.

Inventive Principle:
Principle #26Copying

3Productivity

If real-time gesture interpretation is implemented, then productivity is improved, but use of energy increases

Engineering Contradiction:
Improvecontrol response timeVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic sampling of gestures at optimized intervals rather than continuous processing. The system captures images at specific time intervals or triggered by motion detection thresholds, processes these sampled gestures to determine control commands, and updates flight control accordingly, reducing computational load while maintaining responsive control.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent performs preliminary processing of captured gesture images to quickly determine if a gesture meets recognition criteria before full processing. This includes preliminary checks for gesture presence, basic geometric validation, and motion threshold evaluation, allowing the system to skip intensive processing for non-gesture inputs and only fully process valid gestures, reducing overall computational energy consumption.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12117826B2Systems and methods for controlling an unmanned aerial vehicle
Publication Date: 2024.10.15 SKYDIO INC
  • US12117826B2 patent drawing
  • US12117826B2 patent drawing
  • US12117826B2 patent drawing

AI summary

The present teachings provide a system including image sensors, remote controllers, and one or more physical processors. The image sensors are configured to generate output signals conveying visual information regarding the one or more images of one or more individuals. The remote controllers are configured to be worn by individuals, and the remote controllers are in communication with the image sensors to provide location information to the image sensors regarding a location of the individuals wearing the remote controllers. The one or more physical processors are configured by computer-readable instructions to recognize the remote controllers worn by the individuals. The one or more physical processors are configured to track the individuals based on the location of the remote controllers. The one or more physical processors are configured to control the image sensors to capture images of the individuals based upon the location of the remote controllers.