Gesture-Based UAV Interface for Precise Navigation by Non-Experts

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Unmanned aerial vehicles (UAVs) are difficult to control and require specialized training, limiting their use by insurers and laypersons for tasks such as insurance-related data collection, which can delay claim processing.

Innovation Solution

A graphical user interface (GUI) is provided for UAV control, allowing users to navigate and control UAVs using intuitive gestures and displays, enabling semi-autonomous data collection while minimizing user interaction through collision-avoidance techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional specialized controls (joysticks, directional pads) are used for UAV navigation, then control precision is improved, but ease of operation deteriorates due to the learning curve required

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces traditional mechanical control interfaces (joysticks, directional pads) with a touchscreen display that accepts gesture inputs. Users interact with the UAV by performing gestures directly on the displayed video feed, such as swiping to change direction or pinching to adjust altitude, eliminating the need to learn specialized control mechanisms while maintaining intuitive navigation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If automated collision-avoidance techniques are implemented, then ease of operation is improved by minimizing user interaction, but device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The UAV incorporates automated collision-avoidance systems that independently monitor the environment and navigate around obstacles without requiring user intervention. The system uses onboard sensors to detect obstacles and automatically adjusts flight paths, allowing the UAV to serve itself in avoiding collisions while the user focuses on high-level navigation tasks through simple gestures.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If specialized training is required for UAV operation, then control precision is improved, but productivity deteriorates due to limited availability of trained operators

Engineering Contradiction:
Improvecontrol precisionVSAvoidproductivity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces complex mechanical control systems with intuitive gesture-based controls on a touchscreen display. Users can navigate the UAV by swiping across the video feed in the desired direction or pinching to adjust altitude, eliminating the need for specialized training while maintaining precise control. This substitution enables insurance personnel and laypersons to operate UAVs immediately for data collection tasks.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If manual navigation control is used, then ease of operation is improved for trained users, but loss of time increases due to delayed claim processing when untrained personnel are involved

Engineering Contradiction:
Improveease of operationVSAvoidloss of time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces traditional mechanical control interfaces with a touchscreen display that responds to natural gestures. Insurance personnel can immediately operate the UAV for claim inspections by performing simple gestures on the video feed, eliminating the time loss associated with training requirements while maintaining intuitive and easy operation for all users.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10969781B1User interface to facilitate control of unmanned aerial vehicles (UAVs)
Publication Date: 2021.04.06 STATE FARM MUTAL AUTOMOBILE INSURANCE COMPANY
  • US10969781B1 patent drawing
  • US10969781B1 patent drawing
  • US10969781B1 patent drawing

AI summary

Various techniques are described to facilitate the control of an unmanned aerial vehicle (UAV). A graphical user interface (GUI) is provided that allows a user to control a UAV using familiar gestures. The GUI may include live video that is captured and transmitted by a UAV, which may be displayed in a display window on a portable computing device. Upon a user interacting with the display window, the video may be updated to display a new UAV perspective by changing a zoom level, panning, rotating, etc., based upon the type of user interaction. In response to the user interaction, a command may be generated and transmitted to the UAV, causing the UAV to navigate to a location to reflect the change in perspective. Upon the UAV moving to the new position, the live video data that is displayed may match the perspective indicated by the user gesture.