3D Touch UAV Waypoint Selection With Surface-Matched Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remote controlling of UAVs in complex environments is challenging due to the need for intuitive and reliable selection of targets or waypoints, often requiring multiple user inputs and lacking feedback during the selection process, which can lead to inefficiency and increased collision risk.

Innovation Solution

A computer-implemented UAV control method that displays a 3D-view of the environment on a touch-sensitive screen, allowing users to intuitively and reliably select targets or waypoints by overlaying a movable target indicating symbol, which dynamically changes appearance based on the underlying object's orientation and texture, providing continuous feedback during the selection process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a traditional 2D interface is used for UAV control, then the device complexity is reduced, but the ease of operation deteriorates due to difficulty in intuitively selecting targets in 3D environment

Engineering Contradiction:
Improveintuitiveness of target selectionVSAvoidcomplexity of control interface
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies dimensionality change by displaying a three-dimensional view of the environment on a two-dimensional touch-sensitive display. This allows users to interact with 3D spatial representations (buildings, obstacles, targets) using 2D touch gestures, making target selection more intuitive while maintaining compatibility with standard display devices. The 3D view preserves depth information and spatial relationships without requiring complex 3D hardware interfaces.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If multiple user inputs are required for target selection, then the reliability of target selection improves, but the productivity deteriorates due to increased time and steps required

Engineering Contradiction:
Improveaccuracy of target selectionVSAvoidspeed of target selection
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements feedback by displaying a movable target indicating symbol that provides continuous visual feedback during the selection process. As users drag the symbol across the 3D view, they can see its position relative to buildings, obstacles, and potential targets in real-time. This immediate feedback allows users to confirm correct target selection during the dragging motion itself, eliminating the need for multiple confirmation steps while maintaining high accuracy.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The target indicating symbol is pre-configured with properties such as color, transparency, and size that are optimized for visibility and interaction. The symbol is also pre-programmed to respond to touch gestures and update its position continuously during dragging, enabling users to perform selection in a single continuous action rather than through multiple discrete steps.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If a static target indicating symbol is used, then the device complexity is reduced, but the ease of operation deteriorates due to lack of feedback during selection

Engineering Contradiction:
Improvefeedback during selection processVSAvoidcomplexity of target indicating symbol
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the target indicating symbol movable rather than static. The symbol can be dragged across the 3D view by user touch input, and its position updates continuously during the dragging motion. This dynamic behavior provides intuitive feedback as users can see the symbol's position relative to environmental features in real-time, making the selection process more interactive and user-friendly without requiring complex additional components.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The target indicating symbol utilizes color and transparency properties to provide visual feedback. The symbol can be configured with specific colors and transparency levels that make it visible against various backgrounds in the 3D view. These visual properties help users track the symbol's position and understand its relationship to surrounding objects during the selection process.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS20210397202A1Touch control of unmanned aerial vehicles
Publication Date: 2021.12.23 HEXAGON GEOSYSTEMS SERVICES AG
  • US20210397202A1 patent drawing
  • US20210397202A1 patent drawing

AI summary

The invention relates to a computer implemented UAV control method comprising, in a target selection mode, the steps of displaying on a touch sensitive display a 3D-view of an environment of a UAV; Overlaying a moveable target indicating symbol to the 3D-view of the environment, wherein the target indicating symbol is moveable in the 3D-view by a touch input; While moving the target indicating symbol, continuously determining a location of the target indicating symbol in the 3D-view and dynamically changing the appearance of the target indicating symbol such that it creates the impression of being displayed in an orientation matching the orientation of a face over which the target indicating symbol is located wherein the orientation of the respective face is derived from stored 3D-data or from the 3D-view; And selecting a target based on the location of the target indicating symbol.