UAV Control Interface Using Virtual Joystick and Direction Indication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for controlling unmanned aerial vehicles (UAVs) are complex and difficult to use, especially for accurately navigating and capturing images, as they require skilled operation of joysticks or touch inputs to manage altitude and rotation in three-dimensional space.

Innovation Solution

An electronic device with a communication circuit, display, and processor that receives direction information from the UAV, displays a user interface for intuitive rod-type altitude adjustment and circular movement/rotation control, allowing users to easily operate the UAV with one hand by generating and transmitting control signals based on user inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional joystick-type operation devices are used to control UAV, then the UAV can be controlled to move and rotate in three-dimensional space, but the operation method becomes complex and difficult for users to operate skillfully

Engineering Contradiction:
ImproveUAV movement control capabilityVSAvoidUser operation difficulty
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent uses a smartphone screen as a virtual copy of the traditional joystick interface. The display shows a visual representation of the UAV and its movement directions, allowing users to control the UAV by touching or dragging on the screen rather than manipulating physical joysticks. This virtual interface simplifies the operation while maintaining full control capability.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical joystick system with a touchscreen-based electronic interface. Users interact with the UAV control system through touch inputs on the smartphone screen, which are then converted into control signals. This substitution eliminates the complexity of physical joystick manipulation while preserving three-dimensional movement control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If complex joystick operations are required to capture images with the UAV camera, then the UAV can be positioned accurately, but the user cannot easily capture images of the desired composition

Engineering Contradiction:
ImproveUAV positioning accuracyVSAvoidImage capture ease
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent displays a visual copy of the UAV's field of view and position on the smartphone screen. Users can see the camera's current orientation and drag the display to reposition the UAV, allowing them to compose images intuitively by directly manipulating the visual representation rather than controlling the UAV through complex joystick sequences.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system provides real-time visual feedback by displaying the UAV's current position, orientation, and camera view on the smartphone screen. As users drag the display to move the UAV, the visual representation updates immediately, allowing users to see the effect of their inputs and make precise adjustments to achieve the desired image composition.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If traditional operation methods are used, then the UAV can be controlled, but the user must use both hands to operate two joysticks complexly

Engineering Contradiction:
ImproveUAV control functionalityVSAvoidOperation device complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple control functions into a single touchscreen interface. Instead of requiring two separate joysticks for different control functions, the smartphone display integrates altitude adjustment, horizontal movement, and rotation controls into one unified interface that users can manipulate with one hand.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The touchscreen display serves multiple functions simultaneously: it displays the UAV's position and orientation, provides control inputs through touch or drag gestures, and shows real-time feedback. This multi-functional interface replaces the need for multiple specialized control devices, simplifying the overall system while maintaining full control capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10809710B2Method for controlling unmanned aerial vehicle and electronic device for controlling unmanned aerial vehicle
Publication Date: 2020.10.20 SAMSUNG ELECTRONICS CO LTD
  • US10809710B2 patent drawing
  • US10809710B2 patent drawing
  • US10809710B2 patent drawing

AI summary

An electronic device is provided that includes a communication circuit configured to transmit and receive wireless data with the unmanned aerial vehicle (UAV), a display configured to display a user interface (UI) for operating the UAV, a memory, and a processor electrically coupled with the communication circuit, the display, and the memory. The processor is configured to receive information about a direction of a first point of the UAV from the UAV, display a direction indication object corresponding to a direction of the first point on the display, in response to receiving a user input associated with movement or rotation of the UAV, generate a control signal for moving or rotating the UAV with respect to the first point in response to a location of the direction indication object and the user input, and transmit the generated control signal to the UAV using the communication circuit.