UAV Image-Based Flight Control for Out-of-Sight Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Unmanned aerial vehicles (UAVs) are difficult to control when they are out of the user's sight, leading to inconvenience and potential flight accidents due to the lack of visual feedback.

Innovation Solution

A method and device that display prompt information in a photographed picture sent by the UAV, allowing users to intuitively control its flight direction by dividing the picture into portions representing different flight directions, with the control terminal obtaining the location of a click operation and adjusting the UAV's flight accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional rocker or button control is used, then the control method is simple, but the user cannot intuitively control the aerial vehicle when it is out of sight

Engineering Contradiction:
Improveintuitive controlVSAvoidcontrol system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent displays a real-time copied image from the aerial vehicle's camera on the user's device screen. This optical copy allows the user to see what the aerial vehicle sees, creating an intuitive visual reference for control. The user can tap on the displayed image to command the aerial vehicle to move toward the tapped location, establishing a direct visual-motor connection without complex control mappings.

Inventive Principle:
Principle #26Copying

2Reliability

If the user controls the aerial vehicle without visual feedback, then the control is simple, but flight accidents容易发生

Engineering Contradiction:
Improveflight safetyVSAvoidcontrol system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements real-time visual feedback by continuously transmitting images from the aerial vehicle's camera to the user's device. The user can see the aerial vehicle's current position, orientation, and surrounding environment, and this visual information is immediately reflected on the screen. When the user taps a location, the aerial vehicle moves toward it, and the next image shows the result of this action, creating a closed-loop feedback system that enhances safety.

Inventive Principle:
Principle #23Feedback

3Loss of information

If real-time picture transmission is implemented, then visual feedback is provided, but data transmission requirements increase

Engineering Contradiction:
Improvevisual information lossVSAvoidenergy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system transmits images at a frame rate that provides sufficient visual feedback for control purposes without transmitting every possible frame. This partial action approach ensures that the user receives enough visual information to control the aerial vehicle safely, while avoiding the excessive energy consumption that would result from continuous high-rate transmission of all sensor data.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11186366B2Method and device for controlling flight, control terminal, flight system and processor
Publication Date: 2021.11.30 SZ DJI TECH CO LTD
  • US11186366B2 patent drawing
  • US11186366B2 patent drawing
  • US11186366B2 patent drawing

AI summary

A method for controlling flight includes displaying prompt information in a picture received from an aerial vehicle, dividing the picture into at least two portions based on the prompt information, obtaining a location of a click operation on the picture, and controlling a flight direction of the aerial vehicle based on the location and the prompt information.