UAV interaction system based on gesture recognition, and control method thereof

An interactive system and control method technology, applied in the design field of the UAV interactive system and its control method, can solve the problems that UAV control is not simple, fast, intelligent, etc., achieve good practicability and scalability, increase Real-time, accelerated effects

Inactive Publication Date: 2019-01-25
SOUTHWEAT UNIV OF SCI & TECH
View PDF13 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to solve the problem that the existing unmanned aerial vehicle control is not simple, fast and intelligent enough in task execution, and proposes an interactive system and control method for unmanned aerial vehicles based on gesture recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • UAV interaction system based on gesture recognition, and control method thereof
  • UAV interaction system based on gesture recognition, and control method thereof
  • UAV interaction system based on gesture recognition, and control method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] The embodiment of the present invention provides a UAV interaction system based on gesture recognition, such as figure 1 As shown, it includes the UAV body, vision processing subsystem, flight control subsystem and handheld remote control; the vision processing subsystem and flight control subsystem are built on the UAV body, and communicate with each other through the UART interface , the handheld remote controller communicates with the vision processing subsystem and the flight control subsystem respectively; the vision processing subsystem is used to obtain the video image of the environment where the UAV body is located, and process it to obtain the results of target detection and attitude recognition; The control subsystem is used to control the UAV body to perform corresponding actions and tasks according to the results of target detection and attitude recognition; It is also used to control the take-off of the drone body.

[0061] Such as figure 2 As shown, th...

Embodiment 2

[0066] The embodiment of the present invention provides a control method of the UAV interaction system based on gesture recognition, such as Figure 4 As shown, the following steps S1-S12 are included:

[0067] S1. Use the handheld remote control to control the UAV body to take off, hover at the set height, and collect environmental video images through the 3-degree-of-freedom rotation of the motion camera in the vision processing subsystem.

[0068] In the embodiment of the present invention, the set height is 10-15m.

[0069] S2. Judging whether the operator is detected according to the environmental video image, if so, proceed to step S3, otherwise repeat step S2 until the detection time threshold is reached, and control the drone body to land autonomously.

[0070] In the embodiment of the present invention, when detecting the operator, it is necessary to adjust the position and posture of the UAV in a small range according to the posture, direction, acceleration of the U...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a UAV interaction system based on gesture recognition, and a control method thereof. The UAV interaction system comprises a UAV body, a visual processing subsystem, a flight control subsystem and a handheld remote controller, wherein the visual processing subsystem and the flight control subsystem are established on the UAV body, and are connected with each other communicatively by means of a UART interface; and the handheld remote controller is connected with the visual processing subsystem and the flight control subsystem communicatively and respectively. The UAV interaction system is realized through combining the computer vision technology and the UAV control technology, so that the UAV is more convenient, rapid and intelligent when executing a task, the task can be set according to actual needs, and the UAV interaction system has good practicality and expandability.

Description

technical field [0001] The invention belongs to the technical field of computer vision and unmanned aerial vehicle control, and in particular relates to the design of an interactive system for unmanned aerial vehicles based on gesture recognition and a control method thereof. Background technique [0002] With the advancement and development of science and technology, human-computer interaction technology has attracted more and more attention and attention. Unmanned Aerial Vehicle (UAV) has been applied to In many fields, the application of drones in the fields of agriculture, environment and security abnormal behavior monitoring has increased dramatically. However, how to realize the control of UAVs and make them more convenient, faster and smarter when performing tasks is still a hot and difficult point in the field of UAV control. The current drone control mainly relies on special equipment such as remote controllers, joysticks or ground stations, and is completed by pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05D1/10G05D1/08G01C21/16G01C11/02
CPCG01C11/02G01C21/165G05D1/0825G05D1/101
Inventor 邵延华陈璐梅艳莹楚红雨常志远郭玉英展华益饶云波张得沛罗燕阳
Owner SOUTHWEAT UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap