Unmanned aerial vehicle interaction apparatus and method based on deep leaning and attitude estimation

A posture estimation and interaction device technology, applied in the field of UAV interaction, can solve the problems of inconvenience and complicated operation, and achieve the effect of convenient operation and accurate results

Active Publication Date: 2017-10-10
XILINX TECH BEIJING LTD
View PDF10 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of these control methods are complicated to operate, requiring people to control the flight attitude of the drone at all times, and it is very inconvenient to take into account the flight status of the drone when completing simple tasks such as selfies

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle interaction apparatus and method based on deep leaning and attitude estimation
  • Unmanned aerial vehicle interaction apparatus and method based on deep leaning and attitude estimation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The accompanying drawings are only for illustrative purposes and should not be construed as limiting the patent; the technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0025] figure 1 It is a structural schematic diagram of the UAV interaction device according to the present invention.

[0026] Such as figure 1 As shown in , a UAV interaction device 10 based on deep learning pose estimation according to the present invention includes: a shooting unit 11, which is used to shoot an object video; a key frame extraction unit 12, which is used to extract information about The key frame image of the object; the pose estimation unit 13, for the image recognition algorithm based on the deep convolutional neural network, for the key frame image, recognize the object pose; and the UAV operation control unit 14, for identifying the The attitude of the object is converted into control instr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Unmanned aerial vehicle interaction apparatus and method based on deep leaning and attitude estimation. According to the invention, the apparatus herein includes: a photographing unit which is intended for photographing a target video; a key frame extracting unit which is intended for extracting a key frame image of a target from the photographed target video; an attitude estimation unit which is intended for based on an image identifying algorithm of a deep convolutional neural network, identifying a target attitude for the key frame image; and an unmanned aerial vehicle operation and control unit which is intended for converting the identified target attitude to a control command so as to control the operation of an unmanned aerial vehicle. According to the invention, the apparatus herein controls the unmanned aerial vehicle based on human body attitude estimation so as to control the unmanned aerial vehicle in an easy manner. In addition, in the proceeding of key frame extraction and attitude estimation, by using the algorithm of the deep convolutional neural network, the apparatus can acquire the result in a faster and more accurate manner.

Description

technical field [0001] The present invention relates to the field of UAV interaction, and more specifically, to an UAV interaction device and method based on deep learning attitude estimation. Background technique [0002] UAV has the advantages of low cost, small and portable, etc., and has broad application prospects in various fields, especially in the field of aerial photography. It has good application value to study the interaction between human and UAV. [0003] In the traditional UAV interaction method, most people control the flight attitude and operation of the UAV through mobile phones or remote control devices, so that the UAV can rise, fall, move and shoot. Most of these control methods are complicated to operate, requiring people to control the flight attitude of the drone at all times, and it is very inconvenient to take into account the flight status of the drone when completing simple tasks such as taking selfies. [0004] Human pose estimation is a key te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/08G06F3/01G05D1/10G05D1/00G06V20/13G06V20/17
CPCG05D1/0016G05D1/101G06F3/011G06F3/017G06N3/08G06N3/084G06V40/28G06V40/20G06V20/46G06F18/214G05D1/0033G06F3/0304B64C39/024G06T7/70G06T2207/20084G06V40/103G06V20/13G06V20/17B64U2101/30B64U2201/20G05D1/0088G05D1/0094G06T2207/30196G06T11/60G06T5/20B64U2201/10
Inventor 田露单羿姚颂
Owner XILINX TECH BEIJING LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap