Unmanned aerial vehicle man-machine interaction method based on three-dimensional continuous gesture recognition

A technology of dynamic gestures and interaction methods, which is applied in the field of human-computer interaction and can solve the problems of nonlinear fluctuation of gesture trajectory time and so on.

Active Publication Date: 2016-07-27
SUN YAT SEN UNIV
View PDF2 Cites 46 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the recognition of dynamic gestures needs to consider factors such as time and space, that is, different factors will cause nonlinear fluctuations in gesture trajectory in time. Therefore, dynamic gesture recognition must consider how to eliminate the influence of these fluctuations, which is more technical than static gesture recognition. challenge

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmanned aerial vehicle man-machine interaction method based on three-dimensional continuous gesture recognition
  • Unmanned aerial vehicle man-machine interaction method based on three-dimensional continuous gesture recognition
  • Unmanned aerial vehicle man-machine interaction method based on three-dimensional continuous gesture recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0053] The concrete steps of the technical solution proposed by the present invention are as follows:

[0054] (1) Human skeleton tracking and gesture trajectory feature extraction and preprocessing

[0055] 1. Human skeleton tracking

[0056] The Microsoft Kinect sensor can identify and obtain the skeleton information of the human body. The KinectSDK provided by Microsoft can track and recognize the human body, and obtain the three-dimensional position information and quaternion rotation information of 20 joint bone points from a single frame depth image. The present invention establishes a motion trajectory feature descriptor of a dynamic gesture based on data of key motion skeleton points obtained by KinectSDK, and uses KinectSDK to track joint points of a human body, thereby locating the position of a user's hand.

[0057] 2. Gesture track feature extraction and preprocessing

[0058] Extract gesture trajectory features

[0059] Since the movement of gesture recognitio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an unmanned aerial vehicle man-machine interaction method based on three-dimensional continuous gesture recognition. The method comprises the following steps: acquiring human skeleton tracking data through a Kinect sensor, wherein the human skeleton tracking data at least include skeleton point tracking data of a right hand, a left hand, a right elbow, a left elbow, a right shoulder and a left shoulder; extracting a gesture track feature and preprocessing the gesture track feature, wherein preprocessing includes gesture start-stop detection, smooth filtering processing, resampling and position normalization; performing gesture recognition by using a neural network algorithm; and converting a gesture recognition result into a corresponding control instruction for controlling flight of an unmanned aerial vehicle. Through adoption of the method, gestures can be recognized accurately, so that a user can control flight of the unmanned aerial vehicle more freely and conveniently.

Description

technical field [0001] The present invention relates to the technical field of human-computer interaction, and more specifically, to a method for human-computer interaction of a drone based on three-dimensional continuous dynamic gesture recognition. Background technique [0002] Gesture recognition technology is a key technology of the new generation of natural human-computer interaction. Compared with traditional mouse, keyboard and other contact operation methods, gestures have the advantages of natural, intuitive, easy to understand, simple operation, and good experience, and are more in line with human daily life. Communication habits and gesture recognition have become a research hotspot in human-computer interaction solutions. As a natural and convenient language, gesture is very suitable for human-computer interaction both emotionally and practically. The research significance of gesture recognition technology is to apply gestures, a natural and intuitive way of com...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
CPCG06F3/017
Inventor 成慧唐薇江泽宇
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap