Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A UAV human-computer interaction method based on three-dimensional continuous dynamic gesture recognition

A technology of dynamic gestures and interaction methods, applied in the field of human-computer interaction, can solve problems such as non-linear fluctuations in gesture trajectory time, and achieve the effect of convenient control

Active Publication Date: 2019-06-21
SUN YAT SEN UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the recognition of dynamic gestures needs to consider factors such as time and space, that is, different factors will cause nonlinear fluctuations in gesture trajectory in time. Therefore, dynamic gesture recognition must consider how to eliminate the influence of these fluctuations, which is more technical than static gesture recognition. challenge

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A UAV human-computer interaction method based on three-dimensional continuous dynamic gesture recognition
  • A UAV human-computer interaction method based on three-dimensional continuous dynamic gesture recognition
  • A UAV human-computer interaction method based on three-dimensional continuous dynamic gesture recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0053] The concrete steps of the technical solution proposed by the present invention are as follows:

[0054] (1) Human skeleton tracking and gesture trajectory feature extraction and preprocessing

[0055] 1. Human skeleton tracking

[0056] The Microsoft Kinect sensor can identify and obtain the skeleton information of the human body. The Kinect SDK provided by Microsoft can track and recognize the human body, and obtain the three-dimensional position information and quaternion rotation information of 20 joint bone points from a single frame depth image. The present invention establishes a motion trajectory feature descriptor of a dynamic gesture based on the data of key motion bone points obtained by the Kinect SDK, and uses the Kinect SDK to track the joint points of the human body, thereby locating the position of the user's hand.

[0057] 2. Gesture track feature extraction and preprocessing

[0058] Extract gesture trajectory features

[0059] Since the movement of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an unmanned aerial vehicle man-machine interaction method based on three-dimensional continuous gesture recognition. The method comprises the following steps: acquiring human skeleton tracking data through a Kinect sensor, wherein the human skeleton tracking data at least include skeleton point tracking data of a right hand, a left hand, a right elbow, a left elbow, a right shoulder and a left shoulder; extracting a gesture track feature and preprocessing the gesture track feature, wherein preprocessing includes gesture start-stop detection, smooth filtering processing, resampling and position normalization; performing gesture recognition by using a neural network algorithm; and converting a gesture recognition result into a corresponding control instruction for controlling flight of an unmanned aerial vehicle. Through adoption of the method, gestures can be recognized accurately, so that a user can control flight of the unmanned aerial vehicle more freely and conveniently.

Description

technical field [0001] The present invention relates to the technical field of human-computer interaction, and more specifically, to a method for human-computer interaction of a drone based on three-dimensional continuous dynamic gesture recognition. Background technique [0002] Gesture recognition technology is a key technology of the new generation of natural human-computer interaction. Compared with traditional mouse, keyboard and other contact operation methods, gestures have the advantages of natural, intuitive, easy to understand, simple operation, and good experience, and are more in line with human daily life. Communication habits and gesture recognition have become a research hotspot in human-computer interaction solutions. As a natural and convenient language, gesture is very suitable for human-computer interaction both emotionally and practically. The research significance of gesture recognition technology is to apply gestures, a natural and intuitive way of com...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01
CPCG06F3/017
Inventor 成慧唐薇江泽宇
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com