Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human intention understanding method based on deep stacking Bi-LSTM for man-machine cooperation

A deep and intentional technology, applied in the field of human intention understanding of two-way long-term short-term memory network, can solve the problem of unsatisfactory understanding of behavioral intention, and achieve the effect of easy operation, good effect and accurate accuracy

Inactive Publication Date: 2020-01-21
BEIHANG UNIV
View PDF6 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problem that the robot’s understanding of human behavior intentions is not ideal in the current human-computer collaboration, the present invention proposes a human-computer collaboration-oriented human-machine collaboration-based human intention understanding method based on deep stacked bidirectional LSTM

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human intention understanding method based on deep stacking Bi-LSTM for man-machine cooperation
  • Human intention understanding method based on deep stacking Bi-LSTM for man-machine cooperation
  • Human intention understanding method based on deep stacking Bi-LSTM for man-machine cooperation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to facilitate those of ordinary skill in the art to understand and implement the present invention, the present invention will be further described in detail and in-depth below in conjunction with the accompanying drawings.

[0019] In order to realize safe and efficient human-machine collaboration, the robot is required to actively and intelligently recognize the intention of the operator. This invention uses a recurrent neural network based on deep stacked bidirectional long-term short-term memory to study the understanding of human behavioral intentions. First, the motion capture system (Kinect) based on the visual system is used to collect the motion sequence of the human body during human-machine collaboration, and the skeleton node information of the human body is obtained by using the human skeleton tracking technology; secondly, the skeleton node information of the human body is input into the deep stacked Bi-LSTM The model consists of multiple hidden la...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a human intention understanding method based on deep stacking Bi-LSTM for man-machine cooperation, and belongs to the technical field of robot control. The method comprises: 1,collecting a motion sequence based on human skeleton node information; step 2, carrying out data preprocessing on the acquired human body motion sequence; step 2, carrying out model training on the deeply stacked bidirectional LSTM network by utilizing the preprocessed data; and step 3, inputting the data processed in the step 2 into a deep stack Bi-LSTM network for training, so as to enable the deep stack Bi-LSTM network to capture data features of a human body motion sequence based on human body skeleton node information; and step 4, testing by using the network model of the deep stack bidirectional LSTM. According to the end-to-end human body intention understanding method based on the motion sequence of the human body skeleton information provided by the invention, the intention understanding effect is better and the precision is more accurate based on the bidirectional LSTM model of depth stacking.

Description

technical field [0001] The invention belongs to the technical field of robot control, and relates to a human-machine cooperation-oriented method for understanding human intentions based on a deep-stacked Bi-directional Long Short-Term Memory (Bi-directional Long Short-Term Memory, Bi-LSTM for short). Background technique [0002] With the improvement of robot intelligence, the development of flexible robot technology, and the increasing demand for cooperation between robots and humans to complete tasks, robot applications are developing in the direction of human-machine collaboration. In order to realize safe and efficient human-machine collaboration, it is necessary for the robot to make timely predictions of human actions, realize the robot's understanding of human behavior intentions and in-depth human-computer interaction, so as to ensure the efficiency of human-machine collaborative operations. Traditional statistics-based methods, such as hidden Markov model (HMM), dyn...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/20G06N3/044G06N3/045
Inventor 高晓珊严亮和壮
Owner BEIHANG UNIV
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More