Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

3D human motion prediction method based on depth state space model

A technology of state space model and human motion, applied in biological neural network model, character and pattern recognition, image data processing, etc., can solve the problems that affect the later time prediction and cannot realize the prediction

Pending Publication Date: 2021-03-30
BEIJING UNIV OF POSTS & TELECOMM
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the loss value at the early moment is smaller than the loss value at the later moment, these models implicitly focus on the prediction of the later moment, while ignoring this hidden relationship between the early moment and the later moment, that is, in the recursive model, Early predictions tend to affect predictions at later moments
Therefore, none of these models can achieve more accurate predictions, especially in the recursive prediction model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D human motion prediction method based on depth state space model
  • 3D human motion prediction method based on depth state space model
  • 3D human motion prediction method based on depth state space model

Examples

Experimental program
Comparison scheme
Effect test

experiment example

[0081]1.1 Data sets and experiment details

[0082](1) Data set

[0083]Human3.6m (H3.6M): H3.6M is the most commonly used data set in human motion prediction. The data set consists of 15 actions implemented by seven professional actors, such as walk, eat, smoking, and discussions.

[0084]3D POSE IN The Wild DataSet (3DPW): 3DPW is an field dataset with exact 3D posture, including a variety of human behavior, such as shopping, sports, etc. The data set includes 60 posture sequences, more than 51 kV.

[0085](2) Experimental details

[0086]In the experiment, all experimental settings and data processing consistent with the baseline. The model of the present invention is implemented based on Tensorflow. The mean per joint positionerror, MPJPE) of the average unit of millimeters is the metric index of the present invention. All models are trained in the ADAM optimizer, and the learning rate is initialized to 0.0001. Super parameter λ1: λ2Set to 3: 1.

[0087]1.2 and advanced methods

[0088]Baseline: (1)...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a 3D human body motion prediction method based on a depth state space model, and the method comprises the steps: taking the position and speed of human body motion as observation, and extracting a motion dynamics rule of a historical posture sequence through a depth network to initialize the state of the state space model; and recursively predicting a plurality of future poses of 3D human motion through state-to-observation transitions. By utilizing the advantages of the deep network and the state space model, the human body motion system is modeled into the deep statespace model, a unified description is provided for various human body motion systems, and meanwhile, the existing model can be analyzed.

Description

Technical field[0001]The present invention belongs to the field of human motion prediction, and more particularly to a 3D human motion prediction method based on a depth state spatial model.Background technique[0002]Humans' understanding and interaction of real world depends on the ability to predict the surrounding environment. Similarly, interactive interactive smart robots must have the ability to predict human future dynamics, so that robots can quickly respond to human changes. Most prediction models generally use only L2Or MPJPE (Average Each Point Position Error) Optimizes the prediction model for all frames or all joints of future postures. Since the loss value in the early time is less than the loss value in the late time, these models are implicitly focused on the prediction of late time, and ignore this hidden relationship between early times and later times, that is, in the recursive model, Early predictions were easily forecast for later moments. Therefore, these models...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/246G06N3/04G06K9/62
CPCG06T7/246G06T2207/20081G06T2207/20084G06T2207/30196G06T2207/30241G06N3/045G06F18/253
Inventor 刘小丽尹建芹刘金党永浩
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products