Training method of SMPL parameter prediction model, server and storage medium

A technology for predicting models and parameters, applied in the field of computer vision, can solve the problems of complex model training process and time-consuming, and achieve the effect of improving training quality, efficiency and accuracy

Active Publication Date: 2019-06-07
TENCENT TECH (SHENZHEN) CO LTD
View PDF7 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a training method, server and storage medium of an SMPL parameter prediction model, which can solve the problem that the model training process in the related art is complicated and takes a lot of time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training method of SMPL parameter prediction model, server and storage medium
  • Training method of SMPL parameter prediction model, server and storage medium
  • Training method of SMPL parameter prediction model, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0050] For the convenience of understanding, the nouns involved in the embodiments of the present application are described below.

[0051] SMPL model: a parametric human body model driven by SMPL parameters, including shape (shape) parameter β and attitude (pose) parameter θ. Among them, the shape parameters Contains 10 parameters that characterize the human body, such as tall, short, fat, thin, head-to-body ratio; posture (pose) parameters Contains 72 parameters corresponding to 24 joint points (the parameters corresponding to each joint point are represented by a three-dimensional rotation vector, so a total of 24×3 parameters are included).

[0052] Based on the SMPL model, the 3D human body model can be defined as:

[005...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a training method of an SMPL parameter prediction model, a server and a storage medium. The method comprises the steps of obtaining a sample picture; inputting the sample picture into an attitude parameter prediction model to obtain an attitude prediction parameter; inputting the sample picture into a morphological parameter prediction model to obtain a morphological prediction parameter; according to the posture prediction parameters and the form prediction parameters, constructing a human body three-dimensional model through an SMPL model; calculating model predictionloss according to the SMPL prediction parameters and / or the human body three-dimensional model in combination with the annotation information of the sample picture; and reversely training an attitudeparameter prediction model and a morphological parameter prediction model according to the model prediction loss. In the embodiment of the invention, the sample picture is directly used as model input for model training, and a model for extracting the human body information in the picture does not need to be independently trained, so that the complexity of model training is reduced, and the efficiency of model training is improved.

Description

technical field [0001] The embodiment of the present application relates to the field of computer vision, and in particular to a training method, server and storage medium of an SMPL parameter prediction model. Background technique [0002] 3D human body reconstruction is one of the important topics in computer vision research, and has important application value in the fields of virtual reality (VR, Virtual Reality), human animation, games and so on. [0003] In the related art, a Skinned Multi-Person Linear (SMPL, Skinned Multi-Person Linear) model is used to perform three-dimensional human body reconstruction on a human body in a two-dimensional image. In a 3D human body reconstruction method, the human body information extraction model is first used to extract human body information such as 2D joint points, 3D joint points, 2D human body segmentation maps, and 3D voxels in the 2D image, and then the extracted human body The information is input into the parameter predic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/40G06T17/00
CPCG06T17/00G06T7/74G06T2207/20084G06T2207/30196G06T2207/20081G06V40/11G06N3/08G06V10/82G06V10/809G06N3/045G06F18/254G06T7/70G06T2207/20044G06F18/22
Inventor 孙爽李琛戴宇荣贾佳亚沈小勇
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products