Human body three-dimensional model establishing method and device, electronic equipment and storage medium

A technology of 3D model and human body, applied in neural learning method, biological neural network model, 3D modeling, etc., can solve the problem of low precision of human body 3D model, achieve high precision, accurate pose parameters, and improve accuracy

Pending Publication Date: 2022-02-22
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present disclosure provides a method, device, electronic device, and storage medium for establishing a three-dimensional model of a human body, so as to solve the problem of low precision of a three-dimensional human body model established from a single image by using a deep neural network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body three-dimensional model establishing method and device, electronic equipment and storage medium
  • Human body three-dimensional model establishing method and device, electronic equipment and storage medium
  • Human body three-dimensional model establishing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] For the convenience of understanding, the nouns involved in the embodiments of the present disclosure are described below.

[0029] 1) Multi-person linear skinning (skinned multi-person linear, SMPL) model

[0030] A parametric three-dimensional reconstruction model of a human body, the model is driven by SMPL parameters, and the SMPL parameters include a shape (shape) parameter β and an attitude (pose) parameter θ. Among them, the morphological parameters include 10 parameters representing the height, shortness, fatness, and head-to-body ratio of the human body; the pose parameters include 72 parameters corresponding to 24 joint points (the parameters corresponding to each joint point are represented by a three-dimensional rotation vector, Therefore, a total of 24×3 parameters are included).

[0031] 2) Camera parameters

[0032] The camera parameters in the embodiments of the present disclosure refer to the extrinsic parameter matrix of the camera: including a rotat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a human body three-dimensional model establishing method and device, electronic equipment and a storage medium. The precision of an established human body three-dimensional model can be improved. The method comprises the following steps: acquiring a to-be-processed image including a human body; inputting the to-be-processed image into the neural network model to respectively obtain a first intermediate feature map and the position of a two-dimensional key point of a human body in the to-be-processed image, wherein the first intermediate feature map is used for representing surface structure information of a human body in the to-be-processed image; performing fusion processing on the first intermediate feature map and the two-dimensional key point position of the human body to obtain a fused feature map; inputting the fused feature graph into a graph convolutional neural network to obtain pose parameters of the human body; inputting the fused feature map into a parameter extraction network to obtain human body form parameters and camera parameters; and establishing a human body three-dimensional model of the human body according to the pose parameters, the human body shape parameters and the camera parameters.

Description

technical field [0001] The present disclosure relates to the technical fields of computer vision and computer graphics, and in particular to a method, device, electronic equipment and storage medium for establishing a three-dimensional model of a human body. Background technique [0002] The establishment of a three-dimensional model of the human body is a key issue in the technical fields of computer vision and computer graphics. High-quality 3D human body models have broad application prospects and important application values ​​in the fields of film and television entertainment, demographic data analysis and other fields. [0003] At present, the establishment of high-quality 3D human body models usually relies on expensive laser scanners or multi-camera array systems. This method of establishing 3D human body models has poor versatility and limited applicable scenarios, and the modeling takes a long time. Using a deep neural network to reconstruct a 3D human body model ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/80G06T7/73G06T5/50G06N3/08G06N3/04
CPCG06T17/00G06T5/50G06T7/80G06T7/75G06N3/08G06T2207/20221G06N3/045
Inventor 赵鑫郑文
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products