Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional human body model reconstruction method, storage equipment and control equipment

A human body model, three-dimensional technology, applied in the field of human body model reconstruction, can solve the problems of misalignment between the three-dimensional model reconstruction result and the two-dimensional image, time-consuming initial value of model parameters, and deviation of the position of the two-dimensional image, etc., to achieve efficient human body model reconstruction, The effect of robust pose estimation and improved accuracy

Active Publication Date: 2020-02-21
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF12 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing 3D human body model reconstruction technology, the traditional model-based fitting method usually deforms the 3D human body model iteratively, so that the reprojected model matches the 2D image information such as the position of joint points or the contour of the human body. Time consuming and sensitive to initial values ​​of model parameters
The emerging learning-based methods use neural networks to directly extract features from images and estimate model parameters. These methods have improved the accuracy of model shape and pose estimation to a certain extent, but there are still differences between the reconstruction results of 3D models and 2D images. Alignment etc.
There are two main reasons for this: (1) there is a highly nonlinear mapping relationship between the image and the model parameters; (2) the pose of the 3D human body model is usually expressed by the relative rotation of the joint points, which leads to the reprojection of the model reconstruction results in the Positional deviations are prone to exist on 2D images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional human body model reconstruction method, storage equipment and control equipment
  • Three-dimensional human body model reconstruction method, storage equipment and control equipment
  • Three-dimensional human body model reconstruction method, storage equipment and control equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principle of the present invention, and are not intended to limit the protection scope of the present invention.

[0057] It should be noted that, in the description of the present invention, the terms "first" and "second" are only for the convenience of description, rather than indicating or implying the relative importance of the devices, elements or parameters, so they should not be understood as important to the present invention. Invention Limitations.

[0058] The human body model is a parametric deformation model whose parameters include shape parameters and posture parameters. Among them, the shape parameter represents the shape information of the human body model (such as height, fat and thin, etc.), and the posture parameter represents the postur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of human body model reconstruction, in particular to a three-dimensional human body model reconstruction method, storage equipment and control equipment, and aims to solve the problems that a three-dimensional model reconstruction result is not aligned with a two-dimensional image and the like. The reconstruction method comprises the steps that according to a human body image, adopting a pre-trained full convolutional network module to acquire a global UVI image and a local UVI image of a human body part; estimating camera parameters and shape parameters of the human body model by using a first neural network based on the global UVI graph; based on the local UVI graph, utilizing a second neural network to extract rotation features of each articulation point of the human body; based on the rotation characteristics of each articulation point of the human body, improving the rotation characteristics by utilizing a characteristic improvement strategy based on position assistance to obtain improved rotation characteristics; and estimating attitude parameters of the human body model by using a third neural network according to the improved rotation characteristics. According to the method, the human body model can be reconstructed more accurately and efficiently, and the robustness of attitude estimation is improved.

Description

technical field [0001] The invention relates to the technical field of human body model reconstruction, in particular to a three-dimensional human body model reconstruction method, a storage device, and a control device. Background technique [0002] 3D human body model reconstruction is one of the important tasks of 3D computer vision, which aims to quickly and accurately reconstruct a 3D human body parametric model from human body images, including the shape parameters and posture parameters of the model. [0003] In the existing 3D human body model reconstruction technology, the traditional model-based fitting method usually deforms the 3D human body model iteratively, so that the reprojected model matches the 2D image information such as the position of joint points or the contour of the human body. Time consuming and sensitive to initial values ​​of model parameters. The emerging learning-based methods use neural networks to directly extract features from images and es...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/55G06T17/10
CPCG06T7/55G06T17/10G06T2207/10004G06T2207/20081G06T2207/20084G06T2207/30196G06T17/00G06T13/40G06T7/70G06T7/50Y02T10/40
Inventor 孙哲南张鸿文欧阳万里曹杰
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products