High-precision human body posture reconstruction method and system

A high-precision, human posture technology, applied in the field of computer vision, can solve the problems of rough overall performance, limited ability to express geometric details on the human surface, and inability to reconstruct the detailed texture of clothing on the surface of the human body.

Active Publication Date: 2019-11-05
TSINGHUA UNIV
View PDF20 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Although the technology of reconstructing 3D human body models based on RGB images has been greatly developed, the two popular methods still have their own problems: the reconstruction of parametric models results in limited ability to express the geometric details of the human body ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-precision human body posture reconstruction method and system
  • High-precision human body posture reconstruction method and system
  • High-precision human body posture reconstruction method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The embodiments of the present invention will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present invention, but should not be construed as limiting the present invention.

[0028] The following describes the high-precision human body posture reconstruction method and system proposed according to the embodiments of the present invention with reference to the accompanying drawings. First, the high-precision human posture reconstruction method proposed according to the embodiments of the present invention will be described with reference to the accompanying drawings.

[0029] figure 1 It is a flowchart of a high-precision human body posture reconstruction method according t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a high-precision human body posture reconstruction method and system, and the method comprises the following steps: obtaining a human body video, and selecting a key frame of the human body video; building a deep neural network to obtain human body contour information and two-dimensional joint information of the key frame; constructing a parameterized human body model, andconstraining the parameterized human body model by utilizing the human body contour information and the two-dimensional joint information to obtain initialized human body posture parameters; and optimizing and initializing human body posture parameters by utilizing the two-dimensional joint information and the human body contour information, selecting all frames of a human body video, constructinga joint constraint, optimizing and initializing the human body posture parameters again, and iterating two optimization processes by utilizing a Gauss-Newton formula until an energy difference valueof two adjacent iterations is smaller than a preset threshold value. The human body model can be better reconstructed by utilizing a few angles of human body RGB information, so that the reconstructedhuman body model more accurately reflects the real human body figure.

Description

Technical field [0001] The invention relates to the technical field of computer vision, in particular to a high-precision human body posture reconstruction method and system. Background technique [0002] With the continuous development of 3D reconstruction technology in the field of computer vision, the 3D reconstruction technology of the human body has become a research hotspot in the computer room field. In real life, there are a large number of pictures containing character information on the Internet. How to use these pictures to reconstruct the corresponding three-dimensional human body model has become an emerging research direction. [0003] The currently popular human body reconstruction methods based on RGB images are mainly divided into reconstruction of parametric human body models and reconstruction of human body models based on voxel representation. For the problem of RGB image reconstruction, the general solution is to first estimate the two-dimensional joint positi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T7/90G06N3/04
CPCG06T17/00G06T7/90G06T2207/10016G06T2207/20084G06N3/045
Inventor 刘烨斌赵笑晨戴琼海
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products