Motion migration method driven by 3D human body model

A human body model, 3D technology, applied in the field of motion migration, can solve problems such as distortion and fuzzy shape, achieve the effect of precise shape, short time consumption, and overcome shape distortion

Active Publication Date: 2022-07-22
NANJING UNIV OF INFORMATION SCI & TECH
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the deficiencies in the prior art, the present invention provides a motion migration method driven by a 3D human body model, which not only overcomes the problems o

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Motion migration method driven by 3D human body model
  • Motion migration method driven by 3D human body model
  • Motion migration method driven by 3D human body model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be further described below in conjunction with the accompanying drawings. The following examples are only used to illustrate the technical solutions of the present invention more clearly, and cannot be used to limit the protection scope of the present invention.

[0042] A 3D human body model-driven motion migration method, comprising: constructing a training data set with pre-shot video frames as training data, and extracting the pose of the training data; converting the training data into UV space, generating a UV map, and using adjacent The complementary information between the video frames is used to construct and optimize the 3D human body model; then the optimized 3D human body model is projected onto the 2D plane to obtain a 2D projection that retains the 3D information of the original motion, and the optimized human body is driven by the pose of the target person. 3D human body model; take the 2D projection that retains the 3D informat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a motion migration method driven by a 3D human body model. The motion migration method comprises the following steps: converting training data into a UV space, and constructing and optimizing the 3D human body model according to complementary information between adjacent video frames; then projecting the optimized 3D human body model to a 2D plane to retain 3D information of original motion, and driving the optimized 3D human body model with a target attitude; taking the attitude of the 2D projection and the training data as the input of a pre-training model, and storing the trained model; normalizing the posture of the target person; and finally, taking the 2D projection of the optimized 3D human body model driven by the posture of the target person and the normalized posture of the target person as the input of a trained motion image generation model to carry out final motion migration, so that the problems of blurring, shape distortion and the like existing in the generation of a 2D plane image are solved; and the generated moving image is ensured to have reliable depth information, accurate shape and clear face.

Description

technical field [0001] The invention belongs to the technical field of motion migration, and in particular relates to a motion migration method driven by a 3D human body model. Background technique [0002] Human motion transfer aims to synthesize human motion images with human textures and target poses from training images. It has been used in filmmaking, game design, and medical rehabilitation. Based on human motion transfer technology, the characters of the training images can be freely animated to perform user-defined imitation actions. Traditional computer graphics-based motion transfer methods require complex rendering operations to generate appearance textures, which are time-consuming and computationally complex, but ordinary users or small institutions cannot afford the extremely high computational and time costs. [0003] Human motion is a complex natural phenomenon, all real motion occurs in 3D space, the reason why real motion images look natural is that they a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V40/16G06V40/20G06V10/40G06V10/74G06V10/774G06K9/62
CPCG06F18/22G06F18/214Y02T10/40
Inventor 罗冬夏贵羽张泽远马芙蓉
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap