Method, device, storage medium and terminal for human body posture migration based on three-dimensional information

Abstract

The invention discloses a human body posture migration method, device, storage medium and terminal based on three-dimensional information. The method includes: acquiring a human body image set to be migrated and a target human body image; Estimate, generate the 3D model of the human body to be transferred and the 3D model of the target human body; perform mask processing on the image set of the human body to be transferred and the 3D model of the human body to be transferred, and generate the masked image set of the human body to be transferred and the 3D human body to be transferred after the mask Model; input the masked human body image set to be transferred, the masked 3D human body model to be transferred, and the target human body 3D model into the pre-created human body pose transfer network, and output the pose transfer image corresponding to the human body image set to be transferred. Therefore, by adopting the embodiment of the present application, the frequency and degree of missing human body parts or image distortion in the pose transition image can be reduced, thereby further improving the robustness of the pose transition image.

Description

technical field [0001] The present invention relates to the field of image processing, in particular to a method, device, storage medium and terminal for human body pose transfer based on three-dimensional information. Background technique [0002] Pose transfer technology refers to transferring the action posture of the main character in the target human body image to the human body in the human body image set to be transferred (source main character). Specifically, on the basis of keeping the appearance of the human body (for example: face, figure, clothes) in the human body image set to be transferred unchanged, the actions of the human body in the human body image set to be transferred are driven to be consistent with the movements of the main characters in the target image . [0003] Among the existing pose transfer schemes, they are usually divided into three types, namely, pose transfer based on a single human body photo, pose transfer based on human body video, and ...

AI Technical Summary

Problems solved by technology

In the pose transfer scheme based on a single human body photo and the pose transfer scheme based on a human body video, since the main character in the target human body image is inconsistent with the body size scale and pose angle in the human body image set to be transferred, resulting in The transfer effect is poor in scenes with large scene and pose transformation scales

In addition, in the pose transfer based on 18 key points of the human body, due to the complex structure of the human body, the human body in the output pose transfer image has missing human body parts or image distortion, which reduces the robustness of the pose transfer image

Images