Texture rendering method and system for real-time three-dimensional human body reconstruction, chip, equipment and medium

Abstract

The invention discloses a texture rendering method and system for real-time three-dimensional human body reconstruction, a chip, equipment and a medium. The method comprises the steps of obtaining a current human body model and a depth image of a shooting object; selecting a current human body model as a standard model, reprojecting the vertex of the standard model to the depth image, extracting color information and image coordinates corresponding to the vertex, wherien the color information is a color initial value, and the image coordinates are converted into texture coordinates; calculating a weighted sum of the subsequent color information of the vertex of the human body model and the color initial value to serve as a new color of the vertex of the standard model; calculating sub-texture maps and sub-masks of the current human body model, and combining the sub-texture maps and the sub-masks into a complete texture map and mask; and performing rendering according to the texture mapand the texture coordinates. According to the method, generation and optimization of required textures can be rapidly completed based on the GPU, a high-quality texture atlas is obtained, and color cracks caused by illumination changes are eliminated. A human body model generated in a multi-camera system can be rendered, and a good visual reality sense is achieved.

Description

technical field

[0001] The invention relates to the field of three-dimensional reconstruction of computer vision and computer graphics, in particular to a texture rendering method, system, chip, device and medium for real-time three-dimensional human body reconstruction. Background technique

[0002] With the development of stereoscopic vision technology and the gradual popularization of virtual reality / augmented reality (VR / AR) technology, how to obtain the real 3D model of the human body in daily life has become a research hotspot and difficulty, especially in capturing human motion in dynamic scenes ;The real 3D model of the human body is widely used, and can be used in digital animation, film and television-level character action special effects collection and remote conferences, etc.

[0003] Real-time 3D human body reconstruction mainly includes two aspects: geometry optimization and texture mapping. Geometry optimization refers to the process of accurately generating...

Images