Skeleton tracking-based dynamic real-time three-dimensional reconstruction method and system

Abstract

The invention discloses a skeleton tracking-based dynamic real-time three-dimensional reconstruction method and a skeleton tracking-based dynamic real-time three-dimensional reconstruction system. Themethod comprises the following steps: performing depth image shooting on a human body to acquire a single depth image; converting the single depth image into three-dimensional point cloud and acquiring a matched point pair between the three-dimensional point cloud and a reconstruction model vertex; establishing an energy function according to the matched points and jointly solving a non-rigid motion position conversion parameter and a human body skeleton motion parameter on each vertex on the reconstruction model; and solving the energy function, aligning the reconstruction model with the three-dimensional point cloud according to the solving result, and updating and complementing the aligned model by using the depth image to realize three-dimensional human body reconstruction. By the method, the human body can be shot by a depth image, so that the depth image is acquired to serve as system input information; furthermore, the function of performing real-time three-dimensional reconstruction is completed based on the depth image, and the method and the system are accurate and robust in solution and are simple and easy to realize.

Description

technical field [0001] The invention relates to the technical fields of computer vision and computer graphics, in particular to a dynamic real-time three-dimensional human body reconstruction method and system based on skeleton tracking. Background technique [0002] Human 3D reconstruction is an important issue in the fields of computer graphics and computer vision. High-quality 3D human body models have broad application prospects and important application values ​​in the fields of film and television entertainment, demographic data analysis and other fields. [0003] However, the acquisition of high-quality human body 3D models usually relies on expensive laser scanners or multi-camera array systems. The movement of the scan will lead to obvious errors in the scanning results; and the counterfeiting is expensive, it is difficult to popularize in the daily life of ordinary people, it is often used in large companies or national statistics departments, and the speed is slo...

AI Technical Summary

Problems solved by technology

[0003] However, the acquisition of high-quality human body 3D models usually relies on expensive laser scanners or multi-camera array systems. The movement of the scan will lead to obvious errors in the scanning results; and the counterfeiting is expensive, it is difficult to popularize in the daily life of ordinary people, it is often used in large companies or national statistics departments, and the speed is slow, often it takes at least 10 minutes to reconstruct a 3D human body model to hours, pending resolution

Images