Unmarked motion capturing method and device based on multi-visual angle depth camera

Abstract

The invention provides an unmarked motion capturing method and a device based on a multi-visual angle depth camera. The method comprises the following steps of: calibrating the multi-visual angle depth camera to obtain a calibrating parameter; acquiring a depth map and a colour map through the multi-visual angle depth camera; carrying out three-dimensional space conversion according to the calibrating parameter and the depth map to obtain a point cloud set; matching each three-dimensional point cloud point P in the point cloud set with each surface grid point V on a human body model according to the information in the depth map and the colour map to obtain the matching result; and carrying out motion capturing based on a human body framework driving surface model according to the matching result to obtain the tracking result. By the method of the embodiment, motion capturing can be carried out flexibly and conveniently without using a heavy landmark. The method and device have the advantages of accurate and robust motion parameter, high restoration degree of surface grid model, high algorithm operation speed and low system cost.

Description

technical field [0001] The present invention relates to the field of computer vision, in particular to a markerless motion capture method and device based on a multi-view depth camera. Background technique [0002] Human motion capture is an important and difficult problem in computer vision. Accurate and robust motion capture algorithms are widely used in film production, television broadcasting, robot control, etc. Motion capture can generally be divided into two categories: marked and unmarked. Among them, marked motion capture means that actors wear costumes with special markers to perform, and the algorithm obtains the actor's action parameters in real time through the recognition of these markers. This method has high accuracy and low algorithm complexity, and has been widely used in the production process of commercial movies. However, in this method, actors must wear bulky and tight costumes for performances, and this method is also difficult to apply to the shoot...

AI Technical Summary

Problems solved by technology

This method breaks through the shortcomings of the marked motion capture method that must wear clothing with marked points for collection, but it is still inseparable from the use of green screens, and cannot be applied to general scene shooting

Images