Unmarked motion capturing method and device based on multi-visual angle depth camera

A depth camera and motion capture technology, applied in the field of computer vision, can solve the problem of inseparable from green screen, cannot be suitable for general scene shooting, etc., to achieve the effect of flexible and convenient motion capture, high degree of recovery, and fast algorithm running speed

Active Publication Date: 2012-11-28
TSINGHUA UNIV
View PDF3 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method breaks through the shortcomings of the marked motion capture method that must wear clothing with marked points for collection, but it is still inseparable from the use of green screens, and cannot be applied to general scene shooting

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unmarked motion capturing method and device based on multi-visual angle depth camera
  • Unmarked motion capturing method and device based on multi-visual angle depth camera
  • Unmarked motion capturing method and device based on multi-visual angle depth camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention. On the contrary, the embodiments of the present invention include all changes, modifications and equivalents coming within the spirit and scope of the appended claims.

[0031] A markerless motion capture method and device based on a multi-view depth camera according to an embodiment of the present invention will be described below with reference to the accompanying drawings.

[0032] figure 1 It is a flowchart of a markerless motion capture method based on a multi-view depth camera according to an embodiment of the present invention. Such...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an unmarked motion capturing method and a device based on a multi-visual angle depth camera. The method comprises the following steps of: calibrating the multi-visual angle depth camera to obtain a calibrating parameter; acquiring a depth map and a colour map through the multi-visual angle depth camera; carrying out three-dimensional space conversion according to the calibrating parameter and the depth map to obtain a point cloud set; matching each three-dimensional point cloud point P in the point cloud set with each surface grid point V on a human body model according to the information in the depth map and the colour map to obtain the matching result; and carrying out motion capturing based on a human body framework driving surface model according to the matching result to obtain the tracking result. By the method of the embodiment, motion capturing can be carried out flexibly and conveniently without using a heavy landmark. The method and device have the advantages of accurate and robust motion parameter, high restoration degree of surface grid model, high algorithm operation speed and low system cost.

Description

technical field [0001] The present invention relates to the field of computer vision, in particular to a markerless motion capture method and device based on a multi-view depth camera. Background technique [0002] Human motion capture is an important and difficult problem in computer vision. Accurate and robust motion capture algorithms are widely used in film production, television broadcasting, robot control, etc. Motion capture can generally be divided into two categories: marked and unmarked. Among them, marked motion capture means that actors wear costumes with special markers to perform, and the algorithm obtains the actor's action parameters in real time through the recognition of these markers. This method has high accuracy and low algorithm complexity, and has been widely used in the production process of commercial movies. However, in this method, actors must wear bulky and tight costumes for performances, and this method is also difficult to apply to the shoot...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/20
Inventor 刘烨斌叶亘之戴琼海
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products