Motion Capture Method Based on Asynchronous Video

Abstract

The invention discloses a human body motion capture method based on asynchronous video, which can effectively restore the three-dimensional motion of the target person through multiple asynchronous videos of the target person. In order to utilize multiple non-synchronized videos, the present invention provides a video synchronization and motion reconstruction method. The implementation of the present invention includes: synchronizing multiple segments of video based on the three-dimensional human body posture; performing motion reconstruction based on the synchronized video, and using low-rank constraints to model motion differences under different viewpoints to realize high-precision human motion from multiple segments of non-synchronized video catch. The present invention performs more precise motion capture by utilizing multiple asynchronous videos. In order to utilize multiple asynchronous videos, the present invention provides a video synchronization method and a motion reconstruction method, simultaneously modeling the motion differences of different videos, and realizing high-precision motion capture.

Description

technical field [0001] The invention belongs to the technical field of computers, in particular to a motion capture method based on asynchronous video. Background technique [0002] The motion capture of the human body from asynchronous video, the existing method that can deal with this problem is only a single-view motion capture algorithm, but the inherent depth uncertainty and self-occlusion problems of a single view make this type of algorithm unable to achieve the accuracy of multi-view reconstruction . The traditional multi-view reconstruction algorithm can only solve the situation where all cameras record the same scene, but cannot handle the situation where the cameras record different scenes and the actions between videos are not completely consistent. Contents of the invention [0003] The purpose of the present invention is to address the deficiencies in the prior art, and propose a method for video synchronization and human body reconstruction based on multipl...

AI Technical Summary

Problems solved by technology

[0002] The motion capture of the human body from asynchronous video, the existing method that can deal with this problem is only a single-view motion capture algorithm, but the inherent depth uncertainty and self-occlusion problems of a single view make this type of algorithm unable to achieve the accuracy of multi-view reconstruction

The traditional multi-view reconstruction algorithm can only solve the situation where all cameras record the same scene, but cannot handle the situation where the cameras record different scenes and the actions between the videos are not completely consistent.

Images