Multi-view human body motion capture method based on human body motion prediction

Abstract

The invention discloses a multi-view human body motion capture method based on human body motion prediction. The method comprises steps of carrying out the three-dimensional human body reconstructionof a plurality of images synchronously photographed by a camera at different views, and obtaining a three-dimensional skeleton of each human body; for a subsequent frame, giving a prediction result and confidence to the human body three-dimensional key point position of the current frame according to the three-dimensional skeleton reconstructed by the previous frame; running a human body detectorfor the picture of the key frame, and detecting a two-dimensional bounding box of each human body; for a picture of a non-key frame, projecting the three-dimensional skeleton of the previous frame ofmotion prediction into the image of each view angle of the current frame to quickly obtain a two-dimensional bounding box of a human body under each view angle of the current frame, thereby reducing the overhead of a human body detector and improving the algorithm efficiency. The method is advantaged in that human body key point visibility is calculated by using the time sequence information, andaccuracy of human body three-dimensional skeleton reconstruction is improved based on visibility.

Description

technical field [0001] The invention belongs to the technical field of computers, and in particular relates to a multi-view human motion capture method based on human motion prediction. Background technique [0002] Multi-view human motion capture refers to the restoration of the 3D motion of the human body based on multi-view videos. Most of the current related methods include two stages of detection and reconstruction. Although good results have been achieved on public datasets, their detection and reconstruction modules is separated, the detector cannot benefit from the result of previous frame reconstruction, and lacks motion prediction. Also, the visibility of keypoints is not well exploited. Contents of the invention [0003] The purpose of the present invention is to address the deficiencies in the prior art, and propose a human body detection method based on motion prediction, and use timing information to calculate the visibility of each key point, so as to impro...

AI Technical Summary

Problems solved by technology

[0002] Multi-view human motion capture refers to the restoration of the 3D motion of the human body based on multi-view videos. Most of the current related methods include two stages of detection and reconstruction. Although good results have been achieved on public datasets, their detection and reconstruction modules are separated, the detector cannot benefit from the results of previous frame reconstruction, and lacks motion prediction

Also, the visibility of keypoints is not well utilized

Images