Monocular video-based human skeleton tracking method

Abstract

The invention discloses a monocular video-based human skeleton tracking method. The method comprises the following steps: in a training stage, a, feature descriptor definition: quantifying the difference between a sketch and an initial skeleton by utilizing a distance-based method, b, feature extraction and classification: extracting features having max-relativity with a regression target through a relativity-based random fern method and classifying the features to obtain a regressand which decides the skeleton adjustment range of the current stage, and c, skeleton adjustment: adjusting the skeleton for proper times according to an addition model and outputting a cascading regressand; and in a test state: a, inputting a sketch and an initial skeleton of the first frame of a monocular video, b, gradually adjusting the initial skeleton to a final skeleton according to the cascading regressand obtained through training, and c, searching 5 skeletons mostly similar to the current frame of predicted skeleton, respectively regressing the 5 skeletons, and taking the regressed average skeleton as the initial skeleton of the next frame to predict the skeleton of the next frame. According to the method, the tracking of skeletons can be effectively realized, and the error accumulation phenomenon in the tracking process can be avoided.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a method for tracking human skeletons based on monocular video. Background technique [0002] 3D human skeleton tracking is a research hotspot in the field of computer vision, and it is widely used in video surveillance, human-computer interaction, behavior understanding, intelligent animation synthesis, virtual reality and other fields, and has broad application prospects. Its research involves computer vision, computer graphics, machine learning, image processing and artificial intelligence, and is an interdisciplinary and challenging research topic. [0003] Skeleton tracking is defined as "estimating human poses from frametoframe, tracking is used to ensure temporal coherence between poses over time". Skeleton reconstruction is defined as "estimating human poses from images". Skeleton reconstruction is the basis of skeleton tracking. In some learning-based methods...

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved in the present invention is to propose a skeleton tracking method based on monocular video in view of the existing skeleton tracking technology that relies heavily on image depth information and is difficult to meet real-time performance.

Images