A 3D Motion Reconstruction Method Based on RGB Color and Depth Images

Abstract

The invention discloses a three-dimensional motion reconstruction method based on an RGB color and depth image. Firstly, an RGC color and depth image of human motion is obtained by using Kinect, and denoising and image correction processing are performed on the RGB color and depth image; secondly, a background is removed by adopting different methods according to the complexity of the background, and a foreground RGB color image is obtained; then, the face and the hands in the foreground RGB color image are located according to a skin color model, and centers of mass of the located face and hands are used as initially acquired articulation points; after that, classification and identification of parts are performed on a moving human body in the foreground RGB color image through a Bayes classifier obtained based on learning, the categories of rigid body structural parts of limbs are judged according to classification and identification results, and articulation points are then determined according to connection relations of the rigid body parts; and finally, the articulation points are connected in sequence to form a planar skeleton, and then in combination with depth data of the articulation points, the planar human skeleton is converted to a three-dimensional human skeleton.

Description

technical field [0001] The invention belongs to the technical field of three-dimensional motion reconstruction of videos, and in particular relates to a three-dimensional motion reconstruction method based on RGB color and depth images. Background technique [0002] There are many ways to reconstruct the three-dimensional motion of the human body. The traditional method is to install sensors on each joint of the human body. When the human body moves, the sensor will continuously return the space position information of each joint to the computer, so that the computer can accurately obtain the movement of the human body at each moment. information; the simpler motion information capture method analyzes the image sequence, which can be shot by a single camera or by multiple cameras from various perspectives at the same time. This is generally done in three steps. First, from the image frame Extract low-level features, such as the position of each joint, and identify them, then...

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a three-dimensional motion reconstruction method based on RGB color and depth images, which solves the problems of high reconstruction cost, high reconstruction distortion and complicated operation in the existing methods

Images