Gesture and pose prediction method and system based on multi-view images
A prediction method and multi-view technology, applied in the field of image processing, can solve problems such as being easily affected by sunlight, poor outdoor experience, self-occlusion of gestures, etc., and achieve the effects of reducing complexity, simple structure, and improving accuracy
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0054] Embodiment 1 of the present disclosure provides a gesture and attitude prediction method based on a multi-view camera, which is different from the previous method for gesture and gesture prediction based on a depth image containing depth information. A training set that enables prediction of arbitrary gestures.
[0055] In this embodiment, a binocular camera is preferably used for gesture prediction, such as figure 1 As shown in the figure, a convolutional neural network is used as a base learner for regression prediction of preset gestures, and a deep integrated gesture and pose prediction model is established by combining with an ensemble learning algorithm. The method mainly includes two stages of model training and prediction.
[0056] The present embodiment provides a detailed description of the proposed gesture and attitude prediction system and method for gestures in the right-hand Cartesian coordinate system. Specifically, it mainly includes the following techni...
Embodiment 2
[0103] Embodiment 2 of the present disclosure provides a wearable gesture and posture prediction system based on a dual-view camera, which solves the problem of difficulty in predicting the spatial posture of a computer only through two-dimensional gesture images, and can realize the prediction of any gesture in space. Prediction of poses from different angles.
[0104] This embodiment takes a typical gesture called a right-hand Cartesian coordinate gesture as an example, such as Image 6 shown, that is, the vertical posture of the thumb, index finger and middle finger of the right hand, and the angle data of the thumb, index finger and middle finger of the gesture in space can be predicted The gesture posture prediction system and prediction method are further described for this hand shape.
[0105] Figure 7 is the module diagram of the wearable gesture and posture prediction system, Figure 4 and Figure 5 The schematic diagrams of the two stages of training and predic...
Embodiment 3
[0111] Embodiment 3 of the present disclosure provides a gesture and posture prediction system based on multi-view images, including:
[0112] a data acquisition module, configured to: acquire gesture image data from at least two viewing angles;
[0113] The posture prediction module is configured to: obtain each gesture image prediction angle according to the acquired gesture images from each perspective and the preset posture prediction model corresponding to each perspective;
[0114] an attitude determination module, configured to: take the average value of the predicted angles of each gesture image as the final gesture angle;
[0115] Among them, in the training of the preset attitude prediction model, the maximum error of the kth convolutional neural network on the training set, the relative error of each sample, the regression error rate of the kth convolutional neural network and the weak learner are calculated. Weight coefficient, update the sample weight according t...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More 



