Three-dimensional hand posture estimation and action recognition algorithm based on deep learning
Through the Transformer framework and multi-scale features, the hierarchical mobile window strategy is constructed, combined with the posture smoothing network, the complexity and occlusion problems of three-dimensional hand posture estimation and action recognition in RGB images are solved, and the time dimension utilization of the movement and posture is improved, and the realization of the realization of the action and posture is achieved. High-precision three-dimensional hand posture estimation and motion recognition.
Patent Information
- Application Number
- CN202410842652.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-27
- Publication Date
- 2024-11-29
AI Technical Summary
Three-dimensional hand posture estimation and motion recognition based on RGB images face the complexity of hand structure, occlusion problems, labeling difficulties and real-time challenges. The prior art has not fully utilized time information, resulting in low dynamic gesture recognition accuracy.
Using the Transformer framework, a hierarchical mobile window strategy is constructed through layered ideas and multi-scale features, using inter-frame time information for pose estimation and action recognition, and an pose smoothing network is attached to capture semantic relationships at different time levels, and achieving end-to-end three-dimensional Hand posture estimation and motion recognition.
Improve the accuracy and robustness of three-dimensional hand posture estimation and motion recognition, effectively solve the problem of insufficient hand-object occlusion and single-frame judgment, realize a simple end-to-end training framework, and improve the time of movement and posture Dimension utilization enhances the stability and performance of the model.
Smart Images

Figure CN119049117A_ABST
Abstract
Citation Information
Cited By
A digital human motion recognition method, device, medium and product
CN119741759A
Time series data classification system based on mixed contrast learning network
CN120105190A
Interactive gesture recognition method based on feature mining and adaptive shielding model
CN120877392A
Robot grabbing detection method and system for disordered scene
CN121083672A
Indoor personnel position and typical attitude monitoring method based on electrostatic detection technology
CN121804451A
