Motion-aware and dual-stream spatio-temporal graph convolution based action quality assessment method
By using a method based on motion perception and dual-stream spatiotemporal graph convolution, the position and orientation features of rehabilitation movements are extracted, dynamically grouped, and self-attention mechanism is utilized. This solves the problem of inflexible joint synergy modeling in existing technologies and achieves high-precision rehabilitation movement quality assessment.
Patent Information
- Application Number
- CN202512046231.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-31
- Publication Date
- 2026-06-23
- Estimated Expiration
- 2045-12-31
AI Technical Summary
Existing technologies struggle to accurately model inter-joint synergy in rehabilitation movement quality assessment. Fixed joint grouping strategies lack flexibility, while fully adaptive grouping lacks prior knowledge constraints, resulting in insufficient reliability of assessment results.
We employ a method based on motion perception and dual-stream spatiotemporal graph convolution. By acquiring rehabilitation action skeleton sequence data, we extract position and orientation data streams, extract spatiotemporal features using dual-stream STGCN branches, design a motion perception dynamic grouping module to generate grouping masks, and model the feature correlation between groups and their ins and outs through a multi-head self-attention mechanism. Finally, we construct a regression head for evaluation.
It significantly improves the model's evaluation accuracy and robustness, can distinguish subtle differences in the quality of action completion, reduces the mean absolute error by about 26.5%, achieves state-of-the-art evaluation results on public datasets, and has good robustness and adaptability.