一种基于虚实交互的灵巧手数字孪生系统及其开发方法
By building a dexterous hand digital twin system based on Vue frontend and Unity rendering, combined with Django backend processing and database management, the problems of accurate capture and real-time performance in the interaction between hand movements and the virtual environment were solved, achieving high-precision, real-time synchronous driving of virtual models, improving the user experience and system performance.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HEBEI UNIV OF TECH
- Filing Date
- 2025-01-23
- Publication Date
- 2026-07-17
AI Technical Summary
Existing technologies suffer from difficulties in accurately capturing hand movements and interacting with virtual environments, as well as insufficient real-time performance and interactivity. This results in poor operational accuracy and realism, making it difficult to meet the demands for high-precision and highly flexible hand operations.
We employ a dexterous hand digital twin system based on Vue front-end interaction and Unity 3D rendering, combined with Django back-end processing logic and database management. We design an efficient communication mechanism to achieve real-time capture of hand movements and synchronous driving of the virtual model. We also use image recognition and parsing technology for precise mapping to ensure data security and real-time performance.
It achieves high-precision, real-time synchronous interaction between hand movements and the virtual environment, improving the accuracy and realism of operation, providing an intuitive operating experience, and possessing good scalability and system stability.
Smart Images

Figure CN119987556B_ABST