一种基于虚实交互的灵巧手数字孪生系统及其开发方法

By building a dexterous hand digital twin system based on Vue frontend and Unity rendering, combined with Django backend processing and database management, the problems of accurate capture and real-time performance in the interaction between hand movements and the virtual environment were solved, achieving high-precision, real-time synchronous driving of virtual models, improving the user experience and system performance.

CN119987556BActive Publication Date: 2026-07-17HEBEI UNIV OF TECH

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
HEBEI UNIV OF TECH
Filing Date
2025-01-23
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies suffer from difficulties in accurately capturing hand movements and interacting with virtual environments, as well as insufficient real-time performance and interactivity. This results in poor operational accuracy and realism, making it difficult to meet the demands for high-precision and highly flexible hand operations.

Method used

We employ a dexterous hand digital twin system based on Vue front-end interaction and Unity 3D rendering, combined with Django back-end processing logic and database management. We design an efficient communication mechanism to achieve real-time capture of hand movements and synchronous driving of the virtual model. We also use image recognition and parsing technology for precise mapping to ensure data security and real-time performance.

Benefits of technology

It achieves high-precision, real-time synchronous interaction between hand movements and the virtual environment, improving the accuracy and realism of operation, providing an intuitive operating experience, and possessing good scalability and system stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119987556B_ABST
    Figure CN119987556B_ABST
Patent Text Reader

Abstract

本发明公开了一种基于虚实交互的灵巧手数字孪生系统及其开发方法,包括以下步骤:利用数字建模工具创建灵巧手模型,并绑定骨骼结构和动作信息;后端服务器由Django框架搭建,设计可视化前端页面,集成3D模型展示窗口以及嵌入视频采集窗口;设计后端接口、数据库架构;基于视频窗口捕捉到的手部动作,对3D模型进行精准的动作映射,实现运动控制数据的实时生成;前端利用图表库将数据库中的数据进行可视化处理并实时更新模型运动状态及关节角度等数据。本发明采用上述一种基于虚实交互的灵巧手数字孪生系统及其开发方法,实现了数字孪生系统的高保真镜像,同时基于通信机制,确保了虚实空间中的数据能够实时、准确地交互传输。
Need to check novelty before this filing date? Find Prior Art