A VR teaching method and system for ventricular surgery based on force feedback

Abstract

This invention discloses a VR ventricular surgery teaching method and system based on force-tactile feedback, comprising: acquiring a multimodal biomechanical annotation dataset and a virtual surgical scene model; constructing a force-tactile feature waveform retrieval and synthesis model based on the two; dynamically matching and generating corresponding force feedback driving signals from the multimodal biomechanical annotation dataset according to the real-time interaction state between the virtual instruments and the virtual surgical scene model; using the force-tactile feature waveform retrieval and synthesis model to drive the force feedback device to perform ventricular puncture operation training, and simultaneously collecting the trainee's surface electromyography signal data and virtual instrument interaction data; based on the collected data and expert data, generating a comprehensive evaluation report including spatial accuracy, operation quality, and electromyography control efficiency indicators through a multi-dimensional operation quantitative evaluation model. This invention achieves high-fidelity force-tactile feedback and in-depth quantitative analysis of operational skills.

Images