Virtual hand prosthesis training platform and training method thereof based on Myo armband and eye tracking

Abstract

The invention discloses a virtual hand prosthesis training platform and a training method thereof based on a Myo armband and eye tracking. The virtual hand prosthesis training platform comprises the Myo armband, a Unity virtual environment, an eye tracking unit and a vibrating armband; the Unity virtual environment comprises a virtual hand prosthesis and an adaptive scene capable of grasping objects; the Myo armband comprises a plurality of dry electrodes and a nine-axis inertial module; the dry electrodes are in charge of acquiring micro current of a human arm and solving current gesture information, and the nine-axis inertial module is used for acquiring and solving current arm attitude information; the current gesture information and the current arm attitude information are transmitted to the Unity virtual environment and are used for controlling the virtual hand prosthesis to do corresponding actions; the eye tracking unit is used for analyzing positions of pupils relative to eyes and for mapping the positions in the virtual adaptive scene, so as to select the objects by virtue of the human eyes; and the vibrating armband is used for feeding object grasped information of the Unity virtual environment back to arm muscles. With the application of the training platform and the training method provided by the invention, mental pressure and economic pressure of a patient can be relieved; and meanwhile, the platform can also assess a novel hand prosthesis control algorithm effect, so that the development of myoelectric hand prostheses is promoted.

Description

technical field [0001] The present invention relates to a low-cost virtual prosthetic hand training platform developed to help patients with broken wrists practice real myoelectric prosthetic hands, especially a training platform based on consumable grade Myo armbands and tactile feedback including vibrating armbands. Background technique [0002] Due to the complexity of real myoelectric prosthetic hand equipment, high maintenance costs, poor action demonstration, and inconvenient data statistics, building a virtual prosthetic hand training platform can greatly improve the efficiency of prosthetic hand development, and the cost is relatively lower. [0003] At present, a large number of scholars at home and abroad are studying the content of the virtual prosthetic hand training platform. In this regard, industry scholars have proposed a variety of methods for recognizing human gestures. These methods include recognizing human hand movements based on camera image processing, ...

AI Technical Summary

Problems solved by technology

[0004] These precision instruments can recognize more and finer gestures and movements, but their development, maintenance costs and training costs are quite high, which is unbearable for general patients, and they lack more effective input means and feedback methods, and the interactive experience is not good. immerse yourself in training

Images