Virtual upper limb control system based on myoelectricity and motion capture and method of system

Abstract

The invention discloses a virtual upper limb control system based on myoelectricity and motion capture and a method of the system. The system comprises a myoelectric device, a motion capture device, avirtual game development environment and a virtual/augmented reality device, wherein the virtual game development environment comprises a virtual upper limb model and a virtual game scene; the myoelectric device is used for detecting myoelectric signals and gesture information of different gestures and sending the myoelectric signals and the gesture information to the virtual upper limb model; the motion capture device is used for acquiring joint coordinates and spatial posture information of upper limbs and sending the joint coordinates and the spatial posture information to the virtual upper limb model. The virtual game scene receives data sent by the virtual upper limb model and sends the data to the virtual/augmented reality device, the virtual/augmented reality device feeds back visual auditory stimulation to the user, and virtual objects are placed in a corresponding real environment for operation. The system has the advantages of being low in cost, high in precision, comfort degree, timeliness and interactivity and diversified in scene, has an upper limb integrated game pattern and can increase the game enthusiasm of users.

Description

technical field [0001] The invention belongs to the technical field of virtual environment control, and in particular relates to a virtual upper limb control system based on myoelectricity and motion capture and a method thereof. Background technique [0002] The traditional upper body training game process is monotonous and boring, and the participation is low. It is easy for users to lose interest and confidence in the game, and it is difficult to achieve good training results. Actively participating in the game can improve the user's enthusiasm and promote the remodeling of the brain's neural channels, so the user's autonomous intention can be extracted to decode the movement. For users with certain athletic ability, the user's movement information can be collected through motion capture; for some users with excessive muscle tension, although they have certain athletic ability, excessive muscle tension hinders Movement causes only changes in myoelectric signals but littl...

AI Technical Summary

Problems solved by technology

[0002] The traditional upper body training game process is monotonous and boring, and the participation is low. It is easy for users to lose interest and confidence in the game, and it is difficult to achieve a good training effect.

Images