A gesture control system and method in a virtual reality environment

Abstract

The invention discloses a system and a method for controlling a gesture motion in a virtual reality environment. The system comprises a gesture capturing module, a data transmission module, an analysis recognition module and an interaction control module. According to the technical scheme disclosed by the invention, through collecting motion data of a main joint of a hand, the motion data are transmitted to the analysis recognition module through a way that wired connection is combined with wireless connection, and the gesture recognition efficiency and the gesture recognition accuracy are increased; a corresponding relation form of the gesture motion and a motion order in the virtual reality environment is established by utilizing a way that an Android system is combined with a Unity game engine, and the motion order of the gesture motion in the virtual reality environment is obtained by searching the corresponding relation form, so that gesture motion interaction control of the virtual reality environment is realized, and immersive control can be carried out in the virtual reality environment by the user, and real, comfortable and accurate operation experience can be brought to the user.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a gesture control system and method in a virtual reality environment. Background technique [0002] In recent years, with the gradual maturity of virtual reality technology, various virtual reality-related hardware and software products have emerged one after another, but the operating technology related to virtual reality is still very immature. Now the mainstream method is still using traditional interactive methods such as keyboard and mouse. , handles, etc., but none of these interaction methods can achieve a good interaction effect and user experience in a virtual reality environment. Although emerging technologies based on virtual reality environments have developed, such as the generation of gesture recognition interaction methods, there is no mature interactive control system that closely combines gesture recognition and virtual reality on the market. ...

AI Technical Summary

Problems solved by technology

[0002] In recent years, with the gradual maturity of virtual reality technology, various virtual reality-related hardware and software products have emerged one after another, but the operating technology related to virtual reality is still very immature. Now the mainstream method is still using traditional interactive methods such as keyboard and mouse. , handles, etc., but these interaction methods cannot achieve good interaction effects and user experience in the virtual reality environment.

Although emerging technologies based on virtual reality environments have developed, such as the generation of gesture recognition interaction methods, there is currently no mature interactive control system that closely combines gesture recognition and virtual reality on the market.

Images