A VR interaction method, device and electronic equipment based on dynamic gestures

Abstract

The embodiment of the invention provides a VR interaction method and device based on dynamic gestures and an electronic device. The VR interaction method comprises the steps that binocular video frames acquired by the VR device are continuously obtained; hand shape zones are extracted from first ocular video frames of the obtained binocular video frames, wherein the first ocular video frames are left ocular video frames or right ocular video frames; the extracted hand shape zones are identified to obtain static gesture identification results corresponding to the hand shape zones, wherein the static gesture identification results include pointing or clicking; when the obtained static gesture identification results include the two results of pointing or clicking, dynamic gestures of clicking and pointing are determined, and response operations corresponding to the dynamic gestures are executed. By adopting the scheme provided in the embodiment, the response speed and precision of VR interaction can be improved.

Description

technical field [0001] The present invention relates to the field of virtual reality, in particular to a dynamic gesture-based VR interaction method, device and electronic equipment. Background technique [0002] VR (Virtual Reality, Virtual Reality) technology is to use computer technology to simulate a three-dimensional virtual world, providing users with simulations of vision, hearing, touch and other senses, allowing users to feel as if they are on the scene, in real time, without Observing things in three-dimensional space in a restricted way. [0003] Among them, the human-computer interaction in VR technology refers to the technology of realizing dialogue between human beings and the virtual world generated by computer input and output devices in an effective manner. Specifically, the interaction forms of human-computer interaction in the VR technology include but are not limited to peripheral devices, voice, dynamic gestures and other forms. [0004] In the traditi...

AI Technical Summary

Problems solved by technology

[0004] In the traditional VR interaction method based on dynamic gestures composed of pointing and clicking (that is, human-computer interaction in VR technology), when recognizing dynamic gestures, in order to determine the starting point and end point of each gesture, it is necessary to repeat the video frame Analysis to find the whole process of dynamic gestures, for example, in the prior art, in the process of recognizing dynamic gestures for a video sequence containing dynamic gestures, by using a selected frame window to analyze video frames of the size of the frame window, When the 5th frame of a video frame containing a dynamic gesture is the start moment of the dynamic gesture, the 15th frame is the end moment of the dynamic gesture, the entire video sequence is 25 frames, and the frame window size is 20, the frame analysis process is in order It can be recognized for 1-20 frames, 2-21 frames, 3-22 frames, and 4-25 frames. In the process of recognizing frames that include some dynamic gestures, dynamic gestures can be recognized, but it cannot be determined in which The frame triggers the dynamic gesture. Similarly, the end moment of the dynamic gesture cannot be determined, so repeated analysis of the video frame is required.

[0005] Therefore, in the prior art, the video frame at the start moment and the video frame at the end moment of the dynamic gesture cannot be quickly and accurately determined in the recognition of dynamic gestures, which ultimately leads to low response speed and accuracy of VR interaction

Images