A virtual reality interactive device with a 3D camera component

Abstract

The invention provides a virtual reality interaction device having a 3D camera assembly. The virtual reality interaction device comprises a 3D camera assembly, a head-mounted virtual reality display, a signal processing assembly and a mobile device interface. The 3D camera assembly is connected with the signal processing assembly and used for capturing an image sequence to be tested, containing depth information, of a user's hands and sending the image sequence to be tested to the signal processing assembly. The signal processing assembly is used for obtaining a gesture of a user based on the image sequence to be tested and determining a corresponding operation instruction based on the gesture in order to execute the operation instruction to a mobile device connected to the mobile device interface. The head-mounted virtual reality display is used for receiving a screen display signal of the mobile device via the mobile device interface such that a screen of the mobile device is present in a pre-set display area in a virtual reality display manner. By adoption of the above technology, the virtual reality interaction device having the 3D camera assembly utilizes gesture recognition technology to perform man-machine interaction. Therefore, an input mode is enriched and operation is performed easily and conveniently.

Description

technical field [0001] The invention relates to human-computer interaction technology, in particular to a virtual reality interactive device with a 3D camera component. Background technique [0002] With the evolution of mobile computing devices from laptops to mobile phones and tablet computers, the control methods of mobile computing devices have also experienced the evolution from keyboards, mice to mobile phone buttons, handwriting tablets, and then to touch screens and virtual keyboards. It can be seen that mobile The control method of equipment is evolving in a direction that is more and more intuitive, simple, and in line with people's natural habits. [0003] Currently, the touch-screen-based control method widely used on mobile computing devices is technically a combination of a transparent touch-sensitive screen and a display screen. The touch-sensitive screen is essentially a positioning device that can capture touches on the screen. Action and obtain its positio...

AI Technical Summary

Problems solved by technology

[0004] Compared with the method of keyboard and mouse, the screen touch method is more in line with human's intuitive reaction and easier to learn. However, the screen touch method only captures the movements of human fingers after all. In some occasions that require more user information input, Such as sports games, simulation training, complex manipulation, long-distance manipulation, etc., the screen touch method shows the limitation of capturing human body information too single

[0005] At present, the existing virtual reality interaction technology usually uses conventional input methods such as mouse and button to interact with the device, which makes the input methods too limited, resulting in cumbersome operations for users when selecting or executing functions. poor

Images