Virtual scene interaction method and device and electronic equipment
A virtual scene and virtual hand technology, applied in the field of virtual scene interaction, can solve the problems of poor interactive experience in virtual scenes and achieve the effect of improving interactive experience
Active Publication Date: 2019-12-13
诺百爱(杭州)科技有限责任公司
View PDF4 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The embodiment of this specification provides a method, device and electronic equipment for virtual scene interaction, to solve the problem of poor virtual scene interaction experience in the prior art
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0055] In order to improve the experience of the virtual scene, the applicant thought that if the user's gesture can be directly recognized and the virtual hand can be controlled according to the recognition result, the user does not need to manipulate a third-party tool, but can directly express the operation to be performed with real hand movements , so that the virtual hand in the virtual scene can be synchronized with the real hand movement.
[0056] Gesture changes can be recognized through image recognition. However, since the hand is three-dimensional, in order to recognize the hand movement, it is necessary to mark and locate the hand. Only by collecting binocular view images can the hand be restored. Actions in a three-dimensional space are limited by the scene and affected by light in the way of images, and action recognition is prone to errors or delays, which limits the interaction in this way and the accuracy is low.
[0057] The applicant thinks that if the idea ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a virtual scene interaction method. The method comprises the following steps: displaying a virtual scene and a virtual hand for operating the virtual scene, acquiring an electromyographic signal generated by a hand action at an arm, identifying a gesture corresponding to the electromyographic signal, synchronously adjusting the gesture of the virtual hand according to the identified gesture, and when the gesture of the virtual hand meets a preset condition, responding to the operation of the virtual hand by the virtual scene; identifying the hand action according to an electromyographic signal generated by the hand action at the arm; the gesture of the virtual hand is synchronously adjusted; completing the synchronization of the virtual hand and the real hand in thevirtual scene; and when the gesture of the virtual hand meets a certain condition, showing that the real hand completes the interaction action. The gesture at the moment can trigger the virtual sceneto respond, and at the moment, the virtual scene responds to the operation of the virtual hand, so that the interaction can be accurately carried out, and the interaction experience of the virtual scene is improved.
Description
technical field [0001] The present application relates to the field of computers, in particular to a method, device and electronic equipment for virtual scene interaction. Background technique [0002] With the development of virtual technology, virtual reality and augmented reality (such as VR glasses, AR glasses) are known to people. Virtual reality and augmented reality both display virtual images and create virtual scenes for users. [0003] When using virtual technology to interact, it is not only necessary to display the virtual screen, but also to manipulate the virtual environment to display the result of the interaction. [0004] The control of the virtual environment in the prior art usually uses handles, gloves, or camera-based vision solutions to read or identify relevant position information, so as to achieve the purpose of control. The first two solutions interact by holding or wearing a third-party tool without freeing hands; the third solution is limited by ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F3/01
CPCG06F3/015G06F3/017
Inventor 唐溢辰
Owner 诺百爱(杭州)科技有限责任公司