Unlock instant, AI-driven research and patent intelligence for your innovation.

Password understanding method for voice-driven virtual human

A virtual human and password technology, applied in the field of virtual reality, can solve problems such as affecting the user's sense of experience and immersion in VR scenes, and achieve the effect of enhancing the sense of experience and overcoming limitations.

Pending Publication Date: 2021-11-12
NORTHWESTERN POLYTECHNICAL UNIV
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, in the research on voice-driven virtual human motion, most of the voice recognition of fixed passwords, and then directly match the virtual human motion variables according to the text recognized by the voice, so as to realize the virtual human motion control. When the user wants the virtual human To execute the action of "raising the head", it is necessary to issue the prescribed password of "raising the head". The avatar cannot execute the "head up" action smoothly when the same action as "look up" has a password expressed in a different language
Virtual reality emphasizes the sense of immersion. If the user can only control the movement of the virtual human with the specified password, it will affect the user experience and the sense of immersion in the VR scene.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Password understanding method for voice-driven virtual human
  • Password understanding method for voice-driven virtual human
  • Password understanding method for voice-driven virtual human

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0063] The purpose of the present invention is to provide a voice-driven virtual human password understanding method, which understands passwords with the same meaning and expressed in different languages ​​as the same action command, so that a single user can use multiple passwords expressing the same intention to control the virtual human by voice Perform the same action, or enable multiple users to express their intentions with their own oral expression habits, and then control the virtual person to perform related actions by voice. The application of this method will further enhance the user's sense of experience and immersion in the virtual reality environment feel.

[0064] Such as figure 1 As shown, a voice-driven virtual human password comprehension method includes the following steps:

[0065] Step 1: Determine the password text to be underst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a password understanding method for a voice-driven virtual human. The method comprises the following steps: determining a to-be-understood password text; inputting the to-be-understood password text into a password understanding model to obtain a password understanding result output by the password understanding model, the password understanding model comprising a word vector training module, a word vector correction module and a cosine similarity calculation module, the word vector training module carrying out word vector learning by adopting a D-Skip-Gram algorithm based on the training set to obtain a word vector space; the word vector correction module establishing semantic constraint conditions based on the virtual human action instruction library to obtain a corrected word vector space; and the cosine similarity calculation module calculating the cosine similarity in the corrected word vector space to realize understanding of the password text. According to the method, the passwords expressed by the same meaning and different languages can be understood into the same action instruction, so that the user can express the intention by the oral expression habit of the user, and the user experience feeling of the voice-driven virtual human can be improved.

Description

technical field [0001] The invention belongs to the technical field of virtual reality, and in particular relates to a password comprehension method for a virtual human. Background technique [0002] With the development of virtual reality technology, people hope to participate in the VR scene they are viewing. Currently, the more common VR scene interaction method is that the user immerses in the VR scene from the first perspective by wearing a helmet, and then uses the operating handle to perform posture changes, Object grabbing and other actions realize interaction. However, the existing interaction method is based on body movements or manual operations, which is not simple enough for the operation of virtual human beings. Directly driving virtual human actions through voice control can simplify the operation process of virtual human beings and reduce real-life Body interaction makes the control of virtual characters more natural, convenient and flexible, and is also ben...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/22G10L15/26G10L15/06G06N3/08G06N3/04G06F40/30G06F40/289
CPCG10L15/22G10L15/26G10L15/063G06F40/30G06F40/289G06N3/08G10L2015/223G06N3/045
Inventor 樊养余刘洋殷丽丽张新景何雯清粟晨
Owner NORTHWESTERN POLYTECHNICAL UNIV