Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-mode man-machine conversation system and method in virtual reality

A human-computer dialogue and virtual reality technology, applied in the field of data processing, can solve the problems of poor subjective expression, scarcity of supply, and high cost of teachers, and achieve the effect of vivid interaction process, improve naturalness, and improve learning interest.

Pending Publication Date: 2019-11-19
SHANGHAI SQUIRREL CLASSROOM ARTIFICIAL INTELLIGENCE TECH CO LTD
View PDF10 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Today's online language training industry is trying to solve the bottleneck of "high teacher cost" and "scarce supply" through AI virtual teacher teaching; the second is the current mainstream foreign language man-machine dialogue learning system, which mainly requires users to follow-up and repeat through standard sentences. Score the sentences read out from the speech evaluation system. This type of learning mode can only understand what others say, and improve listening and oral pronunciation, but it cannot express well subjectively.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-mode man-machine conversation system and method in virtual reality
  • Multi-mode man-machine conversation system and method in virtual reality
  • Multi-mode man-machine conversation system and method in virtual reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The technical solutions in the embodiments of the present invention will be clearly and completely described below, obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. The present invention can be embodied in many different forms of embodiments, and the protection scope of the present invention is not limited to the embodiments mentioned herein. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0027] The multimodal human-computer dialogue learning system and equipment may include situational classrooms and multimodal human-computer dialogue learning systems. The scene classroom is equipped with virtual reality equipment such as host VR head display, VR base station, handheld controller, somatosensory equipment and computer host. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a multi-mode man-machine conversation learning system, method and device in virtual reality. According to the method, a student user can visually interact with a computer through multiple interaction modes, various senses and interaction modes are explained along with dynamic changes of operation and intention of the student user in a three-dimensional space, and situation understanding can be better achieved through data fusion. And on the basis, anthropomorphic feedback is given to the dialogue person, so that a better training effect of human-computer natural languageforeign language learning is achieved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a multi-modal man-machine dialogue learning system, method and device in virtual reality (VR). Background technique [0002] The present invention is mainly based on two backgrounds. One is that real foreign teacher resources are scarce or expensive. The biggest pain point of the current 1-to-1 North American foreign teacher model is diseconomies of scale. Many companies are also losing money as their scale expands. Today's online language training industry is trying to solve the bottleneck of "high teacher cost" and "scarce supply" through AI virtual teacher teaching; the second is the current mainstream foreign language man-machine dialogue learning system, which mainly requires users to follow-up and repeat through standard sentences. Score the sentences read out from the speech evaluation system. This type of learning mode can only understand what others say, and impr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01
CPCG06F3/011
Inventor 王鑫许昭慧
Owner SHANGHAI SQUIRREL CLASSROOM ARTIFICIAL INTELLIGENCE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com