Real-time human-computer interaction system and method based on virtual reality

A technology of virtual reality and human-computer interaction, applied in the field of virtual reality, can solve problems that do not involve human-computer interaction, do not have real-time performance, and achieve high practical value

Inactive Publication Date: 2017-09-22
SHANGHAI JIAO TONG UNIV
View PDF16 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Patent CN201610365024.6 "A virtual reality autonomous response method in virtual reality real-time interaction" realizes real-time interaction between virtual scene and real scene, but does not involve the function of human-computer interaction
CN201520627434.4 "A Human-Computer Interaction System Based on Virtual Reality Technology" realizes human-computer interaction in a purely virtual environment, but does not have real-time performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time human-computer interaction system and method based on virtual reality
  • Real-time human-computer interaction system and method based on virtual reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0045] This embodiment provides a real-time human-computer interaction system and method based on virtual reality, including a three-dimensional image acquisition module, a virtual scene processing module, a control module, a motion feedback module, a virtual reality helmet and external devices. The three-dimensional image acquisition module is mounted on an external device, mainly realizes the image acquisition of the real scene, and transmits the three-dimensional image information to the virtual scene rendering module; the virtual scene processing module realizes the virtual construction and real-time rendering of the real scene. The operator provides a three-dimensional real-time simulation of the real scene; the control module is mainly used to realize the overall control and information transmission of each module (three-dimensional image acquisition module, virtual scene processing module, and motion feedback module), while receiving control instructions from the controll...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a real-time human-computer interaction system based on virtual reality. A three-dimensional image collection module carries out image collection on a real scene and transmits three-dimensional image information to a virtual scene processing module; the virtual scene processing module carries out virtual construction and real-time rendering on the real scene, and provides the three-dimensional real-time simulation of the real scene for a controller; a control module carries out overall planning control and information transmission on each module, and meanwhile, the control instruction of the controller is received and sent to an action feedback module and external equipment; after the action feedback module receives the control instruction, according to a preset action way, a control object in the virtual environment is controlled to finish corresponding action, the real-time feedback of a control effect is provided for the controller in the virtual environment; and a virtual reality hamlet is taken as virtual scene presentation equipment and is worn on the controller, and immersive real-time human-computer interaction is realized. The invention simultaneously provides a real-time human-computer interaction method. By use of the method and the system, real-time human-computer interaction under the virtual reality environment is realized.

Description

technical field [0001] The invention relates to the technical field of virtual reality, in particular to a virtual reality-based real-time human-computer interaction system and method for realizing real-time human-computer interaction in a virtual reality environment. Background technique [0002] Virtual reality technology is a computer simulation system that can create and experience a virtual world. It uses a computer to generate a simulated environment. Through the application of virtual reality technology, more natural human-computer interaction can be used to simulate the control process, create a more immersive control environment and conditions that are difficult to achieve in reality, and endow control simulation with new meaning. [0003] After investigation, it is found that no other patent has realized real-time human-computer interaction in a virtual environment. Patent CN201610365024.6 "A virtual-reality autonomous response method in virtual reality real-time...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T15/00
CPCG06F3/011G06T15/00
Inventor 张定国李仁杰王萌何文谦徐瑜健
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products