Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Cooperative control interaction method of virtual reality and mixed reality

A mixed reality and virtual reality technology, applied in the field of human-computer interaction, can solve problems such as the inability to realize two or more user interactions, and achieve the effect of avoiding hand gesture recognition and retaining operability

Active Publication Date: 2021-01-05
NORTHEASTERN UNIV
View PDF11 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to solve the problem that virtual reality systems and mixed reality systems generally face single-user scenarios, and it is impossible for two or more users to interact in the mixed reality system and cooperate to operate virtual objects. A collaborative control interaction method for virtual reality and mixed reality is proposed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cooperative control interaction method of virtual reality and mixed reality
  • Cooperative control interaction method of virtual reality and mixed reality
  • Cooperative control interaction method of virtual reality and mixed reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0049] Example 1, please refer to Figure 1-6 , a collaborative control interaction method for virtual reality and mixed reality, comprising the following steps,

[0050] Step 1: Build a virtual table tennis sparring environment model through the Unity3D development platform, including a table and two table tennis bats, as a mixed reality scene, and can realize the visualization of control interaction. Particle effects, textures, and light and shadow enhancements should be added to the scene Auxiliary material for three-dimensional scene reality, in which the size of the table and racket is determined according to the size of the real object; at the same time, it realizes the operation logic of picking up the corresponding ball on the ground and free selection of the serving position, and completes the control function of Hololens in the scene;

[0051] Step 2: Connect the virtual reality device HTC Vive to a high-performance computer, use the high-performance computer as a wo...

Embodiment 2

[0070] Example 2, please refer to Figure 1-6 , a collaborative control interaction method for virtual reality and mixed reality, comprising the following steps,

[0071] Step 1: Build a virtual table tennis sparring environment model through the Unity3D development platform, including a table and two table tennis bats, as a mixed reality scene, and can realize the visualization of control interaction;

[0072] Step 2: Connect the virtual reality device HTC Vive to a high-performance computer, use the high-performance computer as a workstation, and debug on the Unity3D development platform; the specific steps are as follows:

[0073] 1) First create a project file and add the SteamVR library file, the official development library of HTC Vive, to improve the development efficiency of virtual reality programs;

[0074] 2) Install the HTC Vive locator, install the locator on both sides of the high-performance computer, the distance between the two locators is 3.1m, the distance ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a cooperative control interaction method of virtual reality and mixed reality, which comprises the following steps of 1, establishing a virtual table tennis batting environmentmodel through a Unity 3D development platform to realize visualization of control interaction; 2, connecting the virtual reality device HTC Vive with a high-performance computer; 3, performing interaction between virtual reality and mixed reality; 4, unifying a virtual reality coordinate system and a mixed reality coordinate system; and 5, realizing interaction between mixed reality and mixed reality. According to the method, for example, virtual table tennis playing games are performed in holograms, the operability of each user in an asymmetric mode is reserved, and virtual reality equipmentis used as input equipment to replace direct operation of hands, so that the limitation of limited hand posture recognition in the system is avoided; on the basis of cooperative interaction between the mixed reality devices, control interaction between the mixed reality device and the virtual reality device is achieved.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a collaborative control interaction method for virtual reality and mixed reality. Background technique [0002] Virtual reality technology is a new form of human-computer interaction, a computer simulation system that can create and experience virtual worlds. It uses computer to generate a simulated environment, conducts systematic simulation of physical behavior, and immerses users in the environment from a multi-sensory perspective by improving the resolution, quality and effectiveness of the senses; on the basis of virtual reality, it derives augmented reality and mixed reality technologies. Augmented reality superimposes the virtual world and supplementary information on the real world, that is, puts the virtual world on the real world and interacts with it. Mixed reality technology is defined as the combination of reality, augmented reality, augmented vi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01G06T19/00
CPCG06F3/011G06T19/006
Inventor 王斌杨晓春刘一
Owner NORTHEASTERN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products