A method for implementing MR hybrid reality interaction, and a storage medium

A mixed reality and client-side technology, applied in the input/output of user/computer interaction, the input/output process of data processing, instruments, etc., can solve the problems of equipment loss of spatial information, limited recognition range, and inaccurate recognition. Achieve the effects of improving flexibility, expanding the range of operation recognition, and relieving fatigue

Active Publication Date: 2018-12-25
福建天晴在线互动科技有限公司
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Therefore, it is necessary to provide a method for realizing MR mixed reality interaction with Holoens combined with HTCVive that can well solve the above-mentioned problems su

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for implementing MR hybrid reality interaction, and a storage medium
  • A method for implementing MR hybrid reality interaction, and a storage medium
  • A method for implementing MR hybrid reality interaction, and a storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0076] Please refer to figure 2 , this embodiment provides a method for realizing MR mixed reality interaction by combining Holoens with HTCVive. Use the HTC VIVE device that can record and transmit spatial information and event information, combined with the Unity development engine suitable for mobile terminal development to replace the Click device.

[0077] Among them, the HTC VIVE device includes a helmet, a pair of handles and two scanning signal towers, which can realize the simultaneous acquisition of event information and spatial information. After being used in MR scenes, it will enhance the realism of users interacting with MR applications; at the same time, it also It can improve the trigger mode of user operation and greatly enhance the flexibility of operation.

[0078] In addition, a server and a client will be built separately to transfer the event information and spatial information collected by the above-mentioned devices to the Hololens application. Speci...

Embodiment 2

[0120] Please refer to Figure 4 to Figure 12 , this embodiment further expands Embodiment 1, and provides a specific implementation method for realizing MR mixed reality interaction by combining Holoens with HTCVive. Methods include:

[0121] 1. Server

[0122] 1.1 Build server

[0123] In order to successfully obtain the spatial information and event information of the HTC VIVE handle, we need to build a server to collect and process these data. In the project applied in this embodiment, we build a server-side scene based on the Unity engine and SteamVR components to obtain the space information and event information of the handle and establish a monitoring of the client connection. When the server listens to the connection of the client, it will open a new thread to process and package the collected data information, and then send it to the specified client, while the main thread continues to monitor the connection status of the client. The specific flow chart is as F...

Embodiment 3

[0168] This embodiment corresponds to Embodiment 1 and Embodiment 2, and provides a scene applied to MR shooting games:

[0169] 1. Turn on the HTC device (helmet and handle), turn on the HTC base station, turn on the server on the computer where the server is deployed, specify the IP port "127.0.0.1:8080" and start monitoring.

[0170] 2. The player wears and turns on the Hololens helmet, and then opens the MR shooting game application (client). Choose whether to connect to the server, if not, start the game directly. If a connection is required, a connection request is initiated to the specified server according to the set port "127.0.0.1:8080".

[0171] 3. After receiving the connection request sent by the shooting game application (client), the server sends a "connection successful" message to the corresponding client. After the game application (client) receives the message returned by the server, it confirms that the connection is successful, and initializes the mappin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for realizing MR mixed reality interaction by combining Haloens with HTCVive. The storage medium comprises: a server obtains handle data of HTC handle including event information and spatial information, and then packs the handle data to form a data packet and sends the data packet to a Holoens client. The Holoens client parses the packet, obtains the handle data, and applies it to the MR scenario. The invention not only improves the manipulation flexibility of the user; But also greatly alleviate the fatigue problem of user operation; Further, it improves the accuracy of manipulation recognition and the reality of user interaction with MR applications, greatly optimizing the customer experience.

Description

technical field [0001] The invention relates to the field of MR mixed reality, in particular to a method and a storage medium for realizing MR mixed reality interaction. Background technique [0002] Hololens devices currently provide several ways to interact with applications on the device, including voice, gaze, and gestures. The main expansion method of this application is the gesture operation provided by Hololens. At present, several gesture operations supported by Hololens devices are Bloom gestures and Airtap gestures. The Bloom gesture is to stretch out your right hand, put your fingers together and palm up, and then open the palm, and a menu interface similar to win10 will appear, or you can directly voice "hello Cortana" to trigger the Bloom operation. The Airtap gesture is mainly for the operation of the application. Move the cursor over the application icon, stretch out the index finger and thumb, first open it, and then close it, which will trigger the Airtap ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01
CPCG06F3/011G06F2203/012
Inventor 刘德建冯参张伟强陈宏展
Owner 福建天晴在线互动科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap