HoloLens based holographic display and natural interaction application method for computer console

Abstract

The invention discloses a holoLens based holographic display and natural interaction application method for a computer console. The method includes the following steps in sequence establishing a computer console model and creating a virtual scene based on the model according to a scaled down size of a real computer console, importing the virtual scene into HoloLens glasses and performing holographic display in a real space; performing environment comprehension by utilizing SLAM technology through the HoloLens, positioning a user and acquiring real environment data; implementing friendly interaction between the user and the virtual computer console through the HoloLens. According to the invention, through environment perception and virtual object projection and by adopting natural interaction methods employing sight, gesture, voice and the like, height, size, screen inclination degree, placing position and angle of a single console and combined placing of multiple kinds of consoles canbe adjusted; also, material, color, style and design can be changed according to preference of the user.

Description

technical field [0001] The invention relates to a technology of human-computer interaction and artificial intelligence, in particular to a method for holographic display and natural interaction application of a computer console based on HoloLens. Background technique [0002] As early as the 1960s, people had a preliminary exploration of augmented reality (AR) technology. In 2010, AR and wearable devices developed rapidly. In 2012, the first generation of Google Glass came out, and the smart hardware of AR technology became a trend. Apple , Intel, Qualcomm, Microsoft and other giants have joined in one after another, and augmented reality devices are emerging one after another, such as Epson's Moverio ProBT200, Meta2, Vuzix M100, Daqri smart helmet, ODG R-7, Liangfengtai HiAR Glasses, etc. The prospect of AR is widely optimistic. In 2015, the first generation of Google Glass failed and discontinued production, but this did not hinder the development trend that wearable augme...

AI Technical Summary

Problems solved by technology

In July 2017, Google Glass returned and launched the enterprise version of Google Glass, which has extended battery life, improved comfort, and has advantages such as a more powerful central processing unit and an 8-megapixel camera. However, the calculation process is simple, and the product positioning is still as a mobile phone. , Tablet and other equipment external extension

[0004] In the existing technology, there is no holographic and natural interaction technology for computer consoles. Since the production of computer consoles is time-consuming and labor-intensive, once the model is determined, it is difficult to make any small changes, especially for large enterprises that need mass production. It affects the whole body, and it is difficult for businesses to satisfy all kinds of user groups. Traditional computer consoles have high production costs, long cycle times, and slow transformation, making them very inconvenient to use.

Images