A Spatial Consistency Preservation Method for Multiplayer Augmented Reality Interaction

Abstract

The present invention proposes a method for maintaining spatial consistency for multi-person augmented reality interaction. Based on the principle of directional positioning in computer vision, use the Lighthouse base station to obtain the azimuth angles of multiple light sensors distributed on the head-mounted display relative to each base station, and use the front-facing camera of the head-mounted display to obtain the azimuth angle of the base station relative to the head-mounted display. The coordinates of each base station in the camera coordinate system of the front camera of the HMD are calculated by combining the known positional relationship between multiple light sensors of the HMD and the front camera. Furthermore, by using three base stations to determine the model coordinate system of the virtual scene, the transformation relationship between the head-mounted display and the model coordinate system can be established, thereby maintaining the spatial consistency of multi-person augmented reality interaction, which can be achieved with a low amount of calculation. Tracking of multiple headsets without calibration of multiple base stations.

Description

technical field [0001] The invention belongs to the field of computer vision and relates to a method for maintaining spatial consistency, in particular to a method for maintaining spatial consistency oriented to multi-person augmented reality interaction. Background technique [0002] In recent years, the rapid improvement of computer processor capabilities has provided favorable conditions for the rapid development of virtual reality (Virtual Reality, VR) and augmented reality (Augmented Reality, AR). AR display devices such as HTC Vive, Oculus Rift, Microsoft HoloLens, etc. Multi-person augmented reality interaction is one of the main uses of new AR devices. During the interaction process, the augmented reality scenes observed by all users should be consistent, that is, to maintain spatial consistency. Specifically, it is necessary to acquire the position and attitude (referred to as pose) of a head-mounted display (head-mounted display) device accurately and in real time...

AI Technical Summary

Problems solved by technology

[0005] These two methods have their own advantages and disadvantages: the "outside-in" solution has a simpler structure, and only needs to place infrared point light sources on the surface of the head-mounted display. However, there are still many problems in actual use, such as tracking range and distance. Larger limit

And when the number of headsets to be tracked increases, the amount of calculation will also increase dramatically; the "inside-out" solution is essentially a distributed system, and each sensor is responsible for calculating its own position, so the system has no upper limit on the number of tracks , the disadvantage is that the circuit is complicated, and the base station that emits laser needs to be calibrated in advance

Images