A navigation method and system in a panoramic scene, and ar/vr client device

Abstract

Embodiments of the present invention provide a navigation method in a panoramic scene, a navigation system in a panoramic scene, and an AR / VR client device, which relate to the technical fields of AR and VR, and can realize three-dimensional dynamic real-time navigation. The navigation method in the panoramic scene includes: using the first camera device to capture images, and transmitting the captured depth images to the central computing device in real time; the first camera device includes multiple depth cameras, and the shooting range covers 360°; the central computing device Taking multiple images taken by all depth cameras at the same time as one frame, according to the calibration parameters of the depth cameras, point cloud stitching is performed to eliminate redundant data, and the point cloud data for each frame is obtained and compressed and saved; AR / VR The client device imports the point cloud data saved in the central computing device, and for each frame of point cloud data in sequence, renders the image of the corresponding perspective according to the user's current position information and azimuth angle, and transmits it to the display screen to display.

Description

technical field [0001] The present invention relates to the technical fields of AR and VR, in particular to a navigation method in a panoramic scene, a navigation system in a panoramic scene, and an AR / VR client device. Background technique [0002] In recent years, with the popularity of augmented reality (Augmented Reality, AR for short) and virtual reality (Virtual Reality, VR for short) technologies, they can realize panoramic video. [0003] But because this panoramic video based on AV / VR uses a 360° panoramic camera, the user can only see the panoramic video at the position of the camera, but cannot see the panoramic video at other positions. Contents of the invention [0004] Embodiments of the present invention provide a navigation method in a panoramic scene, a navigation system in a panoramic scene, and an AR / VR client device, which can realize three-dimensional dynamic real-time navigation. [0005] In order to achieve the above object, embodiments of the prese...

AI Technical Summary

Problems solved by technology

[0003] However, due to the use of 360° panoramic cameras for this AV / VR-based panoramic video, the user can only see the panoramic video at the position of the camera, and cannot see the panoramic video at other positions.

Images