AR Tour Guidance Using 3D Point Clouds and 6DOF Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current audio guides and AR technologies in scenic areas are limited in providing real-time, multiangular, and orientation-sensitive content matching the tourist's sightline, leading to a suboptimal tour experience due to their inability to handle complex scenarios and diverse angles.
Innovation Solution
A method that utilizes a video stream from a user's device to determine an augmented-reality-based content resource package based on three-dimensional point cloud data of a scenic spot, incorporating six-degrees-of-freedom attitude data to provide real-time, multiangular, and orientation-sensitive content matching the user's viewpoint.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If audio guide is used based on GPS/Wi-Fi/Bluetooth positioning, then audio interpretation can be provided to tourists, but the content cannot match the tourist's sightline in real time and cannot serve as a real scenario tour guide
Solution Approach 1:
The patent transitions from 2D image recognition to 3D spatial understanding by introducing six-degrees-of-freedom attitude data and three-dimensional point cloud data. This enables the system to comprehend the tourist's position, orientation, and viewing angle in three-dimensional space, allowing content to be delivered precisely matched to the tourist's sightline and perspective in real scenarios.
Solution Approach 2:
The patent creates a virtual three-dimensional point cloud model that copies and represents the physical scenic spot environment. This digital twin enables the system to understand the spatial relationships and deliver content that accurately corresponds to what the tourist is actually viewing in the real world.
2Adaptability or versatility
If AR based on 2D image recognition and tracking is used, then limited scenarios such as packaging and printing can be covered, but large-scale scenarios such as scenic areas and buildings cannot be handled with multiangular recognition
Solution Approach 1:
The patent develops a universal AR tour guiding system based on 3D point cloud data that can handle multiple scenarios including large-scale scenic areas, buildings, and various viewpoints. The six-degrees-of-freedom attitude data enables the system to work across different locations and angles, making it versatile for various tour guiding scenarios rather than limited to specific 2D scenarios.
Solution Approach 2:
By moving from 2D image recognition to 3D point cloud-based recognition, the system gains the ability to handle large-scale scenarios and multiple viewing angles. The three-dimensional spatial understanding allows the AR content to be accurately delivered regardless of the tourist's position or orientation in the scenic area.
3Measurement precision
If traditional AR is used without orientation sensitivity, then simple tracking is achieved, but intelligent triggering by orientation sensitivity and continuous experience improvement cannot be realized
Solution Approach 1:
The patent implements a feedback mechanism where the six-degrees-of-freedom attitude data continuously provides information about the tourist's orientation and position. This feedback enables the system to intelligently adjust and trigger AR content based on the tourist's current viewing direction, improving both the precision of orientation detection and the efficiency of content delivery in real-time.
Data Source
AI summary
Provided are a tour guiding method and apparatus, an electronic device and a storage medium. The method includes receiving a video stream collected by a user in a current location area of a target scenic spot and sent by an application device; determining, based on the collected video stream and prestored three-dimensional point cloud data of the target scenic spot, an augmented-reality-based content resource package corresponding to the current location area, where the augmented-reality-based content resource package includes at least six-degrees-of-freedom attitude data of the application device; and sending the augmented-reality-based content resource package corresponding to the current location area to the application device to enable the application device to provide the augmented-reality-based content resource package corresponding to the front location area for the user.