3D Point Cloud Alignment for Accurate Mixed Reality Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) devices lack the accuracy and detail in environmental understanding necessary for precise guidance in construction and surveying applications, relying on imprecise internal sensors and limited field of view.
Innovation Solution
Integrating a high-density LIDAR sensor, such as the Trimble X7, with a head-mounted MR device like the Trimble XR10 to capture and transmit high-accuracy, high-density point clouds, providing enhanced environmental understanding and guidance through a separate external scanner that overwrites the MR device's understanding with higher quality input.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If internal sensors of AR device are used for environmental understanding, then device complexity is reduced, but measurement precision deteriorates
Solution Approach 1:
The patent introduces an external LIDAR scanner as an intermediary device that captures high-precision point cloud data of the environment. This external scanner acts as a mediator between the AR device and the environment, providing accurate spatial information without requiring the AR device itself to have complex sensing capabilities. The scanner is positioned in the environment and transmits point cloud data to the AR device, enabling precise environmental understanding while keeping the AR device relatively simple.
2Measurement precision
If high-density LIDAR sensor is integrated with MR device, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The system is segmented into two independent components: a high-precision LIDAR scanner that remains stationary in the environment, and a lightweight AR device that the user wears. By separating the heavy sensing function from the display and processing functions, the system achieves high measurement precision without making the wearable AR device complex or bulky. The scanner handles data acquisition while the AR device handles presentation and user interaction.
Solution Approach 2:
The external LIDAR scanner serves as an intermediary that provides high-precision point cloud data to the AR device without being integrated into it. This intermediary approach allows the system to achieve high measurement precision while maintaining a simple, lightweight AR device that is easy to wear and operate.
3Measurement precision
If external scanner is used to capture point cloud, then measurement precision is improved, but loss of time increases due to data transmission
Solution Approach 1:
The LIDAR scanner captures the complete point cloud data of the environment in advance before the user begins the AR-guided task. By performing the environmental scanning beforehand, the system eliminates real-time data transmission delays during the actual AR guidance process. The pre-captured point cloud data is then used to generate and display accurate holographic overlays immediately, ensuring both high precision and real-time performance.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise, real-time guidance for construction tasks with millimeter accuracy, allowing users to accurately place holographic information and navigate complex environments, overcoming limitations of internal AR sensors.
Implementation Method 1
A laser scanner, such as Trimble's X7 3D laser scanner, can be used to acquire a three-dimensional point cloud of an environment
Implementation Method 2
The laser scanner includes a laser configured to emit a laser beam
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system for integrating high-density laser scanner data with mixed-reality is disclosed. In some implementations, the system may acquire, using a laser scanner, a collection of data points representing a three-dimensional point cloud, wherein the laser scanner includes: a laser configured to generate an optical beam; a beam-steering device configured to steer the optical beam; and a detector configured to receive light from the optical beam, after light from the optical beam is reflected from an object in an environment. The system may transmit data of the point cloud to the augmented-reality device, wherein the augmented-reality device comprises: one or more cameras configured to acquire images of the environment; and a display configured to render graphics on the display. The system may align a reference frame of the augmented-reality device to the data of the point cloud. The system may present a graphic on the display of the augmented-reality device, wherein the graphic is positioned on the display in relation to the environment based on the reference frame of the augmented-reality device being aligned to data of the point cloud.