Mixed-Reality Scenario Reconstruction via Multi-Device Point Cloud Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Calibration errors in multiple mixed reality devices lead to significant discrepancies in reconstructed scenarios, resulting in poor user experience due to inconsistent sensor calibrations.
Innovation Solution
A method for scenario processing that involves acquiring and aligning point clouds from multiple devices, determining a transition matrix to align coordinate systems, and adjusting scales based on line segment lengths to ensure accurate reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple MR devices are connected for scenario reconstruction, then the coverage and completeness of the reconstructed scenario is improved, but calibration errors between sensors of different devices cause large errors in the reconstructed scenarios
Solution Approach 1:
The patent introduces a terminal device as an intermediary that collects point cloud data from multiple MR devices, performs coordinate system transformation and scaling operations, and generates a unified scenario model. This intermediary processing resolves the calibration errors between devices by centralizing the alignment operations in a dedicated processing unit that can apply transformation matrices and scaling factors to harmonize data from multiple sources.
Solution Approach 2:
The patent transforms the coordinate system parameters of point cloud data from different devices through mathematical transformation matrices. By changing the coordinate system parameters (position, orientation, scale) of each device's point cloud data, the system aligns all data to a unified coordinate system, thereby resolving the calibration errors and enabling accurate multi-device scenario reconstruction.
2Measurement precision
If sensor calibration is performed for each MR device, then individual device accuracy is maintained, but the inconsistency between devices leads to poor user experience
Solution Approach 1:
The patent merges point cloud data from multiple MR devices into a unified scenario model by collecting data from all devices, transforming their coordinate systems to a common reference frame, and integrating them into a single consistent representation. This merging process ensures that while each device maintains its own measurement accuracy, the combined output achieves consistency across all devices through unified coordinate transformation and scaling operations.
3Manufacturing precision
If point cloud alignment and scaling operations are performed, then scenario reconstruction accuracy is improved, but processing time and computational resources increase
Solution Approach 1:
The patent performs coordinate system transformation and scaling operations as preliminary steps before final scenario reconstruction. By pre-aligning the point cloud data from multiple devices and establishing the correct scaling relationships in advance, the system avoids costly real-time computations during rendering and presentation, thereby reducing overall processing time while maintaining high reconstruction precision.
Data Source
AI summary
A method for scenario processing, a terminal device and a storage medium are provided. The method includes: acquiring information of a first point cloud corresponding to a target scenario collected by a terminal device; acquiring information of a second point cloud corresponding to the target scenario collected by a target device; determining a target point cloud, corresponding to the second point cloud, in the first point cloud based on the information of the first point cloud and the information of the second point cloud; and determining a scale for constructing the target scenario based on the target point cloud and the second point cloud.