2D Scanner and Panoramic Camera for 3D Mesh Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 2D scanners cannot capture three-dimensional data of environments, requiring more complex and expensive 3D scanners, and photogrammetry methods lack scale and are slow, making real-time 3D data capture challenging with portable scanners.
Innovation Solution
A system combining a 2D scanner with a panoramic camera and inertial measurement unit to generate a 3D mesh by converting 2D maps into 3D coordinates and applying panoramic images as textures, using photogrammetry and alignment techniques to overcome the limitations of 2D scanners and improve data quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If existing 2D scanners are used to capture environment data, then the system remains simple and portable, but three-dimensional data cannot be captured
Solution Approach 1:
The patent combines a 2D laser scanner with a panoramic camera and IMU into an integrated scanning system. The 2D scanner captures distance measurements while the panoramic camera captures texture images, and the IMU provides orientation data. By merging these components and their data streams, the system achieves 3D data capture capability without requiring a completely new complex 3D scanning system.
Solution Approach 2:
The patent transforms 2D scan data into 3D spatial information by incorporating panoramic images and IMU orientation data. The 2D distance measurements are enriched with texture information from the panoramic camera and spatial orientation from the IMU, effectively adding dimensional information to convert 2D data into 3D representations of the environment.
2Measurement precision
If traditional 3D scanners are used to capture three-dimensional data, then 3D data quality is improved, but the system becomes more complex and expensive
Solution Approach 1:
Instead of using a complex traditional 3D scanner, the patent merges a simple 2D scanner with a panoramic camera and IMU. The combination of 2D distance data, panoramic texture images, and IMU orientation information creates a functional equivalent to 3D scanning while maintaining simplicity and reducing cost.
Solution Approach 2:
The panoramic camera acts as an intermediary that bridges the gap between 2D scanning and 3D representation. By capturing omnidirectional images that are then aligned with 2D scan data using feature matching and IMU orientation, the system generates 3D-like representations without requiring complex 3D scanning hardware.
3Ease of operation
If photogrammetry methods are used to generate 3D data, then portability is improved, but the processing speed is slow and scale is lost
Solution Approach 1:
The patent performs preliminary actions by capturing all necessary data (2D scan points, panoramic images, and IMU orientation) simultaneously during a single scanning pass. The alignment and 3D reconstruction are then performed using pre-extracted features and pre-calibrated camera parameters, significantly accelerating processing compared to traditional photogrammetry that requires multiple separate steps.
Solution Approach 2:
The system uses IMU orientation data as feedback to guide the alignment of panoramic images with 2D scan data. The IMU provides real-time orientation information that feeds into the feature alignment process, enabling rapid and accurate 3D reconstruction while maintaining portability.
4Measurement precision
If panoramic images are aligned with 2D maps using feature extraction, then alignment accuracy is improved, but processing time increases
Solution Approach 1:
The patent performs preliminary feature extraction from panoramic images and pre-aligns them with the 2D map using IMU orientation data during the scanning process itself. By preparing and aligning features in advance rather than performing exhaustive post-processing alignment, the system achieves high accuracy while minimizing additional processing time.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the generation of scaled 3D meshes in real-time using 2D scan data and panoramic images, providing a cost-effective and portable solution for capturing 3D data of environments, improving data quality and reducing complexity compared to traditional 3D scanning methods.
Implementation Method 1
a scanning device that determines coordinates of surfaces in the environment by emitting a light and capturing a reflection to determine a distance
Implementation Method 2
uses a panoramic camera to provide additional information to generate a three-dimensional scan of the environment
Data Source
AI summary
Techniques are described for converting a 2D map into a 3D mesh. The 2D map of the environment is generated using data captured by a 2D scanner. Further, a set of features is identified from a subset of panoramic images of the environment that are captured by a camera. Further, the panoramic images from the subset are aligned with the 2D map using the features that are extracted. Further, 3D coordinates of the features are determined using 2D coordinates from the 2D map and a third coordinate based on a pose of the camera. The 3D mesh is generated using the 3D coordinates of the features.