3D Earth Surface Reconstruction for GPS-Free Position and Orientation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing position determining systems rely on remote wireless information that can fail due to sender or receiver malfunction or electromagnetic interference, necessitating a GPS-free localization and navigation method.
Innovation Solution
A method involving obtaining sensor data from calibrated cameras to form a 3D reconstruction of Earth's surface, matching it with pre-stored source data to determine position and orientation using a digital surface model (DSM) and orthophoto, and utilizing algorithms like SLAM and one-shot detection networks for improved matching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If GPS-based position determining systems are used, then position information can be obtained wirelessly from remote systems, but the system fails when senders or receivers malfunction or when electromagnetic interference occurs
Solution Approach 1:
The position determining system is segmented into multiple independent components: visual sensors capturing images, 3D reconstruction module creating geometric models, DSM generation extracting height information, orthophoto generation creating corrected images, and matching module comparing with source data. Each component operates independently, eliminating single-point failure and providing robust positioning without GPS dependency.
Solution Approach 2:
The system performs self-positioning by using its own visual sensors to capture images, reconstruct 3D geometry, generate DSM and orthophoto, and match these self-generated products with source data. The system serves itself without external GPS signals, achieving autonomous position determination that is immune to electromagnetic interference affecting remote communication systems.
2Reliability
If 3D reconstruction and matching algorithms are used for GPS-free localization, then position and orientation can be determined independently of remote systems, but computational complexity increases
Solution Approach 1:
The complex computational task is segmented into distinct modules: image acquisition, 3D reconstruction, DSM generation, orthophoto generation, and matching. Each module processes specific aspects of the data independently, allowing for optimized computation in each stage and reducing overall computational burden compared to monolithic approaches.
Solution Approach 2:
The system performs preliminary actions by pre-generating and storing source DSM and orthophoto data for the region of interest before the actual positioning task. During operation, only matching against these pre-prepared reference data is required, significantly reducing real-time computational complexity compared to performing full 3D reconstruction and matching from scratch.
3Measurement precision
If sensor data from multiple calibrated cameras is processed to form 3D reconstruction, then position and orientation accuracy is improved, but the quantity of data and processing requirements increase
Solution Approach 1:
Multiple sensor data streams from calibrated cameras are merged into a unified 3D reconstruction. The individual images from multiple cameras are combined through stereo vision and multi-view geometry to create a single coherent 3D model, DSM, and orthophoto. This merging process consolidates redundant information while preserving complementary data, improving measurement precision without proportionally increasing processing requirements.
Solution Approach 2:
The system transitions from 2D images to 3D reconstruction by adding the height dimension through depth estimation from multiple camera views. This dimensional transformation allows the system to extract rich geometric and height information (DSM) from the 3D model, enabling accurate position and orientation determination while efficiently utilizing the data from multiple cameras.
Data Source
Figure 1a~1d
Figure 2a~2b
Figure 3
AI summary
The present disclosure relates to a method for determining a position and an orientation. The method (300) comprises the steps of obtaining (310) sensor data (210) comprising a plurality of images of Earth's surface from at least one calibrated camera; forming (320) a 3D reconstruction (220) of a part of Earth's surface based on obtained sensor data (210); obtaining (330) from a data storage (250), source data (260) indicative of a region comprising at least said part of Earth's surface, wherein said source data (260) comprises a source digital surface model, DSM, (270) for said region, and an orthophoto (280) of said region; determining (340a) a sensor DSM (230) of the 3D reconstruction (220) and a sensor texture (240) of the 3D reconstruction (220) based on the 3D reconstruction (220); matching (350) the sensor DSM (230) and the sensor texture (240) with the source DSM (270) and the orthophoto (280); and determining (360) the position and the orientation of the 3D reconstruction (220) based on the matching (350) of the sensor DSM (230) and the sensor texture (240) with the source DSM (270) and the orthophoto (280).