3D Earth Surface Reconstruction for GPS-Free Position and Orientation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing position determining systems rely on remote wireless information that can fail due to sender or receiver malfunction or electromagnetic interference, necessitating a GPS-free localization and navigation method.

Innovation Solution

A method involving obtaining sensor data from calibrated cameras to form a 3D reconstruction of Earth's surface, matching it with pre-stored source data to determine position and orientation using a digital surface model (DSM) and orthophoto, and utilizing algorithms like SLAM and one-shot detection networks for improved matching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If GPS-based position determining systems are used, then position information can be obtained wirelessly from remote systems, but the system fails when senders or receivers malfunction or when electromagnetic interference occurs

Engineering Contradiction:
Improveposition determining system reliabilityVSAvoidelectromagnetic interference and system malfunction
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The position determining system is segmented into multiple independent components: visual sensors capturing images, 3D reconstruction module creating geometric models, DSM generation extracting height information, orthophoto generation creating corrected images, and matching module comparing with source data. Each component operates independently, eliminating single-point failure and providing robust positioning without GPS dependency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs self-positioning by using its own visual sensors to capture images, reconstruct 3D geometry, generate DSM and orthophoto, and match these self-generated products with source data. The system serves itself without external GPS signals, achieving autonomous position determination that is immune to electromagnetic interference affecting remote communication systems.

Inventive Principle:
Principle #25Self-service

2Reliability

If 3D reconstruction and matching algorithms are used for GPS-free localization, then position and orientation can be determined independently of remote systems, but computational complexity increases

Engineering Contradiction:
Improveindependent position determining capabilityVSAvoidcomputational complexity of 3D reconstruction and matching
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The complex computational task is segmented into distinct modules: image acquisition, 3D reconstruction, DSM generation, orthophoto generation, and matching. Each module processes specific aspects of the data independently, allowing for optimized computation in each stage and reducing overall computational burden compared to monolithic approaches.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-generating and storing source DSM and orthophoto data for the region of interest before the actual positioning task. During operation, only matching against these pre-prepared reference data is required, significantly reducing real-time computational complexity compared to performing full 3D reconstruction and matching from scratch.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If sensor data from multiple calibrated cameras is processed to form 3D reconstruction, then position and orientation accuracy is improved, but the quantity of data and processing requirements increase

Engineering Contradiction:
Improveposition and orientation accuracyVSAvoidquantity of sensor data
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

Multiple sensor data streams from calibrated cameras are merged into a unified 3D reconstruction. The individual images from multiple cameras are combined through stereo vision and multi-view geometry to create a single coherent 3D model, DSM, and orthophoto. This merging process consolidates redundant information while preserving complementary data, improving measurement precision without proportionally increasing processing requirements.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system transitions from 2D images to 3D reconstruction by adding the height dimension through depth estimation from multiple camera views. This dimensional transformation allows the system to extract rich geometric and height information (DSM) from the 3D model, enabling accurate position and orientation determination while efficiently utilizing the data from multiple cameras.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP4323970B1A method, software product, and system for determining a position and orientation in a 3D reconstruction of the earth's surface
Publication Date: 2026.03.25 SAAB AB
  • EP4323970B1 patent drawingFigure 1a~1d
  • EP4323970B1 patent drawingFigure 2a~2b
  • EP4323970B1 patent drawingFigure 3

AI summary

The present disclosure relates to a method for determining a position and an orientation. The method (300) comprises the steps of obtaining (310) sensor data (210) comprising a plurality of images of Earth's surface from at least one calibrated camera; forming (320) a 3D reconstruction (220) of a part of Earth's surface based on obtained sensor data (210); obtaining (330) from a data storage (250), source data (260) indicative of a region comprising at least said part of Earth's surface, wherein said source data (260) comprises a source digital surface model, DSM, (270) for said region, and an orthophoto (280) of said region; determining (340a) a sensor DSM (230) of the 3D reconstruction (220) and a sensor texture (240) of the 3D reconstruction (220) based on the 3D reconstruction (220); matching (350) the sensor DSM (230) and the sensor texture (240) with the source DSM (270) and the orthophoto (280); and determining (360) the position and the orientation of the 3D reconstruction (220) based on the matching (350) of the sensor DSM (230) and the sensor texture (240) with the source DSM (270) and the orthophoto (280).