Remote Image Localization via Sensor-Image Data Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in accurately locating imaging recording devices from a distance, particularly in aerial photographs or satellite images, due to inaccuracies in determining the position of the recording device and height differences on the object's surface.

Innovation Solution

A procedure that compares image data and measurement data to compensate for optical distortions, iteratively filters pixels based on correspondence with the presence or absence of a medium, and determines the position of the sensor device with high accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional methods are used to determine the position and orientation of recording devices, then the process is simple, but the accuracy is insufficient due to non-negligible inaccuracies in determining orientation and position

Engineering Contradiction:
Improveaccuracy of image locationVSAvoidcomplexity of location determination
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary approach by using reference objects with known positions and distinctive features as mediators between the recording device and the imaged object. These reference objects serve as intermediate markers that can be detected in images and used to establish accurate geometric relationships, thereby improving location accuracy without requiring direct complex measurements from the recording device itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs the copying principle by creating a virtual copy of the three-dimensional scene in a two-dimensional image coordinate system. Through photogrammetric methods, the spatial coordinates of points in the real world are copied and transformed into image coordinates, allowing accurate location determination through computational geometry rather than direct physical measurement.

Inventive Principle:
Principle #26Copying

2Measurement precision

If traditional photogrammetric methods are used, then the process is established and known, but the achievable accuracy is limited by optical distortions and measurement inaccuracies

Engineering Contradiction:
Improvespatial assignment accuracyVSAvoidreliability of position determination
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent applies parameter changes by systematically adjusting and optimizing multiple geometric parameters including camera position, orientation angles, and reference point coordinates. By iteratively refining these parameters and using multiple reference objects with known positions, the method compensates for optical distortions and measurement errors, thereby improving both accuracy and reliability of spatial assignment.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements feedback mechanisms through iterative photogrammetric processing, where the initial position and orientation estimates are continuously refined based on the detected positions of reference objects in images. This feedback loop allows the system to correct errors and converge on more accurate location determinations, enhancing the reliability of the results.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If multiple reference objects with known positions are used, then the accuracy of locating image elements improves, but the complexity of the measurement and evaluation procedure increases

Engineering Contradiction:
Improveaccuracy of pixel-to-surface assignmentVSAvoidcomplexity of image processing procedure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the complex task of location determination into separate, manageable steps: first identifying and detecting multiple reference objects with known positions in the images, then establishing geometric relationships between these reference points, and finally using these relationships to determine the positions of other image elements. This segmentation allows the complex procedure to be broken down into systematic operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs universality by designing a multi-functional reference object system that serves multiple purposes: the reference objects with known positions provide both geometric calibration information and spatial orientation data, enabling the same infrastructure to improve both accuracy and simplify the overall processing procedure through standardized reference points.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP4102179B1Method and apparatus for locating an image of an object taken from a distance
Publication Date: 2025.04.16 SCHWARM TECH INC
  • EP4102179B1 patent drawingFigure 1
  • EP4102179B1 patent drawingFigure 2
  • EP4102179B1 patent drawingFigure 3

AI summary

A method for locating an image of an object, in particular a celestial body, taken remotely by means of at least one imaging recording device, comprises: capturing image data representing the image capture and its capture time; capturing measurement data representing a respective measurement signal from at least one sensor device at the capture time, which is arranged in a surface section of the object captured by the image at a location with known position information and is configured to detect electromagnetic radiation incident on the sensor device from a beam path located between the object and the sensor device and to generate the measurement signal as a function of the detected radiation;Comparison of image data and measurement data, whereby an image of a medium at least partially located in the path of the electromagnetic radiation, represented by the image data, is compared with an image of the medium represented by the measurement data in order to identify corresponding image components of the two images with respect to their respective image content; and localization of the image acquisition with respect to the object by determining a position in the image acquisition corresponding to the location of the sensor device based on the comparison and assignment of the location information to this position.