Geotagged Photo Localization Using 3D Model Coordinate Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for determining the location and identifying parts of a target object, such as an airplane, using geotagged photographs are prone to errors due to insufficient metadata, which lacks context about the object's coordinate system, making it difficult for non-experts to accurately assess damage or extract part information.
Innovation Solution
The method involves acquiring geolocation and heading angle data from both reference and feature images, using Cartesian coordinate conversion and coordinate system transformations to estimate the imaging device's location relative to the target object, and then utilizing a 3-D visualization environment with access to the object's models to refine the location and identify parts through interactive or automatic alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If geotagged photographs with metadata are used for location determination, then the ease of operation is improved, but the measurement precision deteriorates due to insufficient context about the target object's coordinate system
Solution Approach 1:
The patent introduces an intermediary coordinate transformation system that bridges the GPS global coordinate system and the target object's local coordinate system. This intermediary layer processes the geotagged metadata through mathematical transformations (using known points on the target object) to convert global coordinates into local object coordinates, thereby resolving the precision issue while maintaining ease of operation
Solution Approach 2:
The patent transforms the coordinate system parameters from global GPS coordinates to local object-specific coordinates. By changing the reference frame and applying transformation parameters based on known points on the target object, the system converts insufficient global location data into precise local position and orientation information relative to the target object
2Device complexity
If visual comparison with technical data is used for part identification, then the device complexity is reduced, but the reliability deteriorates due to subjective indication and high probability of location error
Solution Approach 1:
The patent replaces the subjective visual comparison method with an automated computational system. Instead of relying on expert visual analysis, the system uses computer-based coordinate transformations and 3-D model matching algorithms to objectively determine part locations, thereby improving reliability while keeping the overall system complexity manageable through software automation
Solution Approach 2:
The patent implements a feedback mechanism where the system continuously refines the location determination by comparing calculated positions with known points on the target object. The coordinate transformation process uses feedback from matched features to adjust and verify the accuracy of part identification, reducing errors while maintaining operational simplicity
3Loss of information
If geotagging data is integrated into digital image metadata, then the loss of information is reduced, but the difficulty of detecting and measuring deteriorates without additional context about the location
Solution Approach 1:
The patent adds a new dimensional layer of interpretation to the geotagging data by introducing the target object's coordinate system as a reference dimension. Instead of treating GPS coordinates as standalone information, the system maps these coordinates onto the additional dimension of the object's local coordinate space, enabling precise location and orientation determination relative to the target object
Data Source
Figure 1
Figure 2~6
Figure 3A~3B
AI summary
Methods for identifying parts of a target object (e.g., an airplane (10)) using geotagged photographs captured on site by a hand-held imaging device (4). The geotagged photographs contain GPS location data and camera setting information. The embedded image metadata from two or more photographs is used to estimate the location (i.e., position and orientation) of the imaging device (4) relative to the target object, which location is defined in the coordinate system of the target object. Once the coordinates of the area of interest on the target object are known, the part number and other information associated with the part can be determined when the imaging device (4) viewpoint information is provided to a three-dimensional visualization environment that has access to three-dimensional models of the target object.