Non-Parallel Image Point Transfer via Partial 3D Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods fail to accurately locate a point of interest in one perspective view when the viewing directions of two images are significantly non-parallel, particularly in urban terrain where full three-dimensional model data is unavailable, leading to unreliable image correlation and manual alignment procedures.
Innovation Solution
A method that involves obtaining a designation image and a working image with significantly non-parallel viewing directions, deriving range information from a secondary designation image to create a partial relative three-dimensional model, and using this information to correlate the images directly or with a common reference image, allowing for the identification of the point of interest by generating a simulated image to approximate the viewing direction of the working image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional image correlation techniques are used to locate points of interest between images with non-parallel viewing directions, then the method is simple and widely applicable, but the accuracy and reliability deteriorate rapidly in urban terrain with vertical topology
Solution Approach 1:
The patent introduces a three-dimensional model as an intermediary reference framework. Instead of directly correlating two perspective images with non-parallel viewing directions, the system transforms points from both images into the three-dimensional model space, where their spatial relationship can be accurately determined regardless of viewing angle differences.
Solution Approach 2:
The patent transitions from two-dimensional image correlation to three-dimensional spatial reasoning. By representing the scene in a three-dimensional model, the system can accommodate points of interest that are invisible or ambiguous in single perspective views, enabling accurate location transfer between non-parallel viewing directions.
2Measurement precision
If a full three-dimensional model of building structures is constructed using structure-from-motion techniques, then the accuracy of point transfer is improved, but the device complexity and computational requirements increase significantly
Solution Approach 1:
The patent applies partial action by constructing a three-dimensional model only for the specific region of interest rather than the entire scene. The model includes sufficient geometric information (building surfaces, roof planes, ground contours) needed for point transfer, avoiding the excessive computational burden of complete SFM processing while maintaining adequate accuracy.
Solution Approach 2:
The three-dimensional model is segmented into discrete geometric elements such as building surfaces, roof planes, and ground contours. This segmentation allows the complex 3D scene to be represented by manageable geometric primitives that can be efficiently processed for point transfer operations.
3Ease of operation
If images are correlated using features common to both views, then the correlation process is straightforward, but the number of corresponding features decreases dramatically in urban terrain with non-parallel viewing directions
Solution Approach 1:
The three-dimensional model serves as an intermediary that bridges the gap between images with different viewing directions. Instead of relying on rare common features between perspectives, the model provides a comprehensive reference where points from both images can be accurately located and correlated through their spatial relationships in 3D space.
Data Source
AI summary
A method for identifying within a working image of a scene a point of interest designated within a designation image of a scene, the designation image being taken along a first viewing direction and the working image being taken along a second viewing direction, the second viewing direction being significantly non-parallel to the first viewing direction, the method comprising the steps of: obtaining a designation image of the scene; obtaining a working image of the scene; correlating said designation image and said working image with each other, directly or by correlating each of said designation image and said working image with a common reference image, so as to derive an interrelation between said designation image and said working image; and employing said interrelation between said designation image and said working image to derive a location within said working image of a point of interest designated within said designation image, characterized in that the method further comprises: obtaining a secondary designation image taken along a viewing direction displaced from, but similar to, the first viewing direction; and co-processing said designation image and said secondary designation image to derive range information relating to a plurality of pixels in said designation image, thereby defining a partial relative three-dimensional model of a portion of the scene relative to the viewing direction of said designation image, wherein said partial relative three-dimensional model is used in said step of correlating.