Fundamental Matrix Calculation Using Depth-Based Point Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies face challenges in accurately calculating the fundamental matrix from images taken from different camera positions and attitudes, leading to inefficiencies in shake correction and three-dimensional reconstruction, particularly when corresponding points lack depth information.
Innovation Solution
An image processing apparatus that acquires multiple images, calculates a first fundamental matrix based on corresponding points, extracts second corresponding points based on depth, and determines a second fundamental matrix to improve shake correction and three-dimensional reconstruction accuracy by selecting points that are both nearest and farthest, thereby enhancing the fundamental matrix calculation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a fundamental matrix is calculated based on corresponding points without depth information, then the calculation can be performed with simple corresponding points, but the accuracy of the fundamental matrix and subsequent shake correction deteriorates
Solution Approach 1:
The patent introduces depth information as an additional dimension to the corresponding points. By extracting corresponding points and sorting them by depth, then selecting points from different depth layers (nearest and farthest), the system transforms 2D corresponding points into 3D spatially-aware points. This dimensional enhancement allows the fundamental matrix to capture more accurate geometric relationships between images, resolving the contradiction between calculation simplicity and accuracy.
2Productivity
If corresponding points are selected without considering depth, then the processing is simpler and faster, but the three-dimensional reconstruction accuracy deteriorates
Solution Approach 1:
The patent performs preliminary actions by first calculating the fundamental matrix from all corresponding points, then using this matrix to compute depth information for each corresponding point. After sorting points by depth, the system selects representative points (nearest and farthest) for final processing. This preliminary computation of depth and sorting enables accurate three-dimensional reconstruction while maintaining efficient processing through selective point usage.
3Measurement precision
If all corresponding points are used for fundamental matrix calculation, then more data is available for accurate reconstruction, but the computational complexity and processing time increase
Solution Approach 1:
The patent extracts and selects only the most representative corresponding points from the complete set. By sorting all corresponding points according to depth information and then extracting only the nearest and farthest points, the system reduces the number of points used for final fundamental matrix calculation. This extraction approach maintains reconstruction accuracy by preserving depth diversity while significantly reducing computational complexity and processing time.
Data Source
AI summary
An image processing apparatus includes an image acquisition unit that acquires a plurality of images, a corresponding point acquisition unit, a first fundamental matrix calculation unit, a depth calculation unit, a corresponding point extraction unit, and a fundamental matrix determination unit. The corresponding point acquisition unit acquires a plurality of first corresponding points of the images. The first fundamental matrix calculation unit calculates a first fundamental matrix based on the first corresponding points. The depth calculation unit calculates depths for the first corresponding points based on the first fundamental matrix. The corresponding point extraction unit extracts a plurality of second corresponding points from the first corresponding points based on the depths. The fundamental matrix determination unit calculates a second fundamental matrix based on the second corresponding points.