Panoramic Image Alignment via Camera Position Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image connection techniques struggle with accurately connecting panoramic images, especially those with uniform regions or fine repetitive patterns, due to lens aberrations and perspective errors, which are not adequately corrected by simple coordinate transformations or second-order derivative comparisons.
Innovation Solution
An image processing apparatus and method that estimates the camera position for each captured image, performs lens aberration correction, and applies perspective correction based on this position, using an evaluation value calculated from overlapping regions to ensure accurate image alignment and connection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If simple coordinate transformation is used to connect images, then the processing is simple and fast, but lens aberration and perspective errors are not adequately corrected
Solution Approach 1:
The patent transforms image connection from simple coordinate transformation to a comprehensive parameter-based correction system. It estimates camera position parameters (x, y, z coordinates and rotation angles) for each captured image and applies lens aberration correction parameters specific to each position, thereby achieving high-precision alignment while maintaining reasonable processing efficiency through automated parameter estimation.
Solution Approach 2:
The patent performs preliminary estimation of camera position and lens aberration parameters for each captured image before the actual image connection process. By pre-calculating these correction parameters and storing them, the system avoids complex real-time calculations during image stitching, thus maintaining processing speed while ensuring alignment accuracy.
2Measurement precision
If camera position estimation and lens aberration correction are performed for each image, then image connection accuracy is improved, but processing complexity increases
Solution Approach 1:
The patent implements a self-service system where the image processing apparatus automatically estimates its own camera position and determines lens aberration correction parameters for each captured image without requiring external intervention. The system uses the captured images themselves to calculate correction parameters, making the complex processing transparent to the user while achieving high precision.
Solution Approach 2:
The patent employs feedback mechanisms where the system continuously refines camera position estimation and lens aberration correction parameters based on the actual captured images. By using overlapping regions between adjacent images to verify and adjust parameters, the system achieves high accuracy while the automated feedback loop manages processing complexity through iterative optimization.
3Measurement precision
If vignetting correction is applied according to camera settings, then image quality is improved, but noise increases in directions away from the image center
Solution Approach 1:
The patent applies local quality correction by determining specific vignetting correction parameters for each captured image based on its unique camera position and orientation. Rather than applying a uniform correction to all images, the system tailors the correction strength and characteristics to each individual image's characteristics, thereby improving overall image quality while minimizing noise amplification in specific regions.
Data Source
AI summary
The invention provides an image processing apparatus comprising: an acquisition unit configured to acquire a plurality of captured images captured by an image capturing apparatus; a determination unit configured to determine position information of the image capturing apparatus for each of the plurality of captured images so that an evaluation value becomes smaller; and a connecting unit configured to connect the plurality of captured images projected onto a reconstruction plane using the determined position information of the image capturing apparatus, wherein the determination unit comprises a calculation unit configured to project each of the plurality of captured images onto the reconstruction plane based on the set position information and to calculate, as the evaluation value, an image difference between the projected images in a overlapping region between the projected images.