Panorama Image Stitching Seam Reduction via Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional methods for generating spherical panorama images using a binocular camera often result in fusion failure, leading to poor user experience due to visible stitching seams, which are not effectively addressed by existing technologies.
Innovation Solution
A system and method employing a panorama device with two fisheye camera lenses capturing images from six spatial directions, performing interpolation to generate rectangular images, stitching and fusing them to minimize stitching seams, and mapping the fused image to a spherical panorama image, with optional rotation to align top and bottom vertices with north and south directions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional spherical panorama image generation method is used, then the panorama image can be generated, but visible stitching seams appear causing fusion failure
Solution Approach 1:
The patent divides the panorama generation process into distinct stages: obtaining multiple images from different directions, performing interpolation on each image separately to generate rectangular images, stitching the rectangular images together, and finally mapping to spherical coordinates. This segmentation allows targeted optimization at each stage, particularly in the interpolation and stitching phases, to minimize seam visibility while ensuring reliable fusion.
Solution Approach 2:
The patent performs interpolation processing on the captured images before stitching them together. By pre-processing the images to generate rectangular images with proper geometric transformation and perspective correction, the patent ensures that the subsequent stitching operation can seamlessly blend the images, thereby reducing stitching seam visibility and preventing fusion failure.
2Area of stationary object
If binocular camera is used to generate panorama image, then wide-range view is achieved, but fusion failure occurs due to stitching seams
Solution Approach 1:
The patent captures images from multiple spatial directions (front, back, left, right) using the binocular camera system, effectively utilizing three-dimensional spatial information. By processing and stitching images from these different dimensional perspectives, the patent achieves a comprehensive wide-range view while maintaining fusion reliability through systematic interpolation and coordinate transformation.
3Manufacturing precision
If interpolation is performed to generate rectangular images, then stitching accuracy is improved, but processing complexity increases
Solution Approach 1:
The patent performs interpolation to transform the captured images into rectangular images with specific geometric parameters and aspect ratios. This parameter transformation standardizes the images for stitching, improving stitching precision by ensuring consistent dimensions and orientations. The systematic parameter changes make the subsequent stitching process more reliable while the automation reduces perceived complexity.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Image processing systems and methods are provided. The method may include obtaining a first image and a second image (510). The first image may be captured by a first camera lens of a panorama device and the second image may be captured by a second camera lens of the panorama device. The method may also include performing an interpolation based on a center of the first image to obtain a first rectangular image (530), and performing an interpolation based on a center of the second image to obtain a second rectangular image (540). The method may further include generating a fused image based on the first rectangular image and the second rectangular image (550), and mapping the fused image to a spherical panorama image (560).