Multipath Panorama Alignment Using Multiple Rotation Matrices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing methods for stitching panorama images using a single rotation matrix result in large stitching gaps, affecting the 3D feature of the panorama image, as some images have small parallax while others have large parallax.
Innovation Solution
A method and device for panorama image alignment based on multipath images, which involves capturing spherical images, calculating rotation Euler angles for different parts of the images, and using these angles to create multiple panorama images that are then aligned to obtain the final rotation matrices for improved alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a single rotation matrix is used to stitch left and right images, then the stitching process is simple, but large stitching gaps occur and 3D feature is degraded
Solution Approach 1:
The patent divides the panorama stitching process into multiple independent paths (left path and right path), each with its own rotation matrix. Instead of using a single rotation matrix for the entire panorama, the system segments the stitching operation into separate transformations for different image regions, allowing each region to be stitched optimally without forcing a uniform transformation across the whole image.
Solution Approach 2:
The patent applies different rotation matrices to different parts of the panorama image. The left path uses a first rotation matrix while the right path uses a second rotation matrix, allowing each region to have its own optimized transformation parameters. This local differentiation enables better stitching quality in regions with small parallax while maintaining simplicity in the overall stitching architecture.
2Manufacturing precision
If left and right images are separately stitched, then stitching gaps are reduced, but 3D feature is affected due to mixed parallax characteristics
Solution Approach 1:
The patent segments the image processing into distinct left path and right path, where each path is processed independently with its own rotation matrix. This segmentation allows the system to handle the parallax characteristics of different regions separately, preventing the mixing of small and large parallax images that would degrade 3D feature quality.
Solution Approach 2:
By assigning different rotation matrices to the left and right paths, the patent ensures that each region is transformed according to its specific parallax characteristics. This local quality approach preserves the 3D feature integrity by avoiding the forced uniform transformation that would occur if all images were stitched together with a single rotation matrix.
3Manufacturing precision
If multiple rotation matrices are used for different paths, then stitching quality and 3D feature are improved, but algorithm complexity increases
Solution Approach 1:
The patent segments the alignment algorithm into independent modules for left and right paths. Each path has its own rotation matrix calculation and application, which simplifies the overall algorithm structure compared to a single complex unified transformation. The segmentation allows for modular implementation and easier debugging while achieving better stitching quality.
Solution Approach 2:
The patent changes the transformation parameters from a single fixed rotation matrix to multiple path-specific rotation matrices. This parameter differentiation enables the system to adapt to different parallax characteristics in different regions, improving stitching quality while maintaining algorithmic simplicity through straightforward parameter substitution rather than complex adaptive algorithms.
Data Source
AI summary
A panorama image alignment method method comprises: obtaining multipath spherical images; calculating rotation Euler angles between each spherical image and a middle portion, a left portion and a right portion of an adjacent spherical image according to a middle portion, a left portion and a right portion of each spherical image to obtain a first left portion rotation matrix and a second right portion rotation matrix; obtaining a first left panorama image, a first right panorama image, a second left panorama image and a second right panorama image; aligning the second left panorama image to the first left panorama image, obtaining a second left portion rotation matrix by means of calculation, and then obtaining a rotation matrix of a left panorama; aligning the second right panorama image to the first right panorama image, obtaining a second right portion rotation matrix by means of calculation, and obtaining a rotation matrix of a right panorama.
