Multipath Panorama Alignment Using Multiple Rotation Matrices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing methods for stitching panorama images using a single rotation matrix result in large stitching gaps, affecting the 3D feature of the panorama image, as some images have small parallax while others have large parallax.

Innovation Solution

A method and device for panorama image alignment based on multipath images, which involves capturing spherical images, calculating rotation Euler angles for different parts of the images, and using these angles to create multiple panorama images that are then aligned to obtain the final rotation matrices for improved alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a single rotation matrix is used to stitch left and right images, then the stitching process is simple, but large stitching gaps occur and 3D feature is degraded

Engineering Contradiction:
Improvestitching process simplicityVSAvoidstitching gap size
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent divides the panorama stitching process into multiple independent paths (left path and right path), each with its own rotation matrix. Instead of using a single rotation matrix for the entire panorama, the system segments the stitching operation into separate transformations for different image regions, allowing each region to be stitched optimally without forcing a uniform transformation across the whole image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different rotation matrices to different parts of the panorama image. The left path uses a first rotation matrix while the right path uses a second rotation matrix, allowing each region to have its own optimized transformation parameters. This local differentiation enables better stitching quality in regions with small parallax while maintaining simplicity in the overall stitching architecture.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If left and right images are separately stitched, then stitching gaps are reduced, but 3D feature is affected due to mixed parallax characteristics

Engineering Contradiction:
Improvestitching gap sizeVSAvoid3D feature quality
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent segments the image processing into distinct left path and right path, where each path is processed independently with its own rotation matrix. This segmentation allows the system to handle the parallax characteristics of different regions separately, preventing the mixing of small and large parallax images that would degrade 3D feature quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

By assigning different rotation matrices to the left and right paths, the patent ensures that each region is transformed according to its specific parallax characteristics. This local quality approach preserves the 3D feature integrity by avoiding the forced uniform transformation that would occur if all images were stitched together with a single rotation matrix.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If multiple rotation matrices are used for different paths, then stitching quality and 3D feature are improved, but algorithm complexity increases

Engineering Contradiction:
Improvestitching qualityVSAvoidalignment algorithm complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the alignment algorithm into independent modules for left and right paths. Each path has its own rotation matrix calculation and application, which simplifies the overall algorithm structure compared to a single complex unified transformation. The segmentation allows for modular implementation and easier debugging while achieving better stitching quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the transformation parameters from a single fixed rotation matrix to multiple path-specific rotation matrices. This parameter differentiation enables the system to adapt to different parallax characteristics in different regions, improving stitching quality while maintaining algorithmic simplicity through straightforward parameter substitution rather than complex adaptive algorithms.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11055818B2Panorama image alignment method and device based on multipath images, and portable terminal
Publication Date: 2021.07.06 SHENZHEN ARASHI VISION CO LTD
  • US11055818B2 patent drawing

AI summary

A panorama image alignment method method comprises: obtaining multipath spherical images; calculating rotation Euler angles between each spherical image and a middle portion, a left portion and a right portion of an adjacent spherical image according to a middle portion, a left portion and a right portion of each spherical image to obtain a first left portion rotation matrix and a second right portion rotation matrix; obtaining a first left panorama image, a first right panorama image, a second left panorama image and a second right panorama image; aligning the second left panorama image to the first left panorama image, obtaining a second left portion rotation matrix by means of calculation, and then obtaining a rotation matrix of a left panorama; aligning the second right panorama image to the first right panorama image, obtaining a second right portion rotation matrix by means of calculation, and obtaining a rotation matrix of a right panorama.