Panoramic Image Alignment Using Gyroscopic Offset Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods for generating panoramic images face errors due to inaccuracies in calculating the moving amount of a camera, particularly when using gyroscopic information, which can be affected by temperature offsets, lens angle variations, and underwater conditions, leading to misalignment and poor image quality.

Innovation Solution

An image processing apparatus that acquires and aligns images by calculating a first moving amount based on common areas and a second moving amount from position information, using a difference correction method to improve precision, especially when gyroscopic information is unreliable, and adjusts for factors like temperature and lens changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If gyroscopic information is used to calculate the moving amount of the image-capturing apparatus, then the alignment process is simplified and faster, but the measurement precision deteriorates due to temperature offsets, lens angle variations, and other environmental factors

Engineering Contradiction:
Improvealignment processing timeVSAvoidmoving amount measurement precision
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The system uses feedback by comparing the gyroscopic moving amount with the actually captured image displacement, detecting the difference (offset) and using this feedback to correct future gyroscopic measurements. The offset detection unit calculates the difference between the gyroscopic moving amount and the actual image moving amount, and this offset information is fed back to improve subsequent alignment accuracy.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system replaces pure gyroscopic mechanical measurement with a hybrid approach that substitutes optical image analysis for correcting gyroscopic errors. By using image-based moving amount detection to correct gyroscopic data, the system substitutes the unreliable mechanical sensing with more accurate optical measurement where the common area overlap is sufficient.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the common area overlap between sequential images is increased to improve alignment accuracy, then the measurement precision improves, but the area of each captured image must be reduced, decreasing the overall image quality and detail

Engineering Contradiction:
Improvealignment accuracyVSAvoidcaptured image area
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The system changes the parameter of image overlap by allowing flexible adjustment of the overlap ratio between sequential images. Instead of requiring large fixed overlaps, the system adapts the overlap parameter based on scene complexity and alignment needs, using offset correction to maintain accuracy even with reduced overlap. This enables optimization between captured area and alignment precision.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If offset correction based on image comparison is applied to improve measurement precision, then the alignment accuracy improves, but the processing complexity and computation time increase

Engineering Contradiction:
Improvemoving amount detection accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the alignment process into distinct functional modules: gyroscopic moving amount acquisition, offset detection through image comparison, offset calculation, and corrected moving amount generation. This segmentation allows each module to be optimized independently and facilitates parallel processing of multiple images, reducing overall processing complexity while maintaining high precision.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10205878B2Image processing apparatus, image-capturing apparatus, image processing method, and non-transitory computer-readable storage medium
Publication Date: 2019.02.12 CANON KK
  • US10205878B2 patent drawing
  • US10205878B2 patent drawing
  • US10205878B2 patent drawing

AI summary

An image processing apparatus configured to generate a panoramic image by combining a plurality of images includes a first acquirer configured to acquire information of a first moving amount of the image based on a common area of the plurality of images, and an aligner configured to align the plurality of images based on difference information between the first moving amount and a second moving amount of the image acquired based on position information of an image-capturing apparatus configured to capture the plurality of images, and information of the second moving amount.