Panoramic Image Stitching via World Coordinate Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current panoramic image stitching methods using a single lens result in time-consuming processes and introduce a 'ghost effect' or double-image blur, leading to monitoring errors and reliability issues due to image distortion, especially when generating 360-degree views.

Innovation Solution

A panoramic image stitching method that involves converting camera coordinates to a world coordinate system, identifying and calibrating feature points, and stitching calibrated images to generate a panoramic image, thereby mitigating geometric distortion and avoiding the double-image blur effect.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If images are captured by several lenses to reduce time, then productivity is improved, but ghost effect and double-image blur are introduced due to image distortion

Engineering Contradiction:
Improvetime for capturing imagesVSAvoidimage quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies parameter changes by transforming images from camera coordinate systems to a unified world coordinate system, and by calibrating feature point coordinates to eliminate geometric distortion. This allows using multiple lenses for fast capture while maintaining image quality through coordinate transformation and calibration parameters

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces a world coordinate system as an intermediary between multiple camera coordinate systems. This unified coordinate system serves as a mediator to align and stitch images from different lenses without distortion, eliminating the ghost effect while maintaining high productivity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If images are captured by a single lens to avoid ghost effect, then image quality is improved, but time for capturing images increases significantly

Engineering Contradiction:
Improveimage qualityVSAvoidtime for capturing images
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent uses parameter changes through coordinate transformation (camera coordinates to world coordinates) and feature point calibration to eliminate distortion. This enables using multiple lenses for fast capture while achieving single-lens quality images through mathematical correction

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If coordinate calibration is performed on feature points, then manufacturing precision is improved, but device complexity increases

Engineering Contradiction:
Improvecoordinate accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing into distinct stages: feature point detection, coordinate calibration, and image stitching. By dividing the complex calibration process into manageable segments, it achieves high coordinate accuracy while keeping each processing step relatively simple and systematic

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10321054B2Panoramic image stitching method for reducing geometric distortion by using an image registration process and system thereof
Publication Date: 2019.06.11 WELTREND SEMICON INC
  • US10321054B2 patent drawing
  • US10321054B2 patent drawing
  • US10321054B2 patent drawing

AI summary

A panoramic image stitching method includes acquiring a plurality of first images, converting camera image plane coordinates of each first image of the plurality of first images into virtual image plane coordinates for generating a second image according a world coordinate system, identifying a plurality of feature points on the second image, calibrating coordinates of the plurality of feature points on the second image, generating a calibrated second image according to calibrated coordinates of the plurality of feature points on the second image, and stitching a plurality of calibrated second images for generating a panoramic image.