Multi-Camera Image Stitching via Parallax and Feature Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The process of stitching images captured by a multi-camera array often results in stitching artifacts due to differences in object movement, parallax error, and image feature complexity, leading to disfigurement of facial features and noticeable visual disruptions in textures.

Innovation Solution

The solution involves manipulating the camera configuration to minimize parallax error and using advanced stitching algorithms that analyze image features, depth, and motion to align and warp image data, with the quality of stitching operations selected based on the proximity of the view window to the overlap region and the importance of image features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If images are stitched together using a multi-camera array, then the field of view and image data coverage are improved, but stitching artifacts appear at or near the stitch lines

Engineering Contradiction:
Improvefield of viewVSAvoidimage alignment accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system performs preliminary calibration between camera pairs to determine transformation parameters before actual image stitching. This pre-processing step establishes the geometric relationship between cameras, enabling accurate alignment and reducing stitching artifacts when images are combined.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces manual or simple automated stitching methods with advanced image processing algorithms that analyze image features, depth information, and motion data. These computational methods automatically warp and align images, substituting complex mechanical alignment procedures with intelligent software-based solutions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If advanced stitching algorithms are used to reduce stitching artifacts, then image quality is improved, but processing complexity and computational requirements increase

Engineering Contradiction:
Improvestitching qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The stitching process is divided into distinct segments: feature detection, depth estimation, motion analysis, image warping, and blending. Each segment handles a specific aspect of the stitching process, allowing the system to manage complexity through modular processing steps rather than attempting to solve all problems simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts stitching parameters such as warp intensity, blending ratios, and processing resolution based on image content analysis. By changing parameters adaptively rather than using fixed settings, the system achieves high stitching quality while optimizing computational resource usage for different scene conditions.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces stitching artifacts, improves the quality of stitched images by aligning image features accurately and adapting the stitching process to the specific content and location within the overlap region, resulting in more seamless and accurate image integration.

Implementation Method 1

differences in object movement, parallax error, and image feature complexity

Methodology Applied
Scientific EffectParallax: Parallax

Data Source

PatentUS9652848B2Image stitching in a multi-camera array
Publication Date: 2017.05.16 GOPRO INC
  • US9652848B2 patent drawing
  • US9652848B2 patent drawing
  • US9652848B2 patent drawing

AI summary

Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.