Multi-Sensor Image Stitching via Overlapping Region Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image stitching in panoramic photography is challenging due to differences in exposure levels and angles between multiple camera lenses, resulting in obvious stitching lines and unnatural color transitions in the resulting image.

Innovation Solution

An image capturing apparatus with multiple image sensors and a processor that detects and captures overlapping regions from different angles, fusing images to generate a stitched image that minimizes these issues by using photographing information from each sensor to create seamless transitions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If images are captured by multiple camera lenses from different angles, then a panoramic scene can be captured, but stitching lines and color transitions appear in the resulting image

Engineering Contradiction:
Improvescene coverage areaVSAvoidimage stitching quality
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent introduces an overlapping region as an intermediary zone between images captured by different camera lenses. This overlapping region contains corresponding features from both images and serves as a mediator for alignment and stitching operations, enabling seamless panorama creation while eliminating visible stitching lines and color transitions

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs feature matching and comparison in the overlapping region to provide feedback for adjusting image alignment and exposure parameters. By continuously refining the stitching based on feature correspondence and exposure differences detected in the overlapping area, the system achieves high-quality seamless panoramas

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If exposure levels are adjusted for different camera lenses, then image quality improves, but stitching becomes more difficult due to exposure differences

Engineering Contradiction:
Improveimage qualityVSAvoidimage stitching complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent dynamically adjusts exposure parameters for different camera lenses based on scene detection and overlapping region analysis. By changing exposure levels adaptively while maintaining consistency in the overlapping region, the system improves overall image quality without creating stitching problems

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent performs exposure matching and feature alignment in the overlapping region before final image stitching. By preliminarily adjusting exposure differences and aligning features in advance, the system simplifies the subsequent stitching process while maintaining high image quality

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10506155B2Image capturing apparatus and image stitching method thereof
Publication Date: 2019.12.10 ACER INC
  • US10506155B2 patent drawing
  • US10506155B2 patent drawing
  • US10506155B2 patent drawing

AI summary

An image capturing apparatus and an image stitching method there are provided, where the method includes the following steps. A scene is detected by using a first image sensor and a second image sensor of the image capturing apparatus to generate first photographing information and second photographing information. The scene is captured by the first image sensor according to the first photographing information and the second photographing information to respectively generate a first image and a first auxiliary image. The scene is captured by the second image sensor according to the second photographing information and the first photographing information to respectively generate a second image and a second auxiliary image. The first image and the first auxiliary image are fused, and the second image and the second auxiliary image are fused so as to obtain fused results corresponding to overlapping regions, and a stitched image is accordingly generated.