Dynamic Image Seam Adjustment for Multi-Sensor Stitching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for merging images from multiple optical sensors often result in artifacts when nearby objects are on the seam, as they fail to accurately represent objects differently in overlapping areas, leading to poor image synthesis and user disorientation.

Innovation Solution

A method that dynamically redefines the seam between images by analyzing object distances using stereoscopy and correlating image content with distance sensor signals, ensuring no objects below a predefined maximum distance are on the seam, thereby avoiding artifacts and improving image synthesis quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a fixed seam is used for merging images based on equal distance or similar pixel projection areas, then the merging process is simple and fast, but artifacts occur when nearby objects are located on the seam

Engineering Contradiction:
Improveimage merging speedVSAvoidimage synthesis quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies dynamics by transitioning from a fixed seam to a dynamic seam that can be adjusted based on object distances. The system determines distances of objects in the overlapping area and modifies the seam position accordingly, making the merging process adaptive rather than static. This resolves the contradiction by allowing the seam to move dynamically when objects are detected near the original seam location.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of seam position based on object distance measurements. When objects are detected within a certain distance range in the overlapping area, the system modifies the seam's horizontal opening parameter to exclude these objects from one of the images. This parameter adjustment eliminates artifacts while maintaining efficient processing.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If the stitching line is adjusted to exclude nearby objects from one image, then artifacts are reduced, but the complexity of the processing increases

Engineering Contradiction:
Improveimage synthesis qualityVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by first determining the distances of objects in the overlapping area before finalizing the seam position. The system identifies objects that would cause artifacts and pre-adjusts the seam accordingly, preventing the artifact problem before it occurs during image synthesis. This structured approach manages complexity by organizing the processing steps logically.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from distance measurements to adjust the seam position. Distance sensors or stereoscopic analysis provide feedback about object locations, and this information feeds back into the seam determination process. The system continuously monitors and adjusts the seam based on detected objects, creating a closed-loop control that improves quality without requiring overly complex processing.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces artifacts in synthesized images, enhancing user orientation and image quality by dynamically adjusting the seam based on object distances and sensor capabilities, particularly in environments with nearby objects.

Implementation Method 1

capturing light reflected from environmental objects to form images

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

determining the distances of objects depicted in the overlapping area from the first optical sensor and/or the second optical sensor

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentEP3011729B1System and method to stitch images from a plurality of optical sensors
Publication Date: 2019.11.20 ROBERT BOSCH GMBH
  • EP3011729B1 patent drawingFigure 1~2
  • EP3011729B1 patent drawingFigure 3~7
  • EP3011729B1 patent drawingFigure 8~12

AI summary

The invention relates to a system and a method for joining images captured using a number of optical sensors, in which a first image is captured using a first optical sensor and a second image is captured using a second optical sensor. The optical content of the first and the second images is analysed and a new joining line for joining the first image and the second image is defined, said new joining line differing from a previously used joining line on the basis of the result of the analysis.