Dynamic Seam Selection for Surround View Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In canonical surround view camera systems, geometric and photometric alignment issues cause seams between overlapping views to misalign on non-planar objects due to differing camera positions, leading to suboptimal composite image stitching.

Innovation Solution

A method is developed to determine the optimal seam by generating a cost map for overlapping regions, computing pixel blending weights based on distance to the seam, and synthesizing a composite view image using dynamic programming to stabilize the seam selection process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a fixed seam is used for stitching views in overlapping regions, then the stitching process is simple and fast, but the seam misaligns on non-planar objects due to different camera positions

Engineering Contradiction:
Improvestitching speedVSAvoidseam alignment accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent transforms the fixed seam approach into a dynamic seam selection process. Instead of using a predetermined fixed seam, the system dynamically determines the optimal seam location for each overlapping region by evaluating multiple candidate seams and selecting the one that minimizes a cost function based on image gradient and intensity differences. This dynamic adaptation allows the seam to adjust to non-planar objects while maintaining computational efficiency through the use of efficient path-finding algorithms.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of seam location from fixed to variable. By introducing a cost function that evaluates different seam positions based on image characteristics (gradients, intensity differences), the system optimizes the seam parameter dynamically. The cost function parameters include gradient magnitude, intensity difference, and positional constraints, allowing flexible adjustment of seam location to achieve better alignment on non-planar objects.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If the seam is adjusted to align on non-planar objects, then the composite image quality improves, but the computational complexity increases

Engineering Contradiction:
Improveseam alignment accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the overlapping region into discrete candidate seam positions and evaluates each independently using a cost function. This segmentation approach transforms the continuous optimization problem into a discrete evaluation process, where each candidate seam is scored based on image gradients and intensity differences. The segmentation of the problem space allows for efficient computation while maintaining high precision in seam selection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent evaluates multiple candidate seams beyond the minimum necessary, using a cost function that considers various image characteristics. By computing costs for all candidate positions and selecting the optimal one, the system performs slightly more computation than a simple fixed seam approach but achieves significantly better alignment accuracy on non-planar objects.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If multiple candidate seams are evaluated to find the optimal seam, then the composite image quality improves, but the processing time increases

Engineering Contradiction:
Improvecomposite image qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary computations by pre-calculating image gradients and intensity differences for all candidate seam positions before selecting the optimal seam. This preliminary action prepares the data structure in advance, allowing the cost function evaluation to proceed efficiently. By organizing the candidate seams and their associated cost metrics beforehand, the system reduces the computational burden during the final seam selection phase.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional mechanical or geometric seam determination methods with an information-based cost function approach. Instead of relying on fixed geometric rules or manual intervention, the system uses computational evaluation of image characteristics (gradients, intensities) to automatically determine the optimal seam. This substitution of mechanical determination with information processing enables efficient evaluation of multiple candidates while maintaining high precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9767561B2Method and apparatus for a optimal seam for surround view synthesis
Publication Date: 2017.09.19 TEXAS INSTRUMENTS INC
  • US9767561B2 patent drawing
  • US9767561B2 patent drawing
  • US9767561B2 patent drawing

AI summary

A method, apparatus and a surround view camera system for determining the optimal seam for a surround view camera system. The method includes determining the corrected side view image at bird-eye perspective, generating a cost map for overlapping region, finding a minimum cost seam for each overlapping region, computing weight based on distance to the seam, if blending of the pixel, and blending the pixel, synthesizing composite view, and generating a composite view image.