Stereo Panoramic Image Seam Position Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for generating stereo panoramic images often result in binocular rivalry due to inconsistent seam positions between left and right eye images, leading to discomfort during stereo viewing, as they do not adequately consider disparity variations when stitching images.

Innovation Solution

An image processing apparatus that acquires and processes images from multiple viewpoints, estimates disparities, and adjusts seam positions based on disparity amounts to synchronize seam positions between left and right eye images, ensuring consistent viewing experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If seam positions are decided in advance without considering disparity variations, then stitching process is simplified, but binocular rivalry occurs due to inconsistent seam positions between left and right eye images

Engineering Contradiction:
Improvestitching process simplicityVSAvoidbinocular rivalry suppression
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent applies preliminary action by calculating disparity amounts for all candidate seam positions in advance, storing them in a disparity map before actual stitching. This preparation allows the stitching process to simply reference pre-computed disparity values, maintaining simplicity while ensuring accurate seam position selection that prevents binocular rivalry.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses feedback by evaluating candidate seam positions based on disparity amounts and selecting the position with the minimum disparity value. This feedback mechanism ensures that seam positions are optimized to minimize differences between left and right eye images, thereby suppressing binocular rivalry while maintaining stitching quality.

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If disparity consideration is added to evaluation function, then seam positions are closer between left and right images, but binocular rivalry may still occur due to other evaluation function terms

Engineering Contradiction:
Improveseam position alignmentVSAvoidbinocular rivalry suppression
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent applies local quality by focusing the evaluation function specifically on disparity amounts at candidate seam positions, rather than using multiple competing evaluation criteria. This localized approach ensures that seam position selection is determined primarily by disparity minimization, guaranteeing consistent seam positions between stereo images and reliable suppression of binocular rivalry.

Inventive Principle:
Principle #3Local quality

3Area of stationary object

If multiple images from different viewpoints are stitched, then panoramic coverage is increased, but seam position consistency between stereo images becomes difficult to maintain

Engineering Contradiction:
Improvepanoramic coverageVSAvoidseam position consistency
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent applies dimensionality change by introducing a disparity map that stores disparity amounts for multiple candidate seam positions across the panoramic image. This additional dimensional structure allows the system to evaluate and select optimal seam positions that maintain consistency between left and right eye panoramic images, even when stitching multiple images from different viewpoints to achieve wide coverage.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10027949B2Image processing apparatus, image processing method, and recording medium
Publication Date: 2018.07.17 CANON KK
  • US10027949B2 patent drawing
  • US10027949B2 patent drawing
  • US10027949B2 patent drawing

AI summary

Based on a disparity amount of an object image in a left-eye viewpoint and a right-eye viewpoint and a seam position decided for one of the left-eye viewpoint and the right-eye viewpoint, a seam position of the other viewpoint is decided, and a panoramic image for left eye and a panoramic image for right eye are generated by using the decided seam position.