Dynamic Look-Up Table for Parallax-Free Image Stitching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Generating seamless stitched images from multiple videos is challenging due to the parallax problem in overlapping areas, which occurs even when using a look-up table, leading to image distortion and increased calculation complexity.

Innovation Solution

A method and apparatus that determine the occurrence of a parallax problem in overlapping areas and update the look-up table accordingly, applying the updated table to generate a stitched image, thereby minimizing distortion and reducing calculation complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a look-up table is used for geometrical correction during image stitching, then calculation complexity is reduced and real-time processing becomes feasible, but parallax problems still occur in overlapping areas causing image distortion

Engineering Contradiction:
Improvecalculation complexityVSAvoidimage distortion
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the look-up table updateable in real-time based on camera motion detection. When parallax is detected in overlapping areas, the system dynamically updates the LUT to correct the distortion, transforming a static correction approach into an adaptive one that responds to changing conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements feedback by continuously monitoring overlapping areas for parallax problems and using this information to update the look-up table. The detection of parallax in overlapping regions triggers a feedback loop that adjusts the geometrical correction parameters to eliminate the distortion.

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If geometrical correction is performed for each frame to achieve seamless stitching, then image quality is improved, but large amount of calculation is required making real-time generation difficult

Engineering Contradiction:
Improveseamless stitching qualityVSAvoidreal-time generation speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing geometrical correction data in a look-up table before actual image processing. This allows the system to perform rapid corrections during real-time stitching by simply looking up pre-computed values rather than performing complex calculations on each frame.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes parameters by switching between using a static look-up table for normal operation and updating the LUT dynamically when parallax is detected. This parameter change allows the system to maintain high speed performance while occasionally adjusting correction parameters to maintain image quality.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If the same look-up table is used for generating stitched video, then processing efficiency is maintained, but parallax problems persist in overlapping areas

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidparallax problem occurrence
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent transforms the static look-up table into a dynamic one that can be updated based on detected parallax conditions. This allows the system to maintain processing efficiency through LUT-based correction while adapting the correction parameters when reliability issues are detected in overlapping areas.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from parallax detection in overlapping areas to trigger LUT updates. When reliability problems are detected, the feedback mechanism initiates a correction by updating the look-up table with new geometrical correction parameters specific to the problematic overlapping region.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10963989B2Apparatus and method of generating stitched image based on look-up table
Publication Date: 2021.03.30 ELECTRONICS & TELECOMM RES INST
  • US10963989B2 patent drawing
  • US10963989B2 patent drawing
  • US10963989B2 patent drawing

AI summary

Disclosed is an apparatus and method of generating a stitched image. A method of generating a stitched image according to the present disclosure includes: obtaining a plurality of input images; determining whether or not a parallax problem occurs between overlapping areas of the obtained input images; updating a predetermined look-up table according to the determination; and generating a stitched image by applying the updated look-up table to the input images.