Image Stitching Using Optical Flow Remapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image stitching methods often result in fractures or discordance at the splicing seams of panoramic videos, compromising the quality of the spliced image.
Innovation Solution
The method involves remapping overlapping images using an optical flow vector matrix to align pixels before blending, and optionally employing a transition weight matrix for smooth transitions, thereby alleviating seam issues and improving image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If images are directly blended without remapping, then processing speed is improved, but image quality deteriorates due to fractures and discordance at splicing seams
Solution Approach 1:
The patent applies preliminary remapping to overlapping images using an optical flow vector matrix before the blending operation. This pre-alignment of pixels in the overlapping area ensures that corresponding features from different images are properly positioned, preventing fractures and discordance at splicing seams while maintaining efficient processing
2Manufacturing precision
If remapping is performed using optical flow vector matrix, then image quality is improved by aligning pixels, but device complexity increases
Solution Approach 1:
The patent introduces an optical flow vector matrix as an intermediary data structure to facilitate the remapping process. This matrix stores motion vectors that guide the alignment of pixels during remapping, enabling high-quality image stitching without requiring complex real-time computation during the blending phase
Data Source
Figure 1~2a
Figure 2b~2c
Figure 2d~2f
AI summary
This application discloses an image splicing method and apparatus, and a storage medium. The method includes: obtaining a first overlapping image and a second overlapping image, the first overlapping image being an area, in a first image, overlapped with a second image, the second overlapping image being an area, in the second image, overlapped with the first image, and the first image and the second image being to-be-spliced neighboring images; determining a motion vector from each pixel in the first overlapping image to a corresponding pixel in the second overlapping image, to obtain an optical flow vector matrix; remapping, according to the optical flow vector matrix, the first overlapping image to obtain a first remapping image and remapping the second overlapping image to obtain a second remapping image; and blending the first remapping image and the second remapping image, to obtain a blended image of the first overlapping image and the second overlapping image.