Multi-view Image Motion Estimation Using Disparity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Motion estimation between sequential images from different viewpoints lacks consistency, affecting the performance of multi-view image processing.
Innovation Solution
A method and apparatus that acquire motion estimation information by considering disparity between viewpoints to enhance the consistency of temporal motion estimation, using modules for disparity extraction, motion estimation, and compensation to generate images between sequential views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If motion estimation is performed independently at each point of view using sequential images, then motion estimation can be performed for each viewpoint separately, but consistency of motion estimation values between different points of view deteriorates
Solution Approach 1:
The patent introduces disparity information as an intermediary element that mediates between motion estimation results from different viewpoints. By using disparity maps derived from multi-view geometry, the system adjusts motion vectors from one viewpoint to be consistent with another viewpoint's motion estimation, thereby maintaining independence of processing while ensuring consistency of results through the disparity-mediated correction process
Solution Approach 2:
The patent implements a feedback mechanism where motion estimation results from one viewpoint are used to refine and correct motion estimation at another viewpoint. The system continuously adjusts motion vectors by comparing them against disparity information and iteratively improves consistency, creating a closed-loop system that maintains reliability while allowing independent processing
2Reliability
If disparity information is used to adjust motion estimation between viewpoints, then consistency of motion estimation is improved, but processing complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-computing disparity information between viewpoints before performing motion estimation. By having disparity maps ready in advance, the system avoids the need for complex real-time calculations during motion estimation, reducing processing complexity while maintaining consistency through the pre-established geometric relationships
Solution Approach 2:
The patent segments the motion estimation process into distinct modules: disparity computation, motion estimation at reference viewpoint, and motion adjustment using disparity. This segmentation allows each module to be optimized independently and processed in a systematic manner, reducing overall processing complexity while ensuring consistency through the structured workflow
Data Source
Figure 1~2
Figure 3a
Figure 3b
AI summary
A method and apparatus for processing a multi-view image is provided. The method includes: extracting disparity information between an image of a first point of view and an image of a second point of view; and estimating a motion between two sequential images of the first point of view or the second point of view using the extracted disparity information. The apparatus may include a processor which is configured to extract disparity information between an image of a first point of view and an image of a second point of view in the multi-view image and is further configured to estimate a motion using the extracted disparity information between two sequential images of the first point of view or the second point of view.