Background Recovery Using 3D Projection Matrices for Moving Camera Sequences
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional background recovery methods fail when applied to image sequences captured with a moving camera, as they require no camera movement or rotation.
Innovation Solution
A background recovery apparatus and method that utilize 3D position and posture information, focal length information, and projection matrices to change the viewpoint of a background image from one view point to another, allowing for the deletion of objects and recovery of the background even with camera movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the conventional background recovering method is used to recover the background by collecting parts without image change, then the background recovery is simple and straightforward, but the method becomes inapplicable when the camera moves or rotates
Solution Approach 1:
The patent transitions from 2D image frame analysis to 3D spatial coordinate analysis. By introducing three-dimensional coordinate systems and projection matrices, the system can map background regions from one view point to another, enabling background recovery even when the camera moves or rotates between capturing the target frame and reference frames.
Solution Approach 2:
The patent introduces projection matrices and 3D coordinate transformations as intermediary elements between different view points. These mathematical tools serve as mediators that translate background information from reference frames captured at different positions into the coordinate system of the target frame, allowing accurate background recovery despite camera movement.
2Adaptability or versatility
If multiple view points and 3D geometric information are introduced to handle camera movement, then the adaptability to moving camera is improved, but the computational complexity and processing requirements increase
Solution Approach 1:
The patent performs preliminary actions by pre-establishing projection matrices and 3D coordinate relationships between different view points before actual background recovery. By preparing the geometric transformation framework in advance, the system reduces real-time computational burden while maintaining the capability to handle camera movement.
Data Source
AI summary
Provided is a background recovering apparatus for deleting an object of an arbitrary region and recovering a background covered with the object. The apparatus includes a storing block for storing the input image sequence, and storing the three dimensional (3D) position and posture information, and focal length information; a geometric information extracting block for extracting 3D with respect to the background; a background image generating block for generating the background image; and a background image inserting block for recovering the background by inserting the background image into an arbitrary region of a first view point.