Intrusive Object Removal via Dual-Camera Depth Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
During video recording or image capturing, unexpected persons or objects often enter the field of view, leading to spoiled captures, as users have limited real-time control over the scene.
Innovation Solution
A computing device equipped with a first camera for capturing a primary image sequence and a second camera for capturing a secondary image sequence, along with a processor that generates a depth map, identifies intrusive objects, and replaces them with background pixels from a reference frame to generate a modified primary image sequence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If users manually monitor and control the field of view during capture, then intrusive objects can be avoided, but the user's attention is diverted from the viewfinder and real-time control is limited
Solution Approach 1:
The system performs automatic detection and removal of intrusive objects without requiring user intervention. The processor autonomously analyzes the field of view, identifies unwanted objects, and replaces them with background pixels, allowing the device to serve itself in maintaining capture quality while the user focuses on composition.
Solution Approach 2:
The system provides real-time feedback by displaying the modified image sequence showing detected intrusive objects and their removal. This allows users to verify the system's actions and adjust parameters if needed, creating a feedback loop that improves both reliability and ease of operation.
2Reliability
If post-processing editing is performed to remove intrusive objects, then capture quality can be improved, but time is lost and the user cannot preview the final result before capture
Solution Approach 1:
The system performs intrusive object removal in real-time during capture by generating modified image sequences before finalization. This preliminary action allows users to preview the final result and make adjustments before committing to the capture, eliminating the need for time-consuming post-processing editing.
Solution Approach 2:
The patent replaces manual post-processing editing with an automated computer vision system that uses depth maps and pixel replacement algorithms. This substitution of mechanical/manual operations with automated processing significantly reduces time loss while maintaining or improving capture quality.
3Device complexity
If a single camera is used for capture, then device complexity is reduced, but the ability to detect and remove intrusive objects accurately is compromised
Solution Approach 1:
The system segments the imaging function into two specialized cameras: a first camera optimized for capturing the primary image sequence with high quality, and a second camera optimized for detecting intrusive objects with a wider field of view. This segmentation allows each camera to excel at its specific function, improving detection precision without requiring a single complex camera system.
Solution Approach 2:
The processor acts as an intermediary that receives data from both cameras, generates depth maps, and synthesizes the final modified image sequence. This intermediary processing layer integrates information from multiple sources to achieve accurate intrusive object detection and removal while maintaining overall system complexity at a manageable level.
Data Source
AI summary
A computing device is provided. The computing device may include a first camera configured to capture a primary image sequence of a scene, and a second camera configured to substantially concurrently capture a secondary image sequence of the scene. The computing device may include a processor configured to execute instructions stored in memory to obtain a depth map for an image of the primary image sequence, and based on the depth map, generate a reference frame of background pixels from the primary image sequence. The processor may be configured to execute the instructions to detect an intrusive object in the secondary image sequence, replace the intrusive object in the primary image sequence with corresponding background pixels of the reference frame to generate a modified primary image sequence, and output on a display at least one image of the modified primary image sequence.