Composite Video Generation Using Matched Feature Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current panoramic video generation requires specialized panoramic cameras with multiple lenses and results in large data sizes, limiting its applications and user experience due to dependency on high network bandwidth for data processing and storage.
Innovation Solution
A method for generating a composite video by combining image frames with matched features, projecting pixels from multiple frames onto a single image plane, and processing these frames to reduce data requirements and eliminate the need for specialized cameras, allowing for panoramic video creation using standard imaging devices like mobile phones.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a panoramic camera with multiple lenses is used to collect data for generating panoramic video, then the quality and completeness of the panoramic video is improved, but the data size becomes considerably large and specialized equipment is required
Solution Approach 1:
The patent segments the panoramic video generation process into two parts: (1) capturing only a target area of interest using a standard camera, and (2) synthesizing the full panoramic view by combining the captured target area with a pre-acquired panoramic image. This segmentation allows generating high-quality panoramic video without capturing and processing complete 360-degree data from multiple lenses.
Solution Approach 2:
The patent uses a pre-acquired panoramic image as a template or copy of the complete scene. Instead of capturing all panoramic data in real-time, the system captures only the moving target area and composites it with the panoramic image copy, significantly reducing the data that needs to be processed and transmitted.
2Reliability
If a panoramic camera with multiple lenses is used to collect data for generating panoramic video, then the completeness of the panoramic video is improved, but the device complexity increases
Solution Approach 1:
The patent makes a standard single-lens camera perform the function of a panoramic camera by combining it with software processing and a pre-acquired panoramic image. The standard camera captures the target area, and the system synthesizes the complete panoramic view through image processing, eliminating the need for specialized multi-lens panoramic camera equipment.
Solution Approach 2:
The patent introduces a panoramic image as an intermediary element that mediates between the standard camera capture and the final panoramic video output. The panoramic image serves as a reference template that fills in the areas not captured by the standard camera, allowing a simple camera to produce complex panoramic results.
3Reliability
If complete scene data is captured for panoramic video generation, then the quality of the panoramic video is improved, but the network bandwidth requirements increase
Solution Approach 1:
The patent extracts only the essential moving target area from the complete panoramic scene for real-time capture and processing. By focusing computational and network resources on processing only the target area frames rather than complete 360-degree video data from all directions, the system maintains quality while significantly reducing bandwidth consumption for data transmission and processing.
Data Source
AI summary
A method for video processing is provided. The method comprises obtaining an image of a scene, obtaining a video that records an area included in the scene, determining one or more frames from the plurality of frames of the video, determining pairs of matched features, generating a plurality of composite frames by combining each of the selected one or more frames with the image of the scene based on the pairs of matched features, and generating a composite video based on the plurality of composite frames. Each of the pairs of matched features is related to an object that is in both the image and the one or more frames. Each of the pairs of matched features is associated with one or more pixels of the image of the scene and one or more pixels of a selected frame of the one or more frames.