Video Stabilization via Frame Submergence into Reference Image
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video recording methods suffer from the lack of combining the aesthetic quality of still photos with the lifelike motion of videos, often resulting in shaky and aesthetically deteriorated video footage.
Innovation Solution
A video processing method that matches multiple frames of a video according to corresponding positions, using one frame as a reference image, marks a motion region, and submerges the content of each frame into the reference image to generate replacement frames with a common fixed background, effectively stabilizing the motion region and integrating these frames into a motion image file.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If video recording is used to capture lifelike motion, then the motion quality is improved, but the aesthetic quality deteriorates due to shaking
Solution Approach 1:
The video frames are segmented into motion regions and static background regions. The motion regions are extracted and composited onto a stabilized background, allowing the motion content to be preserved while eliminating camera shake effects on the overall image composition.
Solution Approach 2:
Different processing approaches are applied to different regions of the video frames. Motion regions undergo warping and compositing operations to stabilize them, while the background remains fixed and aesthetic. This local differentiation allows simultaneous optimization of motion capture and aesthetic quality.
2Manufacturing precision
If still photo method is used to achieve aesthetic quality, then the aesthetic feeling is improved, but the lifelike motion is lost
Solution Approach 1:
The invention merges the advantages of still photo processing (aesthetic quality through precise composition and stabilization) with video processing (lifelike motion capture). By compositing motion regions onto a stabilized background, both aesthetic quality and motion liveliness are achieved simultaneously.
3Manufacturing precision
If frame matching and compositing operations are performed to stabilize motion regions, then the aesthetic quality is improved, but the processing complexity increases
Solution Approach 1:
Feature points are detected and matched between frames in advance, and transformation matrices are pre-calculated. This preliminary processing allows the actual compositing operation to be performed efficiently with reduced real-time computational complexity.
Solution Approach 2:
Instead of performing complex real-time stabilization on the entire video, the invention copies motion regions from multiple frames and composites them onto a single stabilized background frame. This copying approach simplifies the processing by avoiding continuous complex transformations.
Data Source
AI summary
A video processing method includes the steps of: inputting a video; matching multiple frames of the video according to corresponding positions, wherein one of the frames serves as a reference image; marking a motion region, to be preserved, in the video; and submerging a content of each of the frames, corresponding to the motion region, into the reference image to generate a replacement frame. An electronic device is also disclosed.