Video Stabilization Through Adaptive Capture Trajectories
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Videos captured by an image capture device in motion often appear shaky due to the device's motion during capture, and existing stabilization techniques may not accurately preserve the user's intended motion or efficiently utilize computational resources.
Innovation Solution
A system and method that determines an observed trajectory of the image capture device using position sensors, smooths this trajectory to create a capture trajectory with less jitter, and generates video content based on this smoother path, while respecting constraints such as field of view and user intent.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If real-time video stabilization is applied using motion sensing, then video shakiness is reduced, but computational resources are consumed and processing time increases
Solution Approach 1:
The system performs preliminary actions by determining the observed trajectory of the image capture device before generating the final video content. By calculating the trajectory that connects the beginning and end positions and determining a stabilized trajectory based on this observed trajectory, the system prepares stabilization data in advance, reducing real-time computational burden during video rendering.
Solution Approach 2:
The stabilization process is segmented into distinct computational stages: (1) determining observed trajectory from position information, (2) generating trajectory that connects start and end positions, (3) determining stabilized trajectory from the generated trajectory, and (4) generating video content based on stabilized trajectory. This segmentation allows computational tasks to be distributed and optimized at each stage, reducing overall computational energy consumption.
2Stability of the object's composition
If trajectory smoothing is applied to reduce jitter, then video appears more stable, but user's intended motion may not be accurately preserved
Solution Approach 1:
The system dynamically adjusts the trajectory smoothing based on the observed motion patterns. By determining the observed trajectory first and then generating a trajectory that connects the beginning and end positions while considering the observed trajectory characteristics, the system preserves significant motion information while reducing high-frequency jitter. The stabilized trajectory is determined dynamically from the generated trajectory, allowing adaptive preservation of user intent.
Solution Approach 2:
The system uses the observed trajectory as feedback to generate the final trajectory. By determining the observed trajectory from position information and using it to guide the generation of the trajectory that connects start and end positions, the system ensures that the stabilization process respects the original capture intent. The stabilized trajectory determination uses feedback from the generated trajectory to maintain fidelity to user's intended motion.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution provides stabilized video content that accurately reflects the user's intended motion with reduced computational overhead, maintaining visual integrity and efficiency.
Implementation Method 1
A position sensor may be configured to generate a position output signal based on positions of the housing during the capture duration
Implementation Method 2
An image sensor may be configured to generate an image output signal based on light that becomes incident thereon during a capture duration
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.