Spherical Video View Stabilization Under Margin Constraints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Abrupt changes in viewing directions result in a jerky or shaky view of videos, decreasing the enjoyability of the viewing experience.
Innovation Solution
A system and method for stabilizing viewing directions by determining stabilized trajectories based on viewing information and margin constraints, using a processor to process video information, viewing information, and margin information to smooth out deviations and present a stabilized view on a display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If viewing directions are allowed to change freely according to user interaction, then adaptability and user control are improved, but viewing stability deteriorates resulting in jerky/shaky views
Solution Approach 1:
The system dynamically adjusts viewing directions based on user interaction while applying stabilization algorithms that adapt to the specific characteristics of each video segment. The stabilization parameters are adjusted in real-time to balance between following user intent and maintaining smooth playback, transforming the static stabilization approach into a dynamic one that responds to both user input and video content characteristics.
Solution Approach 2:
The system changes key parameters such as stabilization strength, response threshold, and smoothing factors based on the detected viewing direction changes and video characteristics. By dynamically adjusting these parameters, the system can transition between more aggressive stabilization (when jerky motion is detected) and more responsive tracking (when smooth panning is intended), thus resolving the contradiction between adaptability and stability.
2Stability of the object's composition
If stabilization constraints are applied to limit deviations, then viewing stability is improved, but adaptability to user interaction deteriorates
Solution Approach 1:
The system applies partial stabilization by selectively constraining viewing direction changes based on the detected motion characteristics. Instead of applying uniform stabilization across all user interactions, the system applies constraints only when jerky motion is detected, while allowing free user control during intentional smooth panning operations. This partial application of stabilization maintains both stability and adaptability.
Solution Approach 2:
The stabilization system continuously monitors viewing direction changes and uses feedback from this monitoring to adjust the level of constraint applied. When the system detects that user interactions are producing smooth, intentional pans, it reduces or removes constraints to maintain adaptability. When jerky, unintended motion is detected, the system increases constraints to restore stability, creating a closed-loop control system that balances both requirements.
Data Source
AI summary
A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.


