Spherical Video View Stabilization Under Margin Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Abrupt changes in viewing directions result in a jerky or shaky view of videos, decreasing the enjoyability of the viewing experience.

Innovation Solution

A system and method for stabilizing viewing directions by determining stabilized trajectories based on viewing information and margin constraints, using a processor to process video information, viewing information, and margin information to smooth out deviations and present a stabilized view on a display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If viewing directions are allowed to change freely according to user interaction, then adaptability and user control are improved, but viewing stability deteriorates resulting in jerky/shaky views

Engineering Contradiction:
Improveuser control of viewing directionsVSAvoidviewing direction stability
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The system dynamically adjusts viewing directions based on user interaction while applying stabilization algorithms that adapt to the specific characteristics of each video segment. The stabilization parameters are adjusted in real-time to balance between following user intent and maintaining smooth playback, transforming the static stabilization approach into a dynamic one that responds to both user input and video content characteristics.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes key parameters such as stabilization strength, response threshold, and smoothing factors based on the detected viewing direction changes and video characteristics. By dynamically adjusting these parameters, the system can transition between more aggressive stabilization (when jerky motion is detected) and more responsive tracking (when smooth panning is intended), thus resolving the contradiction between adaptability and stability.

Inventive Principle:
Principle #35Parameter changes

2Stability of the object's composition

If stabilization constraints are applied to limit deviations, then viewing stability is improved, but adaptability to user interaction deteriorates

Engineering Contradiction:
Improveviewing direction stabilityVSAvoidresponse to user interaction
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The system applies partial stabilization by selectively constraining viewing direction changes based on the detected motion characteristics. Instead of applying uniform stabilization across all user interactions, the system applies constraints only when jerky motion is detected, while allowing free user control during intentional smooth panning operations. This partial application of stabilization maintains both stability and adaptability.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The stabilization system continuously monitors viewing direction changes and uses feedback from this monitoring to adjust the level of constraint applied. When the system detects that user interactions are producing smooth, intentional pans, it reduces or removes constraints to maintain adaptability. When jerky, unintended motion is detected, the system increases constraints to restore stability, creating a closed-loop control system that balances both requirements.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12519917B2Systems and methods for stabilizing views of videos
Publication Date: 2026.01.06 GOPRO INC
  • US12519917B2 patent drawing
  • US12519917B2 patent drawing
  • US12519917B2 patent drawing

AI summary

A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.