Video Stabilization via Dynamic Viewing Window

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Videos captured by image capture devices in motion often appear shaky due to the device's movement, which existing technologies fail to effectively stabilize.

Innovation Solution

A system that determines a viewing window based on the rotational positions of the image capture device over time, adjusting its size and orientation to generate stabilized visual content by cropping and rotating the video footage, thereby compensating for the device's motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the image capture device moves during capture, then the video content covers more dynamic scenes, but the video appears shaky and unstable

Engineering Contradiction:
Improvedynamic scene coverageVSAvoidvideo stability
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent extracts a stable viewing window from the dynamic video content by determining a viewing window based on rotational positions of the image capture device. This viewing window is then applied consistently across frames to isolate stable content, effectively separating the stable portion from the shaky motion.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent dynamically adjusts the viewing window size and position as a function of progress through the video based on rotational positions. This dynamic adjustment allows the system to adapt to changing motion conditions while maintaining stabilization, rather than using a fixed window approach.

Inventive Principle:
Principle #15Dynamics

2Stability of the object's composition

If a fixed viewing window is used for stabilization, then the video appears stable, but the field of view is limited and zoom effects are lost

Engineering Contradiction:
Improvevideo stabilityVSAvoidfield of view flexibility
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The viewing window is defined to change as a function of progress through the video content based on rotational positions. This dynamic definition allows the window size and position to adapt over time, enabling simulated zoom and pan effects while maintaining stability through the function-based approach.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters of the viewing window (size, position, orientation) as functions of video progress and rotational positions. By varying these parameters dynamically, the system achieves both stabilization and flexible field of view adjustment, including simulated zoom effects.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If the viewing window size changes dynamically, then zoom and pan effects are achieved, but the computational complexity increases

Engineering Contradiction:
Improvezoom and pan effectsVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses rotational position information as an intermediary to drive the viewing window adjustments. Instead of directly computing complex transformations from raw video data, the system uses the measured rotational positions as a mediator to determine window parameters, simplifying the computational approach.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system determines rotational positions and computes viewing window parameters in advance as a function of video progress before final rendering. This preliminary computation of window definitions based on pre-analyzed rotational data reduces real-time computational complexity during video playback.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11985425B2Systems and methods for stabilizing videos
Publication Date: 2024.05.14 GOPRO INC
  • US11985425B2 patent drawing
  • US11985425B2 patent drawing
  • US11985425B2 patent drawing

AI summary

A video may be captured by an image capture device in motion. A stabilized view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The size of the punchout of the video may be changed based on different rotational positions of to provide a view that includes different extents of the captured visual content. The changes in the size of the punchout may simulate changes in zoom of the visual content.