Face Stabilization in Video Using Segmented Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video stabilization technologies fail to effectively maintain the position, angle, and scale of a moving face within a video, leading to unstable depiction over time.

Innovation Solution

A system that determines the placement of a face within a video frame based on progress through the video's length, allowing selection of facial stabilization options such as angle, position, and size stabilization, and generates stabilized visual content by adjusting the viewing window accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If existing video stabilization technologies are used, then general video stability is improved, but face stability (position, angle, and scale) deteriorates

Engineering Contradiction:
Improvevideo stabilityVSAvoidface depiction precision
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

The patent segments the stabilization problem into two distinct components: general video stabilization and face-specific stabilization. The system first applies conventional video stabilization techniques to stabilize the overall video content, then separately detects face placement parameters (position, angle, scale) and applies additional face-specific stabilization transformations. This segmentation allows each component to be optimized independently, resolving the contradiction between general video stability and face depiction precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary face detection and analysis module that bridges the gap between general video stabilization and precise face stabilization. This intermediary component detects face placement parameters and generates correction transformations that are applied after video stabilization. The intermediary acts as a mediator that translates face placement variations into appropriate stabilization adjustments, enabling precise face stabilization without compromising overall video stability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If face placement is corrected through video processing, then face stability is improved, but processing complexity increases

Engineering Contradiction:
Improveface stabilityVSAvoidprocessing complexity
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent applies preliminary face detection and parameter extraction at the beginning of the processing pipeline. By detecting face placement parameters (position, angle, scale) early in the video processing sequence, the system establishes a baseline for subsequent stabilization operations. This preliminary action allows the system to pre-calculate the necessary correction transformations, reducing the complexity of real-time processing and enabling more efficient face stabilization throughout the video.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a feedback mechanism where face placement parameters are continuously monitored and used to adjust stabilization transformations. The system detects face placement in each frame, compares it against desired stability criteria, and generates corrective transformations accordingly. This feedback loop enables adaptive face stabilization that responds to actual face movement patterns, improving face stability while maintaining processing efficiency through iterative refinement rather than complex upfront calculations.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11895390B2Stabilization of face in video
Publication Date: 2024.02.06 GOPRO INC
  • US11895390B2 patent drawing
  • US11895390B2 patent drawing
  • US11895390B2 patent drawing

AI summary

Placement of a face depicted within a video may be determined. One or more stabilization options for the video may be obtained. Stabilization option(s) may include angle stabilization option, a position stabilization option, and/or a size stabilization option. The video may be stabilized based on the placement of the face and the stabilization option(s).