Object-Aware Video Stabilization With Adaptive Motion Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video stabilization methods fail to account for the presence of an object of interest, leading to suboptimal stabilization when capturing videos with moving image capture devices.
Innovation Solution
A system that determines whether an object of interest is present in the visual content, using different stabilization techniques based on the presence or absence of the object, either stabilizing based on the movement of the image capture device or the placement of the object within the content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If video stabilization is performed based on image capture device movement, then general video stability is improved, but stabilization quality deteriorates when an object of interest is present
Solution Approach 1:
The patent applies dynamics by switching between two different stabilization modes based on the presence of an object of interest. When no object is detected, the system uses device movement-based stabilization. When an object is detected, it transitions to object-based stabilization, making the stabilization approach adaptive and dynamic rather than static
Solution Approach 2:
The patent segments the stabilization process into two distinct pathways: one for scenes without objects of interest (device movement stabilization) and one for scenes with objects (object-based stabilization). This segmentation allows each pathway to be optimized independently for its specific use case
2Stability of the object's composition
If object-based stabilization is used, then object tracking stability is improved, but device movement compensation is lost
Solution Approach 1:
The patent uses an object detection and tracking system as an intermediary to determine which stabilization mode to activate. This intermediary layer analyzes the visual content to detect objects of interest and then selects the appropriate stabilization strategy, bridging the gap between raw device movement data and final stabilization output
3Device complexity
If a single stabilization method is used for all scenes, then system complexity is reduced, but stabilization adaptability deteriorates
Solution Approach 1:
The patent implements multi-functionality by creating a universal stabilization system that can perform both device movement-based stabilization and object-based stabilization. The system includes multiple components (motion estimation, object detection, tracking) that can be activated based on scene requirements, making the system versatile without requiring separate dedicated systems
Data Source
AI summary
An image capture device may capture a video. A part of the video may include depiction of an object of interest, and another part of the video may not include depiction of the object of interest. Stabilization of the video may switch between object stabilization and movement stabilization based on whether or not the video depicts the object of interest. The part of the video depicting the object of interest may be stabilized using object stabilization. The part of the video not depicting the object of interest may be stabilized using movement stabilization.