Panoramic Video Stabilization via Spherical Motion Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video stabilization techniques are inadequate for panoramic videos, as they rely on 2D motion models that cannot effectively handle the spherical nature of panoramic images, making it impossible to achieve video stabilization for such content.
Innovation Solution
A method and device for panoramic video stabilization that calculates a rotation matrix for each 2D panoramic image, using feature point matching and smoothing processes to perform motion compensation and reconstruction, allowing for stabilization of panoramic videos by accounting for rotational motion without image information loss.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional 2D motion models are used for video stabilization, then the stabilization process is simple and fast, but it cannot effectively handle the spherical nature of panoramic images
Solution Approach 1:
The patent applies spherical projection technology to transform panoramic images into a spherical coordinate system, enabling accurate representation of the 360-degree field of view. This allows the system to handle the curved nature of panoramic images properly, improving stabilization effectiveness while maintaining computational efficiency through optimized spherical coordinate transformations.
Solution Approach 2:
The patent transitions from traditional 2D motion compensation to 3D spherical coordinate system for motion estimation and compensation. By introducing spherical coordinates (azimuth and elevation angles), the system can accurately model camera movements in panoramic space, resolving the limitation of 2D models while managing complexity through efficient 3D-to-2D projection techniques.
2Adaptability or versatility
If 360-degree panoramic stabilization is implemented, then the wide-angle feature is preserved, but computational complexity increases
Solution Approach 1:
The patent divides the 360-degree panoramic video into multiple overlapping sub-regions or views, allowing independent motion estimation and compensation for each region. This segmentation reduces the overall computational complexity by breaking down the large-scale problem into smaller, more manageable sub-problems while maintaining the complete 360-degree coverage through seamless blending of adjacent regions.
Solution Approach 2:
The patent implements dynamic motion adaptation by continuously adjusting motion parameters based on real-time analysis of panoramic video content. The system dynamically selects appropriate motion models and compensation strategies for different scene conditions, optimizing computational resources while preserving the 360-degree wide-angle feature across varying video characteristics.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Panoramic video processing method and device are disclosed. The method includes steps of receiving a panoramic video waiting for processing; conducting inter frame motion estimation in regard to any two neighboring 2D panoramic images in the panoramic video so as to obtain an inter frame motion estimation result between the same two neighboring 2D panoramic images; acquiring, based on the respective inter frame motion estimation results, a historical motion trajectory of the panoramic video, and carrying out smoothing with respect to the historical motion trajectory; calculating, based on the historical motion trajectory after smoothing, a rotation matrix for motion compensation pertaining to each 2D panoramic image in the panoramic video; and performing reconstruction on each 2D panoramic image in the panoramic video by means of the corresponding rotation matrix for motion compensation so as to attain a panoramic video after image stabilization, and outputting the panoramic video after image stabilization.