Spherical Video Framing Using Motion and Stereographic Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manually reviewing videos captured by an image capture device to determine framing is difficult and time-consuming, especially for spherical videos with wide fields of view, as it is challenging to identify spatial extents for presentation or conversion to two-dimensional videos.
Innovation Solution
The system determines framing based on the motion of the image capture device during video capture by projecting spherical visual content onto a plane using stereographic projection, reducing perspective effects, and using optical flow analysis to derive the direction of motion, which is then used to position a viewing window for the visual content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual review of spherical video is used to determine framing, then framing accuracy can be achieved, but the process becomes difficult and time-consuming
Solution Approach 1:
The system enables automatic framing determination by having the video content itself provide the necessary information through optical flow analysis. The spherical video frames automatically determine their own optimal framing based on motion patterns within the content, eliminating the need for manual reviewer intervention while maintaining accuracy.
Solution Approach 2:
The patent replaces the mechanical manual review process with an automated computational system. Optical flow algorithms and stereographic projection techniques substitute for human visual inspection and decision-making, enabling rapid automated framing determination without sacrificing precision.
2Area of stationary object
If spherical video with wide field of view is captured, then more spatial content is recorded, but determining framing becomes more difficult
Solution Approach 1:
The patent applies stereographic projection to transform the spherical video from three-dimensional spherical coordinates to two-dimensional planar coordinates. This dimensional transformation simplifies the framing determination process by mapping the complex spherical field of view onto a manageable plane where optical flow analysis can effectively identify spatial extents and motion patterns.
Solution Approach 2:
The patent introduces optical flow analysis as an intermediary process between capturing spherical video and determining framing. This intermediary technique extracts motion vectors and spatial relationships from the wide-field spherical content, making it easier to identify relevant spatial extents without being overwhelmed by the full 360-degree field of view.
3Productivity
If automated framing based on motion is implemented, then productivity increases, but system complexity increases
Solution Approach 1:
The patent divides the automated framing process into distinct functional segments: stereographic projection of spherical video, optical flow computation for motion detection, and framing determination based on motion patterns. This segmentation allows each component to be independently optimized and processed, improving overall productivity while managing system complexity through modular architecture.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for efficient and automated framing of spherical videos, enabling faster and more accurate determination of spatial extents for presentation, reducing manual effort and improving the framing process.
Implementation Method 1
The spherical visual content may be projected onto a plane using a stereographic projection
Implementation Method 2
The direction of motion of the image capture device during capture of the spherical video may be determined based on an optical flow of the spherical visual content projected onto the plane using the stereographic projection
Data Source
AI summary
Motion of an image capture device during capture of a video, such as a spherical video, is utilized to frame visual content of the video. The motion of the image capture device during video capture is used to determine how the visual content will be framed (e.g., for presentation, for inclusion in a video clip/video edit). The motion of the image capture device during video capture is determined using the visual content projected onto a plane using stereographic projection.