360-Degree Video Stitching via Adaptive Projection Formats
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 360-degree video capture and playback technologies face challenges in efficiently processing, compressing, and rendering immersive videos due to limitations in projection formats, leading to increased rendering complexity and memory bandwidth requirements, as well as suboptimal compression efficiency.
Innovation Solution
The system employs a stitching device that converts 360-degree video into multiple projection formats, such as equirectangular and cube projections, using an intermediate coordinate system, and encodes it with signaling for different formats, allowing for on-the-fly projection mapping and adaptive projection format selection based on coding statistics and raw data statistics to minimize spatial discontinuities and optimize compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If 360-degree video is processed using traditional single projection format, then processing simplicity is maintained, but compression efficiency is suboptimal and rendering complexity increases
Solution Approach 1:
The patent implements dynamic projection format selection where the system adapts between equirectangular and cube projections based on content characteristics and viewing conditions. This allows the rendering system to optimize for compression efficiency in certain scenarios while maintaining manageable rendering complexity in others, resolving the contradiction between improved compression and increased rendering burden.
Solution Approach 2:
The patent segments the 360-degree video processing into multiple projection format options (equirectangular, cube, and hybrid formats). By dividing the processing into distinct format segments that can be selected based on needs, the system achieves better compression efficiency for specific content types without requiring the full complexity of all formats to be active simultaneously, thus reducing overall rendering complexity while improving compression.
2Productivity
If multiple projection formats are used for 360-degree video, then compression efficiency is enhanced, but memory bandwidth requirements increase
Solution Approach 1:
The patent applies local quality by using hybrid projection formats that combine equirectangular and cube projections in different regions of the 360-degree video based on content characteristics. This allows compression optimization to be applied locally where needed without requiring full conversion to multiple complete projection formats, thereby reducing memory bandwidth requirements while still achieving enhanced compression efficiency in critical areas.
3Manufacturing precision
If adaptive projection format selection is implemented, then spatial discontinuities are minimized, but processing complexity increases
Solution Approach 1:
The patent implements preliminary action by pre-defining a set of projection format options and their characteristics before processing the 360-degree video. The system prepares multiple projection formats in advance and selects from these pre-prepared options based on content analysis, which reduces the real-time processing complexity while still achieving minimized spatial discontinuities through careful format selection.
Data Source
AI summary
In a system for 360 degree video capture and playback, 360 degree video may be captured, stitched, encoded, decoded, rendered, and played-back. In one or more implementations, a stitching device may be configured to stitch the 360 degree video using an intermediate coordinate system between an input picture coordinate system and a capture coordinate system. In one or more implementations, the stitching device may be configured to stitch the 360 degree video into at least two different projection formats using a projection format decision, and an encoding device may be configured to encode the stitched 360 degree video with signaling that indicates the at least two different projection formats. In one or more implementations, the stitching device may be configured to stitch the 360 degree video with multiple viewing angles, and a rendering device may be configured to render the decoded bitstream using one or more suggested viewing angles.