360-Degree Video Coordinate Compression and Projection Map Pre-computation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 360-degree video systems face challenges in efficiently capturing, encoding, transmitting, and rendering immersive videos due to issues with spatial discontinuities, memory bandwidth constraints, and the need for flexible projection formats, which affect video quality and rendering complexity.
Innovation Solution
The system employs a network environment with a 360-degree video capture and playback system that includes devices for stitching, encoding, and rendering, using coordinate compression and projection format conversion to minimize spatial discontinuities and optimize memory bandwidth, allowing for real-time rendering with adjustable field of view and viewing direction angles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 360-degree video is captured and rendered in multiple projection formats to provide flexible viewing options, then adaptability and user control are improved, but device complexity and processing requirements increase
Solution Approach 1:
The system pre-generates projection maps for multiple projection formats (equirectangular, cubic, spherical, fisheye) during an offline preparation stage. These pre-computed maps are stored and reused during real-time rendering, eliminating the need to perform complex coordinate transformations on-the-fly. This preliminary action resolves the contradiction by providing multi-format adaptability without increasing real-time processing complexity.
Solution Approach 2:
The rendering process is segmented into distinct stages: coordinate compression of the input 360-degree video, application of pre-generated projection maps for different formats, and final rendering. This segmentation allows each stage to be optimized independently, reducing overall device complexity while maintaining support for multiple projection formats.
2Quantity of substance
If coordinate compression is applied to reduce data size and memory bandwidth consumption, then transmission efficiency and memory bandwidth are improved, but processing complexity increases
Solution Approach 1:
The system applies coordinate compression by transforming the coordinate system representation of the 360-degree video data. This parameter change reduces the amount of data that needs to be transmitted and processed in memory, directly addressing memory bandwidth constraints. The compression is achieved through mathematical coordinate transformations rather than complex algorithmic processing, balancing complexity reduction with efficiency improvement.
3Manufacturing precision
If spatial discontinuities are minimized through optimized projection and rendering, then video quality is improved, but rendering complexity increases
Solution Approach 1:
Projection maps that minimize spatial discontinuities are pre-computed and stored for each projection format. These optimized maps are designed to maintain continuity across seams and boundaries in the projected video. By preparing these maps in advance, the system achieves high video quality without increasing real-time rendering complexity, as the maps are simply applied during rendering rather than computed on-the-fly.
Data Source
AI summary
In a system for 360 degree video capture and playback, 360 degree video may be captured, stitched, encoded, decoded, rendered, and played-back. In one or more implementations, a video capture device captures 360 degree video in a first projection format, and an encoding device encodes the captured 360 degree video into a 360 degree video bitstream. In some aspects, the 360 degree video bitstream is encoded with an indication of the first projection format. In one or more implementations, a rendering device converts the decoded 360 degree video bitstream from the first projection format to a second projection format based on the indication. In one or more implementations, a processing device generates projection maps where each is respectively associated with a different projection format, and a rendering device renders the decoded 360 degree video bitstream using one of the projections maps.