360-Degree Video Projection Format Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality (VR) systems face challenges in efficiently converting 360-degree videos into 2D formats for display, particularly in maintaining image quality and alignment across different projection formats, leading to issues like distortion and redundant pixel information.
Innovation Solution
The method involves selecting a projection plane based on the normal vectors and location of a 3D point in a 3D coordinate system, projecting the 3D point onto a 2D plane, and using unit vectors to derive coordinates, which allows for conversion between different projection formats like equirectangular, cubemap, octahedron, and icosahedron projections, ensuring accurate geometry mapping and alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 360-degree video is converted to 2D format using projection formats, then the video can be displayed on standard screens, but distortion and redundant pixel information occur
Solution Approach 1:
The patent divides the 360-degree video into multiple discrete equirectangular frames that are then packed into a larger 2D image. This segmentation allows each frame to be processed and displayed independently, reducing distortion artifacts and redundant pixels while maintaining compatibility with standard display devices.
Solution Approach 2:
The patent transitions from a 3D spherical representation to a 2D planar representation by packing multiple equirectangular frames into a single 2D image. This dimensional transformation enables the 360-degree video to be displayed on conventional 2D screens while preserving spatial information and reducing distortion through the frame packing process.
2Adaptability or versatility
If multiple projection formats are supported, then versatility is improved, but conversion complexity increases
Solution Approach 1:
The patent uses equirectangular frames as an intermediary representation that can be converted to and from various projection formats. By first converting the 360-degree video into equirectangular frames and then packing them into a 2D image, the system can efficiently convert between different projection formats without requiring complex direct conversion algorithms for each format pair.
3Adaptability or versatility
If 3D points are projected onto 2D planes, then geometry conversion is achieved, but alignment accuracy decreases
Solution Approach 1:
The patent performs preliminary conversion of the 360-degree video into equirectangular frames before packing them into a 2D image. This preliminary action establishes a standardized intermediate representation that simplifies subsequent projection and alignment operations, ensuring accurate geometry conversion while maintaining alignment precision across different viewing angles.
Data Source
AI summary
Conversion between different projection formats of a 360-degree video may be performed in a uniform way. The geometric characteristics of the different projection formats may be considered when applying 3D-to-2D and 2D-to-3D mapping. Parameters reflective of the geometric characteristics of the different projection formats may be determined and used in the mapping and/or conversion. The parameters may include a normal vector that is perpendicular to a projection plane, a reference point in the projection plane, and/or unit vectors defined in the projection plane. An architecture with consolidated modules for handling the various projection formats may be provided.