Hemisphere Cubemap Face Packing Constraints for 360 Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high bitrate requirements for representing 360-degree omnidirectional video content in virtual reality pose a challenge for efficient data compression and transmission, particularly when using hemisphere cubemap projection layouts, which demand innovative face packing constraints to maintain image quality.
Innovation Solution
A video processing method and apparatus that decodes bitstreams to generate projection-based frames with constrained face indexes and rotation angles, ensuring bitstream conformance and maintaining image quality by mapping 360-degree content onto projection faces in a hemisphere cubemap layout, with specific syntax elements signaling face packing configurations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of moving object
If hemisphere cubemap projection layout is used to represent 360-degree omnidirectional video content, then the field of view coverage is improved, but the bitrate requirement increases
Solution Approach 1:
The projection-based frame is segmented into multiple projection faces (one full face and four half faces) that are packed in the hemisphere cubemap layout. Each face can be independently encoded and constrained, allowing for efficient compression while maintaining the complete 360-degree coverage.
Solution Approach 2:
Face packing constraints are applied locally to specific projection faces based on their position indexes. The constraints on face indexes and rotation angles are tailored to each face's location in the hemisphere cubemap layout, optimizing compression efficiency for each region while preserving overall image quality.
2Manufacturing precision
If face packing constraints are applied to maintain image quality in hemisphere cubemap projection, then image quality is improved, but the device complexity increases
Solution Approach 1:
The patent applies parameter changes by constraining face indexes and rotation angles to specific valid ranges based on position indexes. These parameter constraints ensure that projection faces are correctly assembled to maintain image quality while avoiding invalid configurations that would degrade quality.
Solution Approach 2:
The decoding apparatus automatically applies the face packing constraints based on the position indexes of projection faces. The system self-regulates the face assembly process by enforcing the constraints defined in the bitstream, eliminating the need for external intervention or complex manual configuration.
3Reliability
If syntax elements signaling face indexes and rotation angles are constrained to meet bitstream conformance, then bitstream compatibility is improved, but the flexibility in face configuration is reduced
Solution Approach 1:
The face packing constraints are dynamically determined based on the position indexes of projection faces. Different position indexes have different constraint rules, allowing the system to adapt the configuration flexibility to each specific face location while maintaining overall bitstream conformance and compatibility.
Data Source
AI summary
A video processing method includes a step of receiving a bitstream, and a step of decoding a part of the bitstream to generate a decoded frame, including parsing a plurality of syntax elements from the bitstream. The decoded frame is a projection-based frame that includes a plurality of projection faces packed at a plurality of face positions with different position indexes in a hemisphere cubemap projection layout. A portion of a 360-degree content of a sphere is mapped to the plurality of projection faces via hemisphere cubemap projection. Values of the plurality of syntax elements are indicative of face indexes of the plurality of projection faces packed at the plurality of face positions, respectively, and are constrained to meet a requirement of bitstream conformance.