ISOBMFF Transform Property Items for VR Viewport Roll Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The lack of standardization in virtual reality (VR) content storage and delivery formats leads to interoperability issues and high bitrate requirements for omnidirectional VR content, making it challenging to efficiently deliver immersive 360° content.
Innovation Solution
A method and apparatus for deriving VR projection, packing, ROI, and viewport-related tracks in the ISO Base Media File Format (ISOBMFF) that supports viewport roll signaling, enabling efficient encoding, encapsulation, and rendering of VR content by using transform property items to instruct track derivation and include parameters for yaw, pitch, and roll angles of the viewport.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If omnidirectional VR content is delivered to provide immersive visual experiences, then the visual immersion quality is improved, but the bitrate requirement increases significantly
Solution Approach 1:
The patent segments the omnidirectional VR content into multiple spherical segments or regions, allowing selective encoding and transmission of only the visible viewport region rather than the entire 360° content. This segmentation enables delivering immersive VR experiences at lower bitrates by focusing computational and transmission resources on the relevant visual field only.
Solution Approach 2:
The patent applies local quality enhancement by encoding the viewport region (the area currently visible to the user) at high quality while using lower quality or predictive methods for regions outside the viewport. This approach maintains visual immersion quality where needed while reducing overall bitrate requirements for the complete omnidirectional content.
2Adaptability or versatility
If standardized storage and delivery formats are implemented, then interoperability is improved, but the complexity of the standardization process increases
Solution Approach 1:
The patent implements a universal file format structure based on existing standardized containers (such as MP4 or ISOBMFF) that can accommodate multiple VR content types, projections, and resolutions. This universal structure improves interoperability across different devices and platforms while avoiding the complexity of creating entirely new standardized formats, as it leverages existing widely-supported container specifications.
Solution Approach 2:
The patent introduces standardized metadata structures and transformation matrices as intermediaries that enable different VR content formats to be converted and interpreted within a unified framework. These intermediary elements facilitate interoperability by providing a common language for describing viewport transformations, projection types, and spatial relationships without requiring complete standardization of all underlying content formats.
3Adaptability or versatility
If transform property items are added to instruct track derivation, then the VR content rendering flexibility is improved, but the metadata complexity increases
Solution Approach 1:
The patent uses transform property items that modify existing metadata parameters rather than introducing entirely new complex structures. By changing or extending parameters such as transformation matrices, projection types, and viewport definitions within the existing track metadata framework, the patent achieves enhanced VR rendering flexibility while keeping metadata complexity manageable through parameter-based extensions rather than structural overhauls.
Data Source
AI summary
A video processing method includes receiving a virtual reality (VR) content, obtaining a picture from the VR content, encoding the picture to generate a part of a coded bitstream, and encapsulating the part of the coded bitstream into ISO Base Media File Format (ISOBMFF) file(s). In one exemplary implementation, the ISOBMFF file(s) may include a transform property item that is set to enable at least one of a projection transformation, a packing transformation, a VR viewport selection, and a VR region of interest (ROI) selection in track derivation. In another exemplary implementation, the ISOBMFF file(s) may include a first parameter, a second parameter, and a third parameter associated with orientation of a viewport, with the first, second and third parameters indicating a yaw angle, a pitch angle and a roll angle of a center of the viewport, respectively. Further, an associated video processing apparatus is provided.