ISOBMFF VR Media Track Grouping for 6DOF
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current standards for virtual reality (VR) content storage and delivery, such as the Omnidirectional Media Application Format (OMAF), primarily support 3DOF immersive media experiences, limiting the ability to render different types of VR media that require translational movements beyond 3DOF, and lack efficient mechanisms for presenting VR media beyond omnidirectional formats.
Innovation Solution
The proposed solution involves a method and apparatus that utilize the ISO Base Media File Format (ISOBMFF) to encapsulate coded bitstreams of VR content, incorporating translational coordinates and metadata for dynamic adaptive streaming, enabling support for various VR media types by grouping media tracks and leveraging 3DOF media formats to define formats for 3DOF+, 6DOF, windowed 6DOF, and omnidirectional 6DOF experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If omnidirectional VR content is delivered using current standards (OMAF), then 3DOF immersive media experiences are supported, but the ability to render VR media types requiring translational movements beyond 3DOF is limited
Solution Approach 1:
The patent extends the existing ISOBMFF container format to serve multiple VR media types (3DOF, 3DOF+, 6DOF, windowed 6DOF, omnidirectional 6DOF) through a universal track grouping mechanism. By defining a generic OmnidirectionalMediaPresentationBox structure that can accommodate different degrees of freedom through translational coordinates, the format achieves multi-functionality without requiring separate specialized formats for each VR type.
Solution Approach 2:
The patent segments VR media content into distinct tracks within the ISOBMFF container, each track representing a specific omnidirectional media content with its own OmnidirectionalMediaPresentationBox. This segmentation allows different VR media types to be independently encoded, stored, and delivered while maintaining a unified container structure, resolving the contradiction between versatility and complexity.
2Adaptability or versatility
If multiple VR media types are supported with translational movements, then user interactivity and experience complexity are enhanced, but the bitrate required for representing 360° content increases
Solution Approach 1:
The patent enables partial action by allowing selective activation of different VR media types based on device capabilities and content requirements. The track grouping mechanism with OmnidirectionalMediaPresentationBox allows the system to use only the necessary portion of the available VR content (e.g., 3DOF for basic experiences, 6DOF for advanced experiences), avoiding the need to transmit all possible VR media types at full bitrate simultaneously.
Data Source
AI summary
A video processing method includes receiving at least one virtual reality (VR) content, obtaining at least one picture from the at least one VR content, encoding the at least one picture to generate a part of a coded bitstream, and encapsulating, by a file encapsulation circuit, the part of the coded bitstream into at least one ISO Base Media File Format (ISOBMFF) file. The at least one ISOBMFF file includes a first track parameterized with a first set of translational coordinates, wherein the first set of translational coordinates identifies an origin of a first omnidirectional media content.