Spherical Region Presentation for VR Viewport Adaptability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding techniques for virtual reality (VR) viewport experiences are inefficient as they process and deliver the entire spherical content, which is compute-intensive and bandwidth-heavy, especially when users only need to view a portion of the content, leading to suboptimal user experiences with limited resources.
Innovation Solution
The method involves specifying spherical regions by grouping relevant media and metadata tracks, allowing for viewport-dependent processing and delivery, including metadata for transition effects between regions, to enhance the user experience by only processing and delivering the content relevant to the user's viewport.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the entire spherical content is processed and delivered, then the user can view content at any viewport, but the computational burden and bandwidth consumption increase significantly
Solution Approach 1:
The patent divides the spherical content into multiple spherical regions (e.g., northern hemisphere, southern hemisphere, eastern hemisphere, western hemisphere). Each region can be independently processed, encoded, and delivered. This segmentation allows the system to only process and deliver the specific region corresponding to the user's current viewport, rather than processing the entire sphere, thereby reducing computational burden while maintaining viewport flexibility.
Solution Approach 2:
The patent extracts only the necessary portion of spherical content that corresponds to the user's current viewport. By identifying the user's viewing direction and extracting only the relevant spherical region, the system avoids processing and delivering unnecessary content, thus reducing both computational resources and bandwidth consumption while still providing the desired viewport experience.
2Reliability
If the entire spherical content is delivered, then complete viewport coverage is ensured, but network bandwidth consumption increases
Solution Approach 1:
The spherical content is segmented into multiple independent regions that can be selectively delivered. The system determines which segment corresponds to the user's current viewport and delivers only that segment, ensuring complete coverage of the viewed area while minimizing bandwidth consumption by excluding unrelated regions.
Solution Approach 2:
Instead of delivering the complete spherical content (excessive action), the system delivers only the partial content that is necessary for the current viewport. This partial action approach ensures sufficient viewport coverage without the waste of transmitting unnecessary data, thereby reducing bandwidth consumption.
3Loss of energy
If viewport-dependent processing is implemented, then bandwidth efficiency improves, but system complexity increases due to region grouping and metadata management
Solution Approach 1:
The patent merges multiple related media tracks (video, audio, metadata) into unified spherical region presentations. By grouping together all tracks that belong to the same spherical region, the system simplifies the management of viewport-dependent content while maintaining bandwidth efficiency. This merging approach reduces the complexity of handling individual tracks separately while still enabling selective delivery.
Solution Approach 2:
The spherical region presentation structure serves multiple functions: it organizes video content, associates related audio and metadata, and enables viewport-dependent delivery. This multi-functional approach reduces system complexity by using a single unified structure rather than separate management systems for each function.
Data Source
AI summary
The techniques described herein relate to methods, apparatus, and computer readable media configured to process (e.g., encode and/or decode) multimedia data that includes a representation of a multimedia experience associated with at least one spherical region. At least one video portion of the multimedia data and at least one additional multimedia portion of the multimedia data are associated with the spherical region. The multimedia data, at least one video portion, and at least one additional multimedia portion present the multimedia experience associated with the spherical region.