Projection-Based Spatial Relationship Description for 360-Degree Video Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face challenges in efficiently rendering three-dimensional environments for virtual reality and 360-degree video content, particularly in describing and managing spatial relationships and dependencies between different video segments effectively.
Innovation Solution
The proposed solution involves an apparatus and method that use a projection-based spatial relationship description (SRD) to describe video content projected from a sphere surface onto a 2D plane, allowing for the determination and selection of segment streams based on regions of interest, and the extraction of dependencies between segments, enabling efficient image generation and display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video content of a sphere surface is projected onto a 2D plane and divided into multiple segment streams with different video coverage, then the adaptability to different viewing regions and bandwidth conditions is improved, but the complexity of describing and managing spatial relationships and dependencies between segments increases
Solution Approach 1:
The video content of the sphere surface is divided into multiple segment streams with different video coverage areas. Each segment stream covers a specific region of the 2D plane, allowing the system to adapt to different viewing regions and bandwidth conditions by selecting and transmitting only the relevant segments rather than the entire video content.
Solution Approach 2:
A media presentation description file is introduced as an intermediary data structure that describes the spatial relationships and dependencies between different segment streams. This file contains information about video coverage areas, projection types, and segment dependencies, enabling the system to manage the complexity of spatial relationships without increasing the complexity of the video coding itself.
2Measurement precision
If projection based spatial relationship description is used to describe video coverage in the 2D plane, then the precision of spatial relationship description is improved, but the quantity of description data increases
Solution Approach 1:
The spatial relationship description is tailored to the specific projection type being used. Different projection types (equirectangular, cubic, etc.) have different coordinate systems and spatial relationships, so the description format is optimized for each projection type rather than using a universal format. This reduces the quantity of description data while maintaining precision for each specific case.
Solution Approach 2:
The system changes parameters in the description data based on the projection type. For example, equirectangular projection uses latitude and longitude parameters, while cubic projection uses face and UV coordinate parameters. This parameter adaptation allows precise description of spatial relationships in each projection type without generating excessive description data.
3Speed
If segment streams with different video coverage are transmitted to support dynamic adaptive streaming, then the responsiveness to client requirements is improved, but the complexity of segment selection and request management increases
Solution Approach 1:
The media presentation description file is prepared in advance with complete information about all segment streams, including their video coverage areas, projection types, and dependency relationships. This preliminary organization of data allows the client to quickly determine which segments to request based on current viewing requirements without having to perform complex analysis in real-time.
Solution Approach 2:
The system uses the spatial relationship description to enable feedback-based segment selection. The client determines its current region of interest and uses the description data to identify which segment streams contain the required content, then requests only those segments. This feedback loop between client requirements and segment selection improves responsiveness while the structured description data keeps the selection process manageable.
Data Source
AI summary
Aspects of the disclosure provide an apparatus having an interface circuit, a processing circuit, and a display device. The interface circuit is configured to receive media presentation description information of media data. The media data includes video content on a two-dimensional (2D) plane that is projected from video content of a sphere surface. The video content on the 2D plane includes a plurality of segment streams having different coverages on the 2D plane. The media presentation description information uses projection based spatial relationship description (P-SRD) to describe the different coverages of the video content on the 2D plane according to the projection. The processing circuit is configured to determine one or more segment streams based on a region of interests for image generation and the P-SRD, select segments in the one or more segment streams, and cause the interface circuit to request and receive the selected segments.