VR Viewpoint Signaling via MPD Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual reality (VR) systems face challenges in efficiently signaling and rendering content with multiple viewpoints, leading to suboptimal performance and user experience due to the inability to accurately identify and switch between different viewpoints within immersive media metrics.
Innovation Solution
The implementation of a method that includes transmitting a media presentation description (MPD) file describing multiple viewpoints, allowing client devices and content servers to request and render specific viewpoints, and generating metrics with a viewpoint identifier to improve signaling techniques, enhancing viewport-related immersive media metrics and latency metrics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If VR systems use multiple viewpoints in immersive media content, then the user experience and rendering quality are improved, but the complexity of signaling and identifying specific viewpoints deteriorates
Solution Approach 1:
The patent segments the immersive media content into multiple distinct viewpoints, each with its own identifier. The media presentation description file is divided to include separate viewpoint identifier fields for each video stream, allowing the client device to selectively request and render specific viewpoints based on user orientation, thereby managing complexity through structured segmentation.
Solution Approach 2:
The patent introduces an intermediary media presentation description file that acts as a mediator between the content server and client device. This intermediary structure contains organized viewpoint identifier fields that map video streams to specific viewpoints, simplifying the signaling process by providing a standardized intermediate layer for viewpoint identification and selection.
2Measurement precision
If VR systems render viewports for multiple viewpoints, then the immersive media metrics quality is improved, but the latency in switching between viewpoints increases
Solution Approach 1:
The patent implements preliminary action by having the client device pre-request multiple viewpoint video streams based on the media presentation description file before viewpoint switching is needed. The device maintains buffer queues for multiple viewpoints, so when viewpoint switching occurs, the transition uses pre-loaded data from the buffer, significantly reducing switching latency while maintaining precise immersive media metrics.
3Manufacturing precision
If client devices request and process multiple viewpoint streams, then the viewport rendering quality is improved, but the bandwidth and processing requirements increase
Solution Approach 1:
The patent applies local quality by having the client device request and render only the specific viewpoint streams locally relevant to the user's current orientation and field of view. The device uses viewpoint identifiers to selectively process and render only necessary viewpoint data at high quality, while other viewpoint streams are either not requested or processed at lower priority, optimizing bandwidth usage while maintaining rendering quality for the active viewpoint.
Data Source
AI summary
A method of three hundred and sixty degree) (360°) streaming implemented by a client device. The method includes receiving, by the client device, a media presentation description (MPD) file from a content server, the MPD file describing a media content, the media content comprising a plurality of viewpoints each corresponding to one of a plurality of 360° video camera sets; transmitting, by the client device, a request for a part of the media content based on the MPD file that was received; receiving, by the client device, the part of the media content that was requested; rendering, by the client device, a viewport using the part of the media content that was received, the viewport belonging to one viewpoint from the plurality of viewpoints; and generating, by the client device, a metric containing a viewpoint identifier, the viewpoint identifier identifying the viewpoint that the viewport that was rendered belongs to.