VR Bitstream Switching via Multiple Presentation Timelines
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in seamlessly switching between omnidirectional visual media components in virtual reality, particularly in managing multiple timelines and overlays, which complicates the consumption and rendering of complex content with higher degrees of freedom, leading to uncertainty and inefficiencies in media playback.
Innovation Solution
A method and apparatus for encoding and decoding bitstreams that include indications of multiple presentation timelines and switching modes, allowing seamless switching between visual media components, with options for seamless, zeroth time, offset time, or random-access point transitions, enabling efficient management of omnidirectional media content and overlays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple presentation timelines are used to manage omnidirectional visual media components, then the ability to switch between different visual media components is improved, but the complexity of managing and synchronizing multiple timelines increases
Solution Approach 1:
The patent divides the media presentation into separate presentation timelines, each associated with specific visual media components. This segmentation allows independent management and switching between different components (e.g., background omnidirectional content, foreground overlays, subtitles) without affecting the entire system, thus improving adaptability while maintaining manageable complexity through modular organization.
Solution Approach 2:
The patent introduces a temporal dimension by creating multiple presentation timelines that operate independently. This allows switching between visual media components not just spatially but temporally, enabling complex sequencing and synchronization scenarios. The bitstream syntax adds timeline identification and switching mode parameters that operate in this additional temporal dimension, resolving the contradiction between versatility and complexity.
2Reliability
If switching modes between presentation timelines are implemented, then seamless transitions between media components are achieved, but the bitstream syntax and processing complexity increase
Solution Approach 1:
The patent incorporates switching mode indications directly into the bitstream syntax in advance, before the actual switching occurs. The bitstream contains pre-defined switching mode parameters (e.g., immediate switch, fade transition, overlay switch) that guide the decoder on how to perform transitions. This preliminary encoding of switching instructions simplifies real-time processing while ensuring reliable seamless transitions, as the complexity is resolved during encoding rather than decoding.
3Adaptability or versatility
If omnidirectional visual media content with multiple components is used, then the immersive experience in virtual reality is improved, but the difficulty of rendering and playback management increases
Solution Approach 1:
The patent introduces presentation timelines as an intermediary layer between the omnidirectional visual media components and the rendering system. Each visual media component (omnidirectional content, overlays, subtitles) is associated with a specific presentation timeline, which acts as a mediator that coordinates their playback and switching. This intermediary structure simplifies rendering management by providing a clear temporal framework, reducing the difficulty of managing complex multi-component immersive content.
Data Source
AI summary
A method includes generating a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline and a second presentation timeline; and indicating in the bitstream a switching mode with respect to the first presentation timeline associated with the first visual media component, or with respect to the second presentation timeline associated with the second visual media component, the switching mode being indicated dependent on a viewpoint of a user; wherein the switching mode provides an indication of switching to the first visual media component or to the second visual media component, the first visual media component corresponding to content captured from a first omnidirectional camera in a first location, and the second visual media component corresponding to content captured from a second omnidirectional camera in a second location.