Omnidirectional Overlay Timelines for Viewport-Aware VR Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality audiovisual content systems lack a mechanism to support multiple timelines for overlay playback, leading to non-optimal user experiences due to inconsistent interaction handling with overlays that may fall outside the user's field of view, disrupting the creative intent of content creators.
Innovation Solution
A method and apparatus that utilize overlay metadata files to define user interaction capabilities and behaviors, enabling multiple timelines for omnidirectional media playback, allowing customized overlay playback based on whether the overlay overlaps with the user's viewport.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single timeline is used for omnidirectional media playback, then the system complexity is low, but the ability to independently control overlay playback is limited
Solution Approach 1:
The patent divides the playback system into separate timelines: a first timeline for base omnidirectional media content and a second timeline for overlay content. This segmentation allows independent control of overlay playback (pause, continue, skip) without affecting base content, resolving the contradiction between playback control versatility and system complexity.
2Ease of operation
If overlay playback is tied to base content timeline, then synchronization is maintained, but overlay cannot be independently paused or continued when outside viewport
Solution Approach 1:
The patent implements dynamic timeline management where the second timeline (overlay) can independently transition between paused and playing states based on viewport conditions and user interaction, while maintaining synchronization with the first timeline (base content) when needed. This dynamic approach enables flexible overlay control without compromising content synchronization reliability.
3Ease of operation
If overlay continues playing when outside field of view, then content completeness is maintained, but user experience may be degraded
Solution Approach 1:
The patent implements preliminary action by providing user selectable preferences before overlay playback begins. Users can pre-configure whether overlays should pause when outside the viewport or continue playing, allowing them to prioritize either user experience or content completeness based on their preferences. This resolves the contradiction by letting users choose their preferred behavior in advance.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
A method, apparatus and computer program product enable multiple timeline support in playback of omnidirectional media content with overlay. The method, apparatus and computer program product receive a visual overlay configured to be rendered as a multi-layer visual content with an omnidirectional media content file (30). The omnidirectional media content file is associated with a first presentation timeline. The visual overlay is associated with a second presentation timeline. The method, apparatus and computer program product construct an overlay behavior definition file associated with the visual overlay (32). The overlay behavior definition file indicates a behavior of the second presentation timeline with respect to the first presentation in an instance that a pre-defined user interaction switch occurs during a playback of the omnidirectional media content file.