Preselection Signaling for DASH Picture-in-Picture Video Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies lack the necessary indicators and signaling mechanisms to support picture-in-picture services effectively in Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH, particularly in the context of Versatile Video Coding (VVC) standards, which hinders efficient overlaying and replacement of video data units for supplementary videos within main videos.
Innovation Solution
Incorporating indicators in the preselection element of the Media Presentation Description (MPD) to signal the purpose of providing a picture-in-picture experience, allowing replacement of coded video data units, specifying region IDs, and providing position and size information to facilitate seamless integration of supplementary videos within main videos.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional video coding techniques are used without indicators in preselection elements, then the video coding process is simpler, but picture-in-picture services cannot be effectively supported and supplementary videos cannot be properly overlayed on main videos
Solution Approach 1:
The patent applies preliminary action by adding indicator attributes to preselection elements before video processing occurs. These indicators (such as @tag or @value attributes) are pre-configured to signal picture-in-picture purposes, enabling the video coding process to automatically identify and handle supplementary video regions without requiring complex post-processing analysis or interpretation of video content.
2Adaptability or versatility
If indicators are added to preselection elements to signal picture-in-picture purpose, then picture-in-picture services are enabled, but the structure of the Media Presentation Description (MPD) becomes more complex
Solution Approach 1:
The patent applies universality by designing indicator attributes that can be integrated into existing MPD preselection elements without creating entirely new structural components. The @tag or @value attributes serve multiple functions: they identify picture-in-picture purposes, specify replacement capabilities, and maintain compatibility with existing DASH streaming infrastructure, thereby avoiding the need for complex new structural frameworks.
3Ease of operation
If video data units are replaced to enable picture-in-picture, then seamless integration is achieved, but the decoding and processing requirements increase
Solution Approach 1:
The patent applies feedback by using indicator attributes in preselection elements to provide advance information about video data unit replacement requirements. This feedback mechanism allows decoding systems to pre-configure their processing parameters based on the indicated picture-in-picture purpose, reducing the complexity of real-time decoding and processing by eliminating the need for complex analysis and adaptation during video playback.
Data Source
AI summary
A method of processing media data. The method includes determining, for a conversion between the media data and a media data file, that a preselection element includes an indicator, wherein the indicator indicates that a purpose of the preselection element is for providing a picture-in-picture experience where a supplementary video appears to be overlaid on a target picture-in-picture region in a main video; and performing a conversion between the media data and the media data file based on the indicator. A corresponding video coding apparatus and non-transitory computer-readable recording medium are also disclosed.