DASH MPD Indicators for Picture-in-Picture Video Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies lack the ability to efficiently support picture-in-picture services in Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH, specifically lacking indicators for replacing video data units in the target picture-in-picture region with corresponding data units from a supplementary video.
Innovation Solution
Incorporating indicators in the Media Presentation Description (MPD) to signal the purpose of preselection elements for picture-in-picture experiences, allowing replacement of video data units in the target region with supplementary data units, and providing region IDs and position/size information to facilitate seamless integration of supplementary videos within main videos.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video data units in the target picture-in-picture region are replaced by supplementary video data units, then bandwidth utilization is improved and user experience is enhanced, but the complexity of the video coding process increases due to the need for indicators and replacement logic
Solution Approach 1:
The video picture is segmented into a main video region and a picture-in-picture region, allowing independent handling and replacement of video data units in different regions. The preselection element identifies which region should use supplementary video data, enabling selective replacement that improves bandwidth efficiency without affecting the entire video stream.
Solution Approach 2:
The preselection element is included in the Media Presentation Description (MPD) before actual video decoding, providing advance indication of which video data units should be replaced. This preliminary signaling allows the decoding system to prepare replacement logic in advance, reducing runtime complexity while enabling efficient bandwidth utilization.
2Adaptability or versatility
If indicators are added to the preselection element to signal picture-in-picture replacement capability, then the ability to replace video data units is enabled, but the complexity of the media data structure increases
Solution Approach 1:
The preselection element serves multiple functions: it identifies the picture-in-picture region, indicates replacement capability through the @DataUnitsReplaceable attribute, and provides positioning information. By making this single element multi-functional, the patent avoids adding separate indicator structures, thereby limiting the increase in media data structure complexity while enabling versatile picture-in-picture service support.
3Reliability
If separate decoding of main video and supplementary video is performed, then quality and flexibility are improved, but processing time and computational resources increase
Solution Approach 1:
The patent merges the decoding process by allowing the decoder to directly use supplementary video data units for the picture-in-picture region without separately decoding the main video in that region. When the @DataUnitsReplaceable attribute is true, the system replaces main video data units with supplementary video data units, reducing redundant decoding operations while maintaining video quality and flexibility.
Data Source
AI summary
A method of processing media data. The method includes determining, for a conversion between the media data and a media data file, whether a preselection element includes an indicator, wherein the indicator indicates that video data units representing a target picture-in-picture region of a main video are able to be replaced by corresponding video data units of a supplementary video; and performing the conversion between the media data and the media data file based on the indicator. A corresponding video coding apparatus and non-transitory computer-readable recording medium are also disclosed.