DASH PiP Stream Signaling for Dynamic Overlay Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
MPEG DASH lacks explicit and interoperable methods for picture-in-picture signaling, failing to support dynamic changes in location and resolution of PiP video content during streaming sessions.
Innovation Solution
Implement extensions to the DASH standard by introducing new role values and descriptors, such as 'picture-in-picture' and 'replacementRules', to signal and manage the relationship between main and overlay video streams, enabling dynamic changes in location and resolution of PiP content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If MPEG DASH standard is used for streaming media content, then standard compliance and interoperability are achieved, but explicit picture-in-picture signaling capability is lost
Solution Approach 1:
The patent segments the video content into main video streams and overlay video streams, each independently encoded and transmitted through separate adaptation sets in the DASH manifest. This segmentation allows the main video and PiP content to be delivered as distinct entities that can be independently controlled and dynamically switched, enabling PiP functionality while maintaining DASH standard compliance.
Solution Approach 2:
The patent introduces an intermediary mechanism in the form of extended DASH manifest descriptors and role attributes that mediate between the standard DASH protocol and PiP signaling requirements. These intermediaries add metadata layers that enable PiP functionality without altering the core DASH streaming mechanism, thus maintaining compatibility while adding versatility.
2Adaptability or versatility
If dynamic changes in location and resolution of PiP content are supported, then adaptability and user experience are improved, but system complexity increases
Solution Approach 1:
The patent implements dynamic control of PiP content by enabling real-time changes in location, resolution, and visibility through DASH manifest updates. The system allows the overlay video stream to be dynamically switched, resized, and repositioned during playback by modifying adaptation set parameters and selection criteria in the manifest, without requiring system redesign or complex hardware changes.
Solution Approach 2:
The patent utilizes parameter changes in the DASH manifest, specifically through role attributes and adaptation set configurations, to control PiP behavior. By modifying parameters such as role values ('main', 'alternative', 'overlay'), resolution descriptors, and selection attributes, the system achieves dynamic PiP control through standardized parameter manipulation rather than complex proprietary signaling.
3Adaptability or versatility
If explicit extensions to DASH standard are introduced for PiP signaling, then PiP functionality is enabled, but standard interoperability may be affected
Solution Approach 1:
The patent achieves universality by designing the PiP signaling mechanism to work within the existing DASH framework using standardized elements with extended semantics. The role attributes, adaptation sets, and manifest structures used for PiP signaling are compatible with standard DASH processing, allowing the same infrastructure to serve both traditional streaming and PiP functionality without creating proprietary silos.
Solution Approach 2:
The patent employs copying of standard DASH structures and metadata formats to create PiP-specific signaling elements. By replicating and adapting existing DASH manifest components rather than inventing entirely new protocols, the system ensures that PiP signaling follows the same interoperable patterns as standard DASH, facilitating broad compatibility while enabling advanced functionality.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method and apparatus may be provided for dynamically signaling picture-in-picture video during media streaming. The method may include determining whether video data comprises a first main video stream and a second picture-in-picture video stream based on a first role value associated with the first main video stream and a second role value associated with the second picture-in-picture video stream; determining a preselection descriptor indicating that the second picture-in-picture video stream is selected to be signaled with the first main video stream in the DASH media streaming; merging the first main video stream with the second picture-in-picture video stream as a combined video stream using the preselection descriptor; and updating the preselection descriptor using an update media presentation descriptor (MPD).