Dynamic DASH Picture-in-Picture Signaling via MPD Updates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

MPEG DASH lacks explicit signaling for picture-in-picture streaming, and existing methods fail to provide interoperable solutions for dynamic changes in the location, size, and resolution of picture-in-picture media content during streaming sessions.

Innovation Solution

Implement a method and apparatus for dynamically signaling picture-in-picture video using DASH streaming by identifying main and picture-in-picture video streams with role values, merging them as a combined stream, and updating the media presentation descriptor (MPD) to manage location, size, and resolution changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If MPEG DASH standard is used for streaming media content, then interoperability and standardization are improved, but explicit picture-in-picture signaling capability deteriorates

Engineering Contradiction:
ImproveinteroperabilityVSAvoidpicture-in-picture signaling capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent segments the video content into separate main video streams and picture-in-picture video streams, each with distinct role values. This segmentation allows the DASH system to handle multiple video layers independently while maintaining standard interoperability, resolving the contradiction between standardization and PIP signaling capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces role values as intermediary metadata elements within the DASH manifest structure. These role values act as mediators that enable picture-in-picture signaling without modifying the core DASH standard, thus maintaining interoperability while adding PIP functionality

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If picture-in-picture streaming is implemented without explicit DASH extensions, then implementation simplicity is improved, but dynamic updating of location, size, and resolution deteriorates

Engineering Contradiction:
Improveimplementation simplicityVSAvoiddynamic updating capability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic picture-in-picture signaling by allowing role values and preselection descriptors to be updated in real-time within the DASH manifest. This enables location, size, and resolution parameters to change dynamically during streaming sessions while maintaining relatively simple implementation based on existing DASH update mechanisms

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If implicit methods are used for picture-in-picture signaling, then compatibility with existing systems is improved, but interoperability and standardization deteriorates

Engineering Contradiction:
ImprovecompatibilityVSAvoidinteroperability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent creates a universal picture-in-picture signaling mechanism using role values that can be applied across different DASH implementations. The preselection descriptor provides a standardized method that works across systems, ensuring both compatibility with existing DASH infrastructure and improved interoperability through consistent PIP handling

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12381997B2Method and apparatus for dynamic dash picture-in-picture streaming
Publication Date: 2025.08.05 TENCENT AMERICA LLC
  • US12381997B2 patent drawing
  • US12381997B2 patent drawing
  • US12381997B2 patent drawing

AI summary

A method and apparatus may be provided for dynamically signaling picture-in-picture video during media streaming. The method may include determining whether video data comprises a first main video stream and a second picture-in-picture video stream based on a first role value associated with the first main video stream and a second role value associated with the second picture-in-picture video stream; determining a preselection descriptor indicating that the second picture-in-picture video stream is selected to be signaled with the first main video stream in the DASH media streaming; merging the first main video stream with the second picture-in-picture video stream as a combined video stream using the preselection descriptor; and updating the preselection descriptor using an update media presentation descriptor (MPD).