DASH MPD Overlay Priority Signaling for Client Resource Allocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current streaming media technologies, specifically in the context of omnidirectional media transmission, lack the ability for clients to selectively process overlays based on priority and decoding capability, leading to inefficient resource allocation and potential rendering issues.

Innovation Solution

Incorporating priority indication information and decoding capability requirement indication into the DASH MPD file, allowing clients to prioritize and process overlays based on available resources and required capabilities, ensuring efficient processing and rendering of omnidirectional media.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the client processes all overlays without priority indication, then the client can render all overlay content, but the processing resources are allocated inefficiently and rendering issues may occur when resources are insufficient

Engineering Contradiction:
Improveoverlay processing efficiencyVSAvoidrendering reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent introduces priority indication information as a new parameter in the MPD file to specify the priority levels of different overlays. This parameter enables the client to make informed decisions about resource allocation based on overlay importance, resolving the contradiction between processing all overlays and maintaining rendering reliability when resources are constrained.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the client receives multiple overlays without decoding capability requirements, then the client can receive all overlay data, but the client cannot determine which overlays to process based on its own capabilities

Engineering Contradiction:
Improveclient capability adaptationVSAvoidoverlay processing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent implements a feedback mechanism where the server provides decoding capability requirement information in the MPD file, and the client uses this information to adapt its processing strategy. The client compares the required decoding capabilities with its own capabilities to determine which overlays to process, achieving both adaptability and efficiency.

Inventive Principle:
Principle #23Feedback

3Quantity of substance

If the server transmits all overlay data without priority information, then the complete overlay data is available, but the client cannot selectively process overlays based on priority when processing resources are insufficient

Engineering Contradiction:
Improveoverlay data quantityVSAvoidoverlay processing efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The server performs preliminary action by embedding priority indication information directly into the MPD file before transmission. This allows the client to understand the priority structure of overlays in advance and make optimal selection decisions when processing resources are limited, maintaining both data completeness information and processing efficiency.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3860120B1Method for transmitting media data, and client and server
Publication Date: 2023.04.26 HUAWEI TECH CO LTD
  • EP3860120B1 patent drawingFigure 1~2
  • EP3860120B1 patent drawingFigure 3
  • EP3860120B1 patent drawingFigure 4~5

AI summary

This application provides a media data transmission method and apparatus. The method includes: receiving, by a client, a media presentation description MPD file, where the MPD file includes priority indication information, and the priority indication information is used to indicate a priority or priorities of one or more overlays; and processing, by the client, the one or more overlays based on the priority indication information. According to this application, an overlay priority can be signaled in a DASH MPD file, so that the client can select and process an overlay in an overlay priority order.