Extensible NBMP Scheme Signaling for Cloud Media Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP) lacks signaling of processing schemes and extensibility mechanisms, limiting media processing efficiency and scalability.
Innovation Solution
Implementing a method that includes receiving a workflow descriptor document, obtaining tasks and functions from a repository, and managing media processing by signaling schemes through messages, allowing for extensibility by adding new descriptors or parameters, and supporting multiple schemes and extensions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If current NBMP specification is used without scheme signaling, then implementation is simpler, but media processing efficiency and scalability are limited
Solution Approach 1:
The patent segments the NBMP specification by introducing scheme-specific descriptors that can be independently signaled and processed. Different processing schemes (e.g., transcoding, packaging, filtering) are divided into separate descriptor structures, allowing the system to handle only the relevant scheme for each media processing task, thereby improving efficiency without requiring the entire specification to be complex.
Solution Approach 2:
The patent performs preliminary action by defining extensibility mechanisms and scheme signaling structures in advance. The framework pre-establishes descriptor templates, extension points, and inheritance hierarchies that enable future schemes to be added without modifying existing code, thus improving future processing efficiency while maintaining current implementation simplicity.
2Adaptability or versatility
If NBMP lacks extensibility mechanism, then current implementation is more stable, but scalability for large-scale deployment is limited
Solution Approach 1:
The patent implements universality by creating a unified descriptor framework that can accommodate multiple processing schemes through inheritance and extension. The base descriptor structure serves multiple functions across different schemes, while allowing scheme-specific extensions. This enables the system to scale to large deployments with diverse processing requirements without creating separate complex systems for each scheme.
Solution Approach 2:
The patent applies nesting by organizing descriptors in hierarchical structures where general descriptors contain or reference scheme-specific descriptors. The framework allows nested extension where core NBMP descriptors can contain embedded scheme descriptors, enabling compact representation of complex processing workflows and improving scalability without proportionally increasing system complexity.
3Ease of manufacture
If no scheme signaling is implemented, then message structure is simpler, but media service deployment flexibility is reduced
Solution Approach 1:
The patent introduces scheme descriptors as intermediary elements between the core NBMP message structure and scheme-specific processing requirements. These descriptor intermediaries carry scheme identification and configuration information, enabling flexible deployment of different media services without requiring fundamental changes to the message structure. The intermediaries absorb the complexity of scheme variations while maintaining a consistent core message format.
Data Source
AI summary
A method and system for processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP) includes receiving, from an NBMP source, a first message including a workflow descriptor document corresponding to a workflow for processing the media content; obtaining, based on the workflow, a task having a task template; obtaining, based on the task, a function having a function template; and managing the processing of the media content by transmitting, to a media processing entity, a second message instructing the media processing entity to perform the function based on the task. The first message, the workflow descriptor document, the task template, the function template, and/or the second message may be used to signal a scheme for processing the media content.