NBMP-FLUS Integration via Application Server Mediator
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently processing and streaming media content across distributed networks, particularly in integrating Moving Picture Experts Group (MPEG) Network-Based Media Processing (NBMP) with Framework for Live Uplink Streaming (FLUS) protocols.
Innovation Solution
A method and apparatus for processing media content in NBMP systems, which involves receiving a live session request, obtaining a list of FLUS sinks, selecting a FLUS media sink, sending a workflow request to start an NBMP workflow associated with the FLUS media sink, and sending session information to establish the FLUS session using the NBMP workflow and FLUS media sink.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If media processing is distributed across multiple devices (application server, sink device, user device), then system reliability and scalability are improved, but device complexity and integration difficulty increase
Solution Approach 1:
The patent introduces an application server as an intermediary component that coordinates between the user device and FLUS sink device. The application server manages workflow requests, session establishment, and capability discovery, thereby simplifying the integration complexity while maintaining distributed processing architecture for improved reliability
Solution Approach 2:
The application server performs multiple functions including receiving live session requests, obtaining FLUS sink lists, selecting appropriate sinks, sending workflow requests to NBMP sources, and managing session information. This multi-functional approach reduces the number of separate components needed while maintaining system reliability
2Productivity
If NBMP and FLUS protocols are integrated for seamless media processing, then processing efficiency is improved, but protocol compatibility and integration complexity increase
Solution Approach 1:
The patent merges NBMP (Network-Based Media Processing) and FLUS (Framework for Live Uplink Streaming) protocols into a unified processing pipeline. The application server coordinates NBMP workflow requests with FLUS session management, enabling seamless integration of cloud-based media processing with live uplink streaming capabilities, thereby improving overall media processing efficiency
Solution Approach 2:
The system performs preliminary capability discovery and workflow setup before actual media processing begins. The application server obtains FLUS sink lists and selects appropriate sinks in advance, and NBMP workflows are prepared beforehand, which streamlines the actual processing operation and improves efficiency
Data Source
AI summary
Systems and methods for media processing and streaming are provided. A method includes receiving, by a first application operating on an application server, a live session request from a second application operating on a user device separate from the application server to start a Framework for Live Uplink Streaming (FLUS) session; obtaining a list of a plurality of FLUS sinks; selecting a FLUS media sink operating on a sink device from among the plurality of FLUS sinks, wherein the sink device is separate from the application server and the user device; sending a workflow request to a Network-Based Media Processing (NBMP) source to start an NBMP workflow associated with the FLUS media sink; and sending a response to the second application including session information for establishing the FLUS session using the NBMP workflow and the FLUS media sink.