Network based media processing, nbmp, workflow management controlled by 5g real-time uplink streaming, flus

Abstract

The present application provides a method, computer program and computer system for establishing a network-based media processing (NBMP) workflow through 5G real-time uplink streaming framework (FLUS) control. A plurality of sink and network capabilities of a network platform are discovered through a plurality of 5G FLUS discovery and capability mechanisms. An NBMP workflow is created, updated, retrieved and deleted through a control interface including a FLUS source and a FLUS sink, whereby the 5G FLUS control is extended to support tunnel information between an NBMP source and an NBMP workflow manager.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 001,946, filed March 30, 2020, and U.S. Patent Application No. 17 / 034,778, filed September 28, 2020, both of which are incorporated herein by reference. Technical Field

[0003] This application generally relates to the field of data processing, and more specifically to media processing. Background Technology

[0004] The development of the Network-based Media Processing (NBMP) standard aims to address fragmentation issues and provide a unified approach to performing media processing on any cloud platform and any IP network. The 3rd Generation Partnership Project (3GPP) Framework for Live Uplink Streaming (FLUS) protocol provides a mechanism for uplink streaming multimedia content from a source device to a network and sending / distributing that content to one or more destinations. Summary of the Invention

[0005] The embodiments relate to a method, system, and computer-readable medium for establishing an NBMP workflow via 5G FLUS control. According to one aspect, this application provides a method for establishing an NBMP workflow via 5G FLUS control. The method may include: discovering multiple sinks and network capabilities of a network platform through multiple 5G FLUS discovery and capability mechanisms; and creating, updating, retrieving, and deleting NBMP workflows through a FLUS source-sink control interface, whereby the 5G FLUS control is extended to support tunnel information between the NBMP source and the NBMP workflow manager.

[0006] According to another aspect, this application provides a computer system for establishing NBMP workflows via 5G FLUS control. The computer system may include one or more processors, one or more computer-readable storage devices, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices. These program instructions are executed by at least one of the one or more processors via at least one of the one or more memories, thereby enabling the computer system to perform a method. The method may include: discovering multiple receivers and network capabilities of a network platform through multiple FLUS discovery and capability mechanisms; and creating, updating, retrieving, and deleting NBMP workflows through a FLUS source-receiver control interface, whereby FLUS control is extended to support tunneling information between an NBMP source and an NBMP workflow manager.

[0007] According to another aspect, this application provides a computer-readable medium for establishing NBMP workflows via 5G FLUS control. The computer-readable medium may include one or more computer-readable storage devices and program instructions stored on at least one of the one or more tangible storage devices, the program instructions being executable by a processor. The program instructions, executable by the processor, are used to perform a method that accordingly may include: discovering multiple receivers and network capabilities of a network platform through multiple FLUS discovery and capability mechanisms; and creating, updating, retrieving, and deleting NBMP workflows through a FLUS source-receiver control interface, thereby extending 5G FLUS control to support tunnel information between an NBMP source and an NBMP workflow manager. Attached Figure Description

[0008] These and other objects, features, and advantages will become apparent from the following detailed description of illustrative embodiments, which is taken in conjunction with the accompanying drawings. The various features in the drawings are not drawn to scale so that the illustrations are clear enough for those skilled in the art to understand them in conjunction with the detailed description. In the drawings:

[0009] Figure 1 A networked computer environment according to at least one embodiment is shown;

[0010] Figure 2 It is a block diagram of a system for establishing an NBMP workflow via 5G FLUS control according to at least one embodiment;

[0011] Figure 3 This is an operational flowchart illustrating the steps performed by a program for establishing an NBMP workflow via 5G FLUS control, according to at least one embodiment.

[0012] Figure 4 According to at least one embodiment Figure 1A block diagram depicting the internal and external components of a computer and server;

[0013] Figure 5 It includes, according to at least one embodiment Figure 1 A block diagram illustrating a cloud computing environment for a computer system; and

[0014] Figure 6 According to at least one embodiment Figure 5 A block diagram illustrating the functional layers of an illustrative cloud computing environment. Detailed Implementation

[0015] This document discloses detailed embodiments of the claimed structures and methods; however, it is to be understood that the disclosed embodiments are merely illustrative of the claimed structures and methods, which can be implemented in various forms. These structures and methods can be implemented in many different forms and should not be construed as limited to the exemplary embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete and fully convey the scope to those skilled in the art. Details of well-known features and techniques may be omitted in the description to avoid unnecessarily obscuring the presented embodiments.

[0016] The embodiments generally relate to the field of data processing, and more specifically to media processing. The exemplary embodiments described below provide a system, method, and computer program, particularly providing a mechanism for NBMP sources to fully control an NBMP workflow manager via a FLUS control path. Therefore, some embodiments have the ability to improve the computing domain by providing an architecture in which the source client is an NBMP source to manage workflows via a FLUS control interface.

[0017] As previously described, the development of Network-Based Media Processing (NBMP) standards addresses fragmentation issues and provides a unified approach to performing media processing on any cloud platform and any IP network. The 3GPP Real-Time Uplink Streaming Framework (FLUS) protocol provides a mechanism for uplink streaming multimedia content from a source device to a network and sending / distributing that content to one or more destinations. In the NBMP standard, an NBMP source can be an entity that provides a workflow description to a workflow manager to create, run, manage, and monitor media workflows. Interaction between the NBMP source and the workflow manager is facilitated through a set of NBMP operational application programming interfaces (APIs). In the case of the 3GPP FLUS protocol, the source device of a media stream establishes an uplink session with the sink over the network. The FLUS API allows the source device to control the session and also allows the sink to provide feedback or remote control to the source device. The 3GPP FLUS protocol supports including an NBMP Workflow Description Document (WDD) as part of session control updates performed by the source device. However, this protocol may not include interactions between the source device and the receiving end for managing the NBMP workflow after the workflow is established. Furthermore, the protocol may not provide an architecture for the NBMP workflow manager or tasks that provides reports and notifications to the source device, enabling the source device to receive feedback from the running NBMP workflow to dynamically manage and modify the workflow. Therefore, it may be advantageous to provide a mechanism that allows the NBMP source to have complete control over the NBMP workflow manager via the FLUS control path by using cloud-based workflow processing for uplink streaming, where control occurs at the client device acting as the uplink source. This could provide an architecture where the source client is the NBMP source to manage workflows via the FLUS control interface.

[0018] In this document, aspects are described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer-readable media according to various embodiments. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0019] The exemplary embodiments described below provide a system, method, and computer program that allow the establishment of NBMP workflows via 5G FLUS control. Reference is now made to... Figure 1The functional block diagram of the networked computer environment illustrates a media processing system 100 (hereinafter referred to as the "System") for establishing an NBMP workflow via 5GFLUS control. It should be understood that... Figure 1 This is merely an illustration of one implementation and does not imply any limitation on the environments in which different embodiments may be implemented. Many modifications can be made to the depicted environment based on design and implementation requirements.

[0020] System 100 may include computer 102 and server computer 114. Computer 102 may communicate with server computer 114 via communication network 110 (hereinafter referred to as the "network"). Computer 102 may include processor 104 and software program 108 stored on data storage device 106, and computer 102 is capable of interacting with a user and communicating with server computer 114. Reference will be made below. Figure 4 As discussed, computer 102 may accordingly include internal component 800A and external component 900A, and server computer 114 may accordingly include internal component 800B and external component 900B. Computer 102 may be, for example, a mobile device, telephone, personal digital assistant, netbook, laptop computer, tablet computer, desktop computer, or any type of computing device capable of running programs, accessing networks, and accessing databases.

[0021] See below for reference. Figure 5 and Figure 6 The server computer 114 can also operate in a cloud computing service model, such as Software as a Service (SaaS), Platform as a Service (PaaS), or Infrastructure as a Service (IaaS). The server computer 114 can also reside in a cloud computing deployment model, such as a private cloud, community cloud, public cloud, or hybrid cloud.

[0022] Server computer 114 can be used to establish NBMP workflows via 5G FLUS control and is capable of running NBMP FLUS control program 116 (hereinafter referred to as the "program") that can interact with database 112. The following is in conjunction with... Figure 3The NBMP FLUS control program method is described in more detail below. In one embodiment, computer 102 may operate as an input device including a user interface, while program 116 may run primarily on server computer 114. In an alternative embodiment, program 116 may run primarily on one or more computers 102, while server computer 114 may be used to process and store data used by program 116. It should be noted that program 116 may be a standalone program or may be integrated into a larger NBMP FLUS control program.

[0023] However, it should be noted that in some instances, the processing of program 116 can be shared between computer 102 and server computer 114 in any proportion. In another embodiment, program 116 can run on more than one computer, server computer, or some combination of computers and server computers, for example, on multiple computers 102 communicating with a single server computer 114 via network 110. In another embodiment, for example, program 116 can run on multiple server computers 114 communicating with multiple client computers via network 110. Alternatively, the program can run on a network server communicating with a server and multiple client computers via a network.

[0024] Network 110 may include wired connections, wireless connections, fiber optic connections, or some combination of these connections. Typically, network 110 may be any combination of connections and protocols that support communication between computer 102 and server computer 114. Network 110 may include various types of networks, such as local area networks (LANs), wide area networks (WANs) such as the Internet, telecommunications networks such as public switched telephone networks (PSTNs), wireless networks, public switched networks, satellite networks, cellular networks (e.g., fifth-generation (5G), long-term evolution (LTE), third-generation (3G), code division multiple access (CDMA), etc.), public land mobile networks (PLMNs), metropolitan area networks (MANs), private networks, self-organizing networks, intranets, fiber optic-based networks, etc., and / or combinations of these networks or other types of networks.

[0025] Figure 1The number and arrangement of devices and networks shown are provided as examples. In practice, there may be more. Figure 1 The devices and / or networks shown may be more devices and / or networks, fewer devices and / or networks, different devices and / or networks, or related to... Figure 1 The devices and / or networks shown are arranged differently. Furthermore, Figure 1 The two or more devices shown can be implemented within a single device, or Figure 1 The single device shown can be implemented as multiple distributed devices. Additionally or alternatively, a group of devices in system 100 (e.g., one or more devices) can perform one or more functions described as being performed by another group of devices in system 100.

[0026] Now for reference Figure 2 A block diagram of the 3GPP FLUS architecture 200 is depicted. The 3GPP FLUS architecture 200 may include a first user environment 202 and a second user environment 204. The first user environment 202 may include an NBMP source 205, one or more acquisition devices 206, and a FLUS source 208. The FLUS source 208 may include a control source 210, a media source 212, an auxiliary receiver 214, and a remote control target 216. The second user environment 204 may include a FLUS receiver 218, an NBMP workflow manager 219, an auxiliary transmitter 220, an NBMP workflow 221, and a remote controller 222. The FLUS receiver 218 may include a control receiver 224 and a media receiver 226.

[0027] NBMP source 205 can define workflow processing at a network or destination device (i.e., second user environment 204). NBMP workflow manager 219 and NBMP workflow 221 can reside on the network or destination device (i.e., second user environment 204). NBMP workflow 221 can include several stages. In stage 1 (receiver discovery), NBMP source 205 can discover existing receivers by issuing a request to FLUS source 208, which can then be sent to the FLUS discovery point. The FLUS discovery point can provide a list of receivers to FLUS source 208, and thus FLUS source 208 can provide a list of receivers to NBMP source 205.

[0028] In Phase 2 (Capability Discovery), NBMP source 205 may request capabilities from one of the receivers provided in the list of receivers. FLUS source 208 may pass this request to FLUS receiver 218. FLUS receiver 218 may have the capabilities of its platform, or may request the current platform capabilities from NBMP workflow manager 219. It is understood that the platform's capabilities may change depending on the currently running workflow. A description of the platform's capabilities or a link to the platform may be returned to NBMP source 205 via FLUS receiver 218 and FLUS source 208. The Phase 2 response may include: an NBMP scheme identifier, a URL (URI) for the location, and a capability description document describing the platform's capabilities. The NBMP scheme identifier indicates that the workflow manager supports NBMP, and that the platform's capabilities can be retrieved from the URL (URI) for the location.

[0029] In Phase 3 (Workflow Creation), NBMP source 205 may request the creation of NBMP workflow 221 via FLUS source 208 and FLUS receiver 218. Since NBMP workflow 221 can be created immediately, rejected, or created with a possible delay during Phase 3, the Phase 3 response may include: HTTP response code 201 and WDD, or HTTP response code 4xx or 5xx and optionally include WDD, or HTTP response code 202 and an HTTP header followed by a Retry-After value.

[0030] Now for reference Figure 3 The operation flowchart 300 is depicted, which shows the steps performed by the program used to establish an NBMP workflow via 5G FLUS control. Figure 3 It is possible Figure 1 and Figure 2 This is described with the help of [unclear]. As previously described, NBMP FLUS control program 116 ( Figure 1 It can provide an architecture in which the source client is an NBMP source to manage workflows through the FLUS control interface.

[0031] In a 302 response, multiple receivers and network capabilities of the network platform are discovered through various FLUS discovery and capability mechanisms. Network capabilities can be described by identifiers and URL locations; the description of a network capability can be retrieved from the URL location, or the network capability can be explicitly included in the discovery response. During operation, NBMP source 205 ( Figure 2 ) can be achieved by sending data to FLUS source 208 ( Figure 2 It sends a request to discover existing receivers. The list of receivers can be returned to NBMP source 205.

[0032] At 304, NBMP workflows are created, updated, retrieved, and deleted via control interfaces including the FLUS source and FLUS receiver. 5G FLUS control is extended to support tunnel information between the NBMP source and the NBMP workflow manager. During operation, NBMP source 205 ( Figure 2 ) can request access via FLUS source 208 ( Figure 2 ) and FLUS receiver 218 ( Figure 2 Creating NBMP Workflow 221 Figure 2 When creating NBMP workflow 221, an HTTP status code and WDD can be returned.

[0033] Understandable. Figure 3 The illustrations are provided merely to illustrate one implementation and do not imply any limitation on how different embodiments can be implemented. Many modifications can be made to the depicted environment based on design and implementation requirements.

[0034] Figure 4 According to the illustrative embodiments Figure 1 Block diagram 400 depicts the internal and external components of a computer. It should be understood that... Figure 4 This is merely an illustration of one implementation and does not imply any limitation on the environments in which different embodiments may be implemented. Many modifications can be made to the depicted environment based on design and implementation requirements.

[0035] Computer 102 ( Figure 1 ) and server computer 114 ( Figure 1 ) may include, for example Figure 4 The corresponding sets of internal components 800A, 800B and external components 900A, 900B are shown. Each set of internal components 800 includes one or more processors 820, one or more computer-readable RAMs 822 and one or more computer-readable ROMs 824, one or more operating systems 828 and one or more computer-readable tangible storage devices 830, all located on one or more buses 826.

[0036] Processor 820 is implemented in hardware, firmware, or a combination of hardware and software. Processor 820 is a central processing unit (CPU), graphics processing unit (GPU), accelerated processing unit (APU), microprocessor, microcontroller, digital signal processor (DSP), field-programmable gate array (FPGA), application-specific integrated circuit (ASIC), or other type of processing component. In some implementations, processor 820 includes one or more processors that can be programmed to perform functions. Bus 826 includes components that allow communication between internal components 800A and 800B.

[0037] One or more operating systems 828, software programs 108 ( Figure 1 ) and located on server computer 114 ( Figure 1 NBMP FLUS control program 116 on ) Figure 1 The data is stored in one or more of the corresponding computer-readable tangible storage devices 830, and is executed by one or more of the corresponding processors 820 via one or more of the corresponding RAMs 822 (typically including cache). Figure 4 In the illustrated embodiment, each computer-readable tangible storage device 830 is a disk storage device of an internal hard disk drive. Alternatively, each computer-readable tangible storage device 830 is a semiconductor storage device, such as a ROM 824, EPROM, flash memory, optical disc, magneto-optical disc, solid-state drive, compact disc (CD), digital universal disc (DVD), floppy disk, cassette tape, magnetic tape, and / or other types of non-transitory computer-readable tangible storage devices capable of storing computer programs and digital information.

[0038] Each set of internal components 800A, 800B also includes an R / W drive or interface 832 for reading from and writing to one or more portable computer-readable physical storage devices 936 (e.g., CD-ROM, DVD, Memory Stick, magnetic tape, disk, optical disc, or semiconductor storage device). Such as software program 108 ( Figure 1 ) and NBMP FLUS control program 116 ( Figure 1 The software program can be stored on one or more of the corresponding portable computer-readable tangible storage devices 936, and read and loaded into the corresponding hard disk drive 830 via the corresponding R / W drive or interface 832.

[0039] Each set of internal components 800A, 800B also includes a network adapter or interface 836 (e.g., a TCP / IP adapter card); a wireless Wi-Fi interface card; or a 3G, 4G, or 5G wireless interface card or other wired or wireless communication links. Software program 108 ( Figure 1 ) and server computer 114 ( Figure 1 NBMP FLUS control program 116 on ) Figure 1 ) can be downloaded from an external computer to computer 102 via a network (e.g., the Internet, a local area network, or other wide area networks) and a corresponding network adapter or interface 836. Figure 1 The network includes a network adapter or interface 836 and a server computer 114. Software program 108 and NBMP FLUS control program 116 on server computer 114 are loaded into the corresponding hard disk drive 830. The network may include copper wire, fiber optic, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers.

[0040] Each set of external components 900A, 900B may include a computer monitor 920, a keyboard 930, and a computer mouse 934. External components 900A, 900B may also include a touchscreen, virtual keyboard, touchpad, pointing device, and other human-machine interface devices. Each set of internal components 800A, 800B also includes a device driver 840 for interfacing with the computer monitor 920, keyboard 930, and computer mouse 934. Device driver 840, R / W driver or interface 832, and network adapter or interface 836 include hardware and software (stored in storage device 830 and / or ROM 824).

[0041] It should be understood beforehand that while this disclosure includes a detailed description of cloud computing, the implementation of the teachings recorded herein is not limited to cloud computing environments. Rather, some embodiments can be implemented in conjunction with any other type of computing environment now known or developed later.

[0042] Cloud computing is a service delivery model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, network bandwidth, servers, processing, storage, applications, virtual machines, and services) that can be rapidly provisioned and released with minimal management effort or through interaction with a service provider. This cloud model may include at least five features, at least three service models, and at least four deployment models.

[0043] The characteristics are as follows:

[0044] On-demand self-service: Cloud consumers can automatically and unilaterally provide computing power (such as server time and network storage) as needed, without the need for manual interaction with service providers.

[0045] Extensive network access: Capabilities can be obtained through the network and accessed through standard mechanisms that facilitate use by heterogeneous thin client platforms or thick client platforms (e.g., mobile phones, laptops, and PDAs).

[0046] Resource pooling: Pooling a provider's computing resources to serve multiple consumers using a multi-tenant model, where different physical and virtual resources are dynamically allocated and reallocated based on demand. There is a sense of location independence because consumers typically cannot control or know the exact location of the resources provided, but can specify the location at a higher level of abstraction (e.g., country, state, or data center).

[0047] Rapid elasticity: Capacity can be provided quickly and flexibly (in some cases automatically) to rapidly expand outward and rapidly contract inward. For consumers, the capacity available for supply often appears unlimited and can be purchased at any time and in any quantity.

[0048] Measuring services: Cloud systems automatically control and optimize resource usage by leveraging metering capabilities at a level of abstraction appropriate to the service type (e.g., storage, processing, bandwidth, and active user accounts). Resource usage can be detected, controlled, and reported, providing transparency to both service providers and consumers.

[0049] The service model is as follows:

[0050] Software as a Service (SaaS): This provides consumers with the ability to use the provider's applications running on cloud infrastructure. These applications can be accessed from various client devices via a thin client interface, such as a web browser (e.g., web-based email). Consumers do not manage or control the underlying cloud infrastructure, including the network, servers, operating system, storage, or even the individual application capabilities, with possible exceptions such as limited user-specific application configuration settings.

[0051] Platform as a Service (PaaS): This provides consumers with the ability to deploy applications created or acquired by the consumer onto cloud infrastructure using programming languages ​​and tools supported by the provider. Consumers do not manage or control the underlying cloud infrastructure, including networks, servers, operating systems, or storage; instead, they control the deployed applications and the configuration of any application hosting environments.

[0052] Infrastructure as a Service (IaaS): The capabilities provided to consumers are processing, storage, networking, and other basic computing resources that enable consumers to deploy and run arbitrary software, which may include operating systems and applications. Consumers do not manage or control the underlying cloud infrastructure, but rather control the operating system, storage, deployed applications, and may have limited control over the selection of networking components (e.g., host firewalls).

[0053] The deployment model is as follows:

[0054] Private cloud: Cloud infrastructure designed specifically for an organization's operation. The cloud infrastructure can be managed by the organization or a third party and can exist in an on-premises or off-premises manner.

[0055] Community cloud: A cloud infrastructure shared by several organizations that supports a specific community with common concerns (e.g., mission, security requirements, policies, and compliance considerations). A community cloud can be managed by these organizations or a third party and can exist in an on-premises or off-premises manner.

[0056] Public cloud: Cloud infrastructure available to the general public or large industrial groups and owned by organizations that sell cloud services.

[0057] Hybrid cloud: Cloud infrastructure is a combination of two or more clouds (private, community, or public) that maintain distinct entities but are bound together by standardized or proprietary technologies that enable data and application portability (e.g., cloud bursts for load balancing between clouds).

[0058] Cloud computing environments are service-oriented, emphasizing statelessness, loose coupling, modularity, and semantic interoperability. At its core is the infrastructure comprising a network of interconnected nodes.

[0059] refer to Figure 5 The diagram illustrates an illustrative cloud computing environment 500. As shown, the cloud computing environment 500 includes one or more cloud computing nodes 10, with local computing devices used by cloud consumers capable of communicating with the cloud computing nodes 10. These local computing devices include, for example, personal digital assistants (PDAs) or cellular phones 54A, desktop computers 54B, laptop computers 54C, and / or automotive computer systems 54N. The cloud computing nodes 10 can communicate with each other. The cloud computing nodes 10 can be physically or virtually grouped (not shown) into one or more networks, such as private clouds, community clouds, public clouds, or hybrid clouds as described above, or combinations thereof. This allows the cloud computing environment 500 to provide infrastructure, platforms, and / or software as a service that does not require cloud consumers to maintain resources on their local computing devices. It should be understood that... Figure 5 The types of computing devices 54A-N shown are for illustrative purposes only, and cloud computing node 10 and cloud computing environment 500 can communicate with any type of computerized device via any type of network and / or network-addressable connectivity (e.g., using a web browser).

[0060] refer to Figure 6 This demonstrates the 500-fold cloud computing environment ( Figure 5 This provides a set of functional abstraction layers (600). It should be understood beforehand that... Figure 6 The components, layers, and functions shown are for illustrative purposes only, and the embodiments are not limited thereto. As depicted, the following layers and corresponding functions are provided:

[0061] The hardware and software layer 60 includes hardware and software components. Examples of hardware components include: a host 61; a server 62 based on a RISC (Reduced Instruction Set Computer) architecture; a server 63; a blade server 64; a storage device 65; and network and networking components 66. In some embodiments, software components include network application server software 67 and database software 68.

[0062] The virtualization layer 70 provides an abstraction layer from which examples of the following virtual entities can be provided: virtual server 71; virtual storage 72; virtual network 73, including virtual private network; virtual application and operating system 74; and virtual client 75.

[0063] In one example, management layer 80 provides the following functionalities: Resource Provisioning 81 provides dynamic acquisition of computing resources and other resources for performing tasks in the cloud computing environment. Metering and Pricing 82 provides cost tracking and billing or invoicing of the consumption of these resources when they are used in the cloud computing environment. In one example, these resources may include application software licenses. Security provides authentication for cloud consumers and tasks, and protection for data and other resources. User Portal 83 provides access to the cloud computing environment for consumers and system administrators. Service Level Management 84 provides allocation and management of cloud computing resources to meet the required service level. Service Level Agreement (SLA) Planning and Implementation 85 provides pre-scheduling and acquisition of cloud computing resources, anticipating future demand for cloud computing resources according to the SLA.

[0064] Workload layer 90 provides examples of functionalities usable in a cloud computing environment. Examples of workloads and functionalities available from this layer include: mapping and navigation 91; software development and lifecycle management 92; virtual classroom delivery of education 93; data analytics and processing 94; transaction processing 95; and NBMP FLUS control 96. NBMP FLUS control 96 allows source clients to be NBMP sources whose workflows can be managed through the FLUS control interface.

[0065] Some embodiments may relate to systems, methods, and / or computer-readable media at any possible level of technical detail in the integration. A computer-readable medium may include a computer-readable non-transitory storage medium (or medium) having computer-readable program instructions on it that cause a processor to perform operations.

[0066] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example, but not limited to, electronic storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of computer-readable storage media includes: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital universal disc (DVD), memory sticks, floppy disks, mechanically encoded devices (e.g., raised structures in recesses or perforated cards on which instructions are recorded), and any suitable combination of the foregoing. As used herein, computer-readable storage media should not be construed as being itself a transient signal, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses passing through fiber optic cables), or electrical signals transmitted through wires.

[0067] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to a suitable computing / processing device or downloaded via a network (e.g., the Internet, a local area network, a wide area network, and / or a wireless network) to an external computer or external storage device. The network may include copper cables, optical fibers, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives and forwards the computer-readable program instructions from the network to a computer-readable storage medium within the suitable computing / processing device.

[0068] Computer-readable program code / instructions used to perform operations can be assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, integrated circuit configuration data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​(such as Smalltalk, C++, etc.) and procedural programming languages ​​(such as the "C" programming language or similar programming languages). The computer-readable program instructions can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer, partially on a remote computer, or entirely on a remote computer or server. In the latter case, the remote computer can be connected to the user's computer via any type of network, including local area networks (LANs) or wide area networks (WANs), or can establish a connection with an external computer (e.g., through the Internet provided by an Internet service provider). In some embodiments, electronic circuitry, such as including programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), can execute computer-readable program instructions by utilizing the status information of the computer-readable program instructions to personalize the electronic circuitry to perform multiple aspects or operations.

[0069] These computer-readable program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a manner for implementing the functions / actions specified in the flowchart and / or block diagram boxes. These computer-readable program instructions may also be stored in a computer-readable storage medium that directs a computer, programmable data processing apparatus, and / or other apparatus to operate in a particular manner, such that the computer-readable storage medium storing the instructions includes an article of manufacture comprising instructions for implementing aspects of the functions / actions specified in the flowchart and / or block diagram boxes.

[0070] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus or other equipment to cause a series of operational steps to be performed on the computer, other programmable apparatus or other equipment to produce a computer-implemented process, and thus the instructions that execute on the computer, other programmable apparatus or other equipment implement the functions / actions specified in the flowchart and / or block diagram boxes.

[0071] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer-readable media according to various embodiments. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of instructions, including one or more executable instructions for implementing a specified logical function. Methods, computer systems, and computer-readable media may include additional blocks, fewer blocks, different blocks, or blocks arranged differently compared to those depicted in the figures. In some alternative implementations, the functions indicated in the blocks may occur in a non-consecutive order. For example, two blocks shown consecutively may actually be executed simultaneously or substantially simultaneously, or sometimes the blocks may be executed in reverse order, depending on the functions involved. It should also be noted that each block illustrated in the block diagrams and / or flowcharts, and combinations of blocks illustrated in the block diagrams and / or flowcharts, may be implemented by systems based on dedicated hardware that perform the specified functions or actions or implement combinations of dedicated hardware and computer instructions.

[0072] Clearly, the systems and / or methods described herein can be implemented in various forms of hardware, firmware, or combinations of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods does not limit the implementation method. Therefore, this document describes the operation and behavior of the systems and / or methods without reference to specific software code—it should be understood that software and hardware can be designed to implement the systems and / or methods described herein.

[0073] Unless otherwise explicitly stated, elements, actions, or instructions used herein should not be construed as critical or necessary. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and are interchangeable with “one or more.” Additionally, as used herein, the term “set” is intended to include one or more items (e.g., related items, unrelated items, a combination of related and unrelated items, etc.) and is interchangeable with “one or more.” The term “a” or similar language is used where only one item is referred to. Furthermore, as used herein, the terms “have,” “possess,” “contain,” or similar terms are intended to be open-ended terms. Additionally, the phrase “based on” means “at least partially based on,” unless otherwise explicitly stated.

[0074] Descriptions of various aspects and embodiments have been presented for illustrative purposes, but are not intended to be exhaustive or limiting of the disclosed embodiments. Even combinations of features recited in the claims and / or disclosed in the specification are not intended to limit the disclosure of possible implementations. In fact, many of these features can be combined in ways not specifically stated in the claims and / or not disclosed in the specification. While each dependent claim listed below may be directly dependent on only one claim, the disclosure of possible implementations includes combinations of each dependent claim with every other claim in the claim set. Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein has been chosen to best explain the principles of the embodiments, their practical application, or technical improvements relative to technologies found in the market, or to enable those skilled in the art to understand the embodiments disclosed herein.

Claims

1. A method for establishing a network-based media processing (NBMP) workflow via FLUS control for a 5G real-time uplink streaming framework, executed by a processor, the method comprising: Multiple receivers and network capabilities of the network platform are discovered through multiple FLUS discovery and capability mechanisms. as well as NBMP workflows can be created, updated, retrieved, and deleted through a control interface that includes both FLUS sources and FLUS receivers, wherein the 5G FLUS control is extended to support tunnel information between the NBMP source and the NBMP workflow manager.

2. The method according to claim 1, characterized in that, The network capability is described by an identifier and a URL location, and the description of the network capability can be retrieved from the URL location.

3. The method according to claim 2, characterized in that, The description of the capability includes: an NBMP scheme identifier, the URL location, and a capability description document describing the capability, wherein the NBMP scheme identifier indicates that the NMBP workflow manager supports NBMP.

4. The method according to claim 1, characterized in that, The network capabilities are explicitly included in the discovery response.

5. The method according to any one of claims 1 to 4, characterized in that, The discovery of the plurality of receiving ends includes: the NBMP source sending a request to the FLUS source.

6. The method according to any one of claims 1 to 4, characterized in that, The HTTP status code is returned based on the creation of the NBMP workflow.

7. The method according to any one of claims 1 to 4, characterized in that, The FLUS receiver sends a request to the NBMP workflow manager to obtain the current platform capabilities.

8. A computer system for establishing a network-based media processing (NBMP) workflow via FLUS control of a 5G real-time uplink streaming framework, the computer system comprising: One or more computer-readable non-transitory storage media configured to store computer program code; as well as One or more computer processors are configured to access and operate in accordance with the instructions of the computer program code, the computer program code comprising: Discovery code, configured to enable the one or more computer processors to discover multiple receivers and network capabilities of the network platform through multiple FLUS discovery and capability mechanisms; and The code creates, updates, retrieves, and deletes code, configured to enable the one or more computer processors to create, update, retrieve, and delete NBMP workflows respectively through a control interface including a FLUS source and a FLUS receiver, wherein the 5G FLUS control is extended to support tunnel information between the NBMP source and the NBMP workflow manager.

9. The computer system according to claim 8, characterized in that, The network capability is described by an identifier and a URL location, and the description of the network capability can be retrieved from the URL location.

10. The computer system according to claim 9, characterized in that, The description of the capability includes: an NBMP scheme identifier, the URL location, and a capability description document describing the capability, wherein the NBMP scheme identifier indicates that the NMBP workflow manager supports NBMP.

11. The computer system according to claim 8, characterized in that, The network capabilities are explicitly included in the discovery response.

12. The computer system according to any one of claims 8 to 11, characterized in that, The discovery of the plurality of receiving ends includes: the NBMP source sending a request to the FLUS source.

13. The computer system according to any one of claims 8 to 11, characterized in that, The HTTP status code is returned based on the creation of the NBMP workflow.

14. The computer system according to any one of claims 8 to 11, characterized in that, The FLUS receiver sends a request to the NBMP workflow manager to obtain the current platform capabilities.

15. A non-transitory computer-readable medium having stored thereon a computer program for establishing a network-based media processing (NBMP) workflow via 5G Real-Time Uplink Streaming Framework (FLUS) control, the computer program being configured to cause one or more computer processors to: Multiple FLUS discovery and capability mechanisms are used to discover multiple receivers and network capabilities of the network platform; and NBMP workflows are created, updated, retrieved, and deleted through a control interface that includes both FLUS sources and FLUS receivers. The 5G FLUS control has been extended to support tunnel information between the NBMP source and the NBMP workflow manager.

16. The computer-readable medium according to claim 15, characterized in that, The network capability is described by an identifier and a URL location, and the description of the network capability can be retrieved from the URL location.

17. The computer-readable medium according to claim 16, characterized in that, The description of the capability includes: an NBMP scheme identifier, the URL location, and a capability description document describing the capability, wherein the NBMP scheme identifier indicates that the NMBP workflow manager supports NBMP.

18. The computer-readable medium according to claim 15, characterized in that, The network capabilities are explicitly included in the discovery response.

19. The computer-readable medium according to any one of claims 15 to 18, characterized in that, The discovery of the plurality of receiving ends includes: the NBMP source sending a request to the FLUS source.

20. The computer-readable medium according to any one of claims 15 to 18, characterized in that, The HTTP status code is returned based on the creation of the NBMP workflow.

21. An apparatus for establishing a network-based media processing (NBMP) workflow via 5G real-time uplink streaming framework FLUS control, the apparatus comprising: The discovery module is used to discover multiple receivers and network capabilities of the network platform through multiple FLUS discovery and capability mechanisms. as well as The module for creating, updating, retrieving, and deleting NBMP workflows is used to create, update, retrieve, and delete NBMP workflows respectively through control interfaces including FLUS sources and FLUS receivers, wherein the 5G FLUS control is extended to support tunnel information between the NBMP source and the NBMP workflow manager.

Images