Program processing system, method, device, equipment and storage medium

By introducing content exchange networks and integrated service hybrid networks in the broadcasting technology center, and using the scheduling controller to uniformly schedule and process program data, the inefficiency problem caused by system isolation is solved, and efficient and unified management of program production, playback and dissemination is achieved.

CN115706812BActive Publication Date: 2024-12-03TENCENT TECH (BEIJING) CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110903851.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-08-06
Publication Date
2024-12-03
Estimated Expiration
2041-08-06

AI Technical Summary

Technical Problem

The production domain, general control, broadcasting and transmission systems of the broadcasting technology center are isolated from each other, and cannot form a unified signal domain and management domain, resulting in low program production, playback and dissemination efficiency.

Method used

A program processing system is adopted, including a content switching network, a comprehensive service hybrid network and a scheduling controller. The program production data is uniformly dispatched through the scheduling controller, and the program scheduling signals are centrally processed through the content switching network, and multiple resource pools are pooled. The required program resource signals are respectively sent to the corresponding terminals to form a unified signal domain and management domain.

Benefits of technology

The information transmission logic is simplified, the program production, playback and dissemination efficiency is improved, and the unified control of the program and efficient allocation of resources are achieved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115706812B_ABST
    Figure CN115706812B_ABST
Patent Text Reader

Abstract

The present application provides a program processing system, method, device, electronic device and computer-readable storage medium; the system includes: a content exchange network, an integrated service hybrid network, a scheduling controller, and multiple terminals including resource pools; wherein the integrated service hybrid network is used to collect program production data; the scheduling controller is used to obtain program production data from the integrated service hybrid network, and schedule the program production data to obtain a scheduling signal for the program; the content exchange network is used to perform signal exchange based on the program scheduling signal to obtain program resource signals required by multiple resource pools, and send the program resource signals required by the multiple resource pools to the corresponding terminals including the resource pools respectively; the terminals including the resource pools are used to perform program production processing based on the received program resource signals required by the resource pools and the source data of the program to obtain programs for broadcasting, and send the programs for broadcasting to user terminals.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to Internet technology, and in particular to a program processing system, method, device, electronic device and computer-readable storage medium. Background Art

[0002] The Broadcast Technology Center serves all departments, carrying out the full-process production and broadcasting of variety shows, sports, information, games and other program content. It closely follows the program content and strives to create a complete, professional and industry-leading live or broadcast technology platform, and output cost-effective production technology solutions.

[0003] At present, the broadcasting technology center isolates the production domain, master control, broadcasting, and transmission systems from each other, and is unable to form a unified signal domain and management domain. The information transmission logic is complex, resulting in low efficiency in program production, broadcasting, and dissemination. Summary of the invention

[0004] The embodiments of the present application provide a program processing system, method, device, electronic device and computer-readable storage medium, which can form a unified signal domain and management domain to improve the efficiency of program production, playback and dissemination.

[0005] The technical solution of the embodiment of the present application is implemented as follows:

[0006] The present application provides a program processing system, including:

[0007] Content switching network, integrated service hybrid network, scheduling controller, multiple terminals including resource pools; wherein,

[0008] The integrated business hybrid network is used to collect program production data;

[0009] The scheduling controller is used to obtain the production data of the program from the integrated service hybrid network, and perform scheduling processing on the production data of the program to obtain a scheduling signal of the program;

[0010] The content exchange network is used to perform signal exchange based on the scheduling signal of the program, obtain program resource signals required by the plurality of resource pools, and respectively send the program resource signals required by the plurality of resource pools to corresponding terminals containing the resource pools;

[0011] The terminal including the resource pool is used to perform program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtain the program for broadcasting, and send the program for broadcasting to the user terminal.

[0012] The embodiment of the present application provides a program processing method, which is applied to a program processing system, wherein the program processing system includes: a content exchange network, an integrated service hybrid network, a scheduling controller, and a plurality of terminals including a resource pool;

[0013] The method comprises:

[0014] The scheduling controller obtains the production data of the program from the integrated service hybrid network, and performs scheduling processing on the production data of the program to obtain a scheduling signal of the program;

[0015] The content exchange network performs signal exchange based on the scheduling signal of the program, obtains program resource signals required by the plurality of resource pools, and sends the program resource signals required by the plurality of resource pools to the corresponding terminals including the resource pools, so that

[0016] The terminal including the resource pool performs program production processing based on the received program resource signal required by the resource pool and the source data of the program to obtain the program for broadcasting, and sends the program for broadcasting to the user terminal.

[0017] The embodiment of the present application provides a program processing device, characterized in that the device includes:

[0018] Integrated business mixing module, used to collect production data of programs;

[0019] A scheduling control module, used for acquiring the production data of the program from the integrated service mixing module, and performing scheduling processing on the production data of the program to obtain a scheduling signal of the program;

[0020] A content exchange module, configured to perform signal exchange based on the scheduling signal of the program, obtain program resource signals required by multiple resource pools, and send the program resource signals required by the multiple resource pools to corresponding resource modules including the resource pools;

[0021] The resource module including the resource pool is used to perform program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtain the program for broadcasting, and send the program for broadcasting to the user terminal.

[0022] An embodiment of the present application provides an electronic device for program processing, the electronic device comprising:

[0023] A memory for storing executable instructions;

[0024] The processor is used to implement the program processing method provided in the embodiment of the present application when executing the executable instructions stored in the memory.

[0025] An embodiment of the present application provides a computer-readable storage medium storing executable instructions for causing a processor to execute and implement the program processing method provided in the embodiment of the present application.

[0026] The embodiments of the present application have the following beneficial effects:

[0027] The production data of the program is uniformly scheduled through the scheduling controller to achieve unified control of the data by the scheduling controller, and the scheduling signals of the program are centrally processed through the content exchange network to send the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools, thereby forming a unified signal domain and management domain, simplifying the information transmission logic, and thus improving the efficiency of program production, playback, and dissemination. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1A-Figure 1C is a schematic diagram of the structure of a program processing system provided by an embodiment of the present application;

[0029] Figure 2 is a schematic diagram of the structure of an electronic device for program processing provided by an embodiment of the present application;

[0030] Figure 3 It is a flowchart of a program processing method provided by an embodiment of the present application;

[0031] Figure 4 It is a technical architecture diagram provided by relevant technologies;

[0032] Figure 5-Figure 6 It is a schematic diagram of the production process of the program production and dissemination system provided in the embodiment of the present application;

[0033] Figure 7 It is a topological diagram of a program production and dissemination system provided in an embodiment of the present application;

[0034] Figure 8 is a schematic diagram of network congestion provided by an embodiment of the present application;

[0035] Fig. 9 is a schematic diagram of path load balancing provided in an embodiment of the present application;

[0036] Fig.10 It is a schematic diagram of the transmission level of the high-precision time synchronization protocol (PTP) provided in an embodiment of the present application;

[0037] Fig.11 is a business process diagram of the media resource system provided in the embodiment of the present application;

[0038] Fig.12 This is a schematic diagram of audio cross-layer networking provided in an embodiment of the present application;

[0039] Fig.13It is a schematic diagram of an audio PTP network provided in an embodiment of the present application;

[0040] Fig.14 It is a schematic diagram of the audio call production domain flow provided by an embodiment of the present application;

[0041] Fig.15 It is a schematic diagram of the out-of-band integrated service hybrid network topology provided by an embodiment of the present application;

[0042] Fig.16 It is a schematic diagram of the out-of-band integrated service hybrid network application architecture provided by an embodiment of the present application;

[0043] Fig.17 It is a schematic diagram of the IP system scheduling control logic provided by an embodiment of the present application;

[0044] Fig.18 This is a schematic diagram of content distribution network distribution provided in an embodiment of the present application. DETAILED DESCRIPTION

[0045] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.

[0046] In the following description, the terms "first\second" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0047] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0048] It should be pointed out that the data collection and processing in this application should be strictly in accordance with the requirements of relevant national laws and regulations when applied in practice, and the informed consent or separate consent of the personal information subject should be obtained, and subsequent data use and processing should be carried out within the scope of authorization of laws and regulations and the personal information subject.

[0049] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0050] 1) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed may be in real time or have a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.

[0051] 2) Internet Protocol (IP): An Internet layer protocol in the Transmission Control Protocol (TCP) system or IP system. IP can improve the scalability of the network: first, it solves Internet problems and realizes the interconnection of large-scale, heterogeneous networks; second, it separates the coupling relationship between top-level network applications and bottom-level network technologies to facilitate the independent development of the two. Based on the end-to-end design principle, IP can provide a connectionless, unreliable, best-effort data packet transmission service for the host.

[0052] IP is the core of the entire TCP / IP protocol suite and the foundation of the Internet. IP is located in the network layer of the TCP / IP model. It can provide information of various protocols to the transport layer, such as TCP, UDP, etc. It can put IP information packets into the link layer and transmit them through various technologies such as Ethernet and token ring network.

[0053] 3) Commercial Off-The-Shelf (COTS): software or hardware products with interfaces defined by open standards.

[0054] 4) Production data: data used for program production, such as program data obtained from the data background, real-time instructions from studio or master control platform operators, program scheduling plans obtained from the prediction system, etc. For example, for live sports events, program data includes game scores, order of athlete appearances, number of spectators, event host information, etc. Program data can be various types of data, such as text data, image data, audio data, etc.

[0055] 5) Source data: unprocessed raw data of a program collected by a collection device, which can be various types of data, such as text data, image data, audio data, etc. For example, for a live sports event, the source data includes live audio data and video data collected by a collection device such as a camera.

[0056] The embodiments of the present application provide a program processing system, method, device, electronic device and computer-readable storage medium, which can form a unified signal domain and management domain to improve the efficiency of program production, playback and dissemination.

[0057] The program processing system provided in the embodiment of the present application is implemented by a distributed machine learning system. Among them, the integrated service hybrid network, scheduling controller, and content exchange network in the distributed machine learning system can be independent physical servers, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0058] In some embodiments, the electronic device in the program processing system can implement the program processing method provided in the embodiments of the present application by running a computer program. For example, the computer program can be a native program or software module in the operating system; it can be a native application (APP, Application), that is, a program that needs to be installed in the operating system to run; it can also be a small program, that is, a program that can be run only by downloading it to a browser environment; it can also be a small program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module or plug-in.

[0059] See also Figure 1A , Figure 1A It is a structural diagram of a program processing system 10 provided in an embodiment of the present application. The program processing system includes an integrated service hybrid network 100, a scheduling controller 200, a content switching network 300, and a terminal 400 including a resource pool; wherein the integrated service hybrid network 100, the scheduling controller 200, the content switching network 300, the terminal 400 including a resource pool, and the user terminal 500 are connected via a network 600, and the network 600 may be a wide area network or a local area network, or a combination of the two.

[0060] Integrated service hybrid network 100, used to collect production data of programs;

[0061] The scheduling controller 200 is used to obtain the production data of the program from the integrated service hybrid network 100, and perform scheduling processing on the production data of the program to obtain a scheduling signal of the program;

[0062] The content exchange network 300 is used to perform signal exchange based on the scheduling signal of the program, obtain the program resource signals required by the multiple resource pools, and send the program resource signals required by the multiple resource pools to the corresponding terminals 400 containing the resource pools;

[0063] The terminal 400 including the resource pool is used to perform program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtain the program for broadcasting, and send the program for broadcasting to the user terminal 500.

[0064] In some embodiments, the scheduling controller includes an upper-layer scheduling controller and multiple lower-layer sub-controllers, wherein the multiple lower-layer sub-controllers correspond to different resource pools respectively, and the upper-layer scheduling controller is connected to the multiple lower-layer sub-controllers through an Internet protocol; the upper-layer scheduling controller is used to obtain program production data from the integrated service hybrid network, and map the program production data for multiple lower-layer sub-controllers to obtain mapping data corresponding to the multiple lower-layer sub-controllers, and send the mapping data corresponding to the multiple lower-layer sub-controllers to the corresponding lower-layer sub-controllers; the lower-layer sub-controller is used to perform data update processing on the received mapping data, obtain the scheduling signal of the program, and send the scheduling signal of the program to the content exchange network.

[0065] like Figure 1B As shown, the upper-level scheduling controller, as the main control of the entire program processing system (i.e., the program production and dissemination system), can obtain the production data of the program from the integrated business hybrid network, and map the production data of the program to multiple lower-level sub-controllers (i.e., the controllers to which the signal transceiver terminals in each resource pool belong, corresponding to the resource pool) based on the matrix crosspoint form, obtain the mapping data corresponding to the multiple lower-level sub-controllers, and send the mapping data corresponding to the multiple lower-level sub-controllers to the corresponding lower-level sub-controllers. The lower-level sub-controller fills the address, format and other data of the signal required by each terminal into the signal request list to perform data update processing, obtain the scheduling signal of the program, and send the scheduling signal of the program to the content exchange network.

[0066] In some embodiments, the scheduling controller is also used to perform real-time monitoring and processing on a content exchange network, an integrated service hybrid network, and multiple terminals containing a resource pool, obtain monitoring data, and display the monitoring data through a control interface; wherein the dimensions of real-time monitoring and processing include at least one of the following: network topology, device ports, routing flows, service status, and system events.

[0067] like Figure 1C As shown in the figure, the monitoring mechanism is realized by the scheduling controller, which can not only monitor the network node equipment (i.e. content switching network, integrated service hybrid network, multiple terminals containing resource pools) in real time, but also comprehensively monitor the traffic and bandwidth performance of the whole network. The scheduling controller can monitor the system availability and monitoring data such as equipment and link status from multiple dimensions such as network topology, device ports, routing flow, business status, system events, etc.

[0068] In order to solve the problem of unified control between different control systems of products of different brands in the system, different control systems are brought together through a scheduling controller, while taking various protocols into account, and a unified control interface is formed through the standardized design of the management and control interface to facilitate user control.

[0069] It should be noted that the dispatch controller connects the bottom independent control system or stand-alone controller from top to bottom through the IP control protocol to form a unified operation interface for operators. It is widely supported in the NMOS protocol cluster. Each protocol (including NMOS, Generic X-Switch, nVision, LRC, TS L, Ember+, Pro-bel, etc.) has its own support camp, and the dispatch controller realizes complex logic applications in a streamlined control system through internal logic source, logic trigger, one-key follow, system snapshot, layered co-cutting and other technologies.

[0070] In some embodiments, the scheduling controller is also used to write the scheduling signal of the program into the signal request list; the terminal containing the resource pool is also used to perform signal switching based on the signal request list, obtain the group management protocol request of the program, and send the group management protocol request of the program to the content exchange network; the content exchange network is also used to parse the group management protocol request of the program, obtain the program resource signals required by multiple resource pools, and send the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools.

[0071] like Figure 1B As shown, the scheduling controller writes the scheduling signal of the program into the signal request list, and the terminal containing the resource pool performs signal switching based on the signal request list, obtains the group management protocol (IGMP) request of the program, and sends the group management protocol request of the program to the content switching network. The content switching network obtains the program resource signals required by multiple resource pools (i.e., the multicast signals corresponding to the resource pools) based on the group management protocol request of the program and according to multicast routing addressing, and sends the program resource signals required by the multiple resource pools to the corresponding interfaces of the terminals containing the resource pools.

[0072] In some embodiments, the content exchange network includes a primary domain spine switch, a backup domain spine switch, a plurality of first leaf switches, and a plurality of second leaf switches, and the primary domain spine switch, the backup domain spine switch, the plurality of first leaf switches, and the plurality of second leaf switches all use ports of a three-layer domain structure. The content exchange network is also used to enable multicast routing using the connection relationship between the primary domain spine switch and the plurality of first leaf switches, the connection relationship between the backup domain spine switch and the plurality of second leaf switches, and a routing-independent multicast protocol; based on multicast routing, the program scheduling signal is exchanged to obtain program resource signals required by multiple resource pools; based on the three-layer domain structure, the program resource signals required by the multiple resource pools are processed by three-layer addressing to obtain the forwarding address of each program resource signal, and the program resource signal is sent to the corresponding terminal containing the resource pool based on the forwarding address of each program resource signal.

[0073] For example, the core of the content switching network has a total switching throughput of more than 200T (terabytes), including active-standby dual-spine switches (i.e., primary domain spine switch and backup domain spine switch), each spine exceeding 100T, with 44 leaf switches under its jurisdiction, covering the entire production and broadcasting process of 8 studios, 4 sets of secure broadcasting units, 8 commentary rooms, and 1 recording studio.

[0074] Among them, the embodiment of the present application adopts a full three-layer routing architecture design. Under the leaf-spine architecture, each switch is connected to all switches at the next level, and a fixed number of hops is used to resolve the uncertainty of delay and reduce the range of jitter. Among them, the leaf switch connected to the main domain spine switch is the first leaf switch, and the leaf switch connected to the backup domain spine switch is the second leaf switch. The entire network of the embodiment of the present application adopts a three-layer routing design, and each switch port is set to a three-layer domain, and each three-layer domain is an independent error domain, so that the smallest three-layer domain is formed between the ports (each port and the IP on the terminal use a 30-bit mask, relying on the routing protocol to communicate with other IPs). Not only can the errors between different terminals not be transmitted through the domain, but also different ports on the same device are isolated from each other, and can only communicate through three layers, minimizing the possibility of data flooding.

[0075] At the same time, the embodiment of the present application uses a routing-independent multicast protocol (PIM) to enable multicast routing in the network, and uses an Open Shortest Path First (OSPF) protocol or a Border Gateway Protocol (BGP) to enable unicast routing and automatically announce the routing status, so that PIM can be used to perform three-layer addressing in the entire network and achieve deterministic forwarding.

[0076] In some embodiments, the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; the content switching network is also used to: determine the data bandwidth of the physical link through a professional media network architecture and non-blocking multicast to obtain the used bandwidth and remaining bandwidth of the physical link; based on the used bandwidth and remaining bandwidth of the physical link, allocate the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools.

[0077] For example, if the total bandwidth of the terminal interfaces under the leaf switch is greater than the uplink bandwidth from the leaf switch to the spine switch, network congestion and packet loss will inevitably occur. In order to solve the problem of network congestion, the embodiment of the present application performs a completely equal design for the uplink and downlink physical links from the leaf switch to the spine switch (i.e., the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch) to ensure that no bandwidth bottleneck is generated. And by using the professional media network architecture (PMN) and non-blocking multicast (NBM) method to enable the link to have the ability to perceive data bandwidth, all services can be evenly distributed to the existing paths (i.e., the terminals containing the resource pool) as much as possible based on the used bandwidth and the remaining bandwidth, while the bandwidth carried by each path is basically kept balanced.

[0078] In some embodiments, the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; the content switching network is also used to: determine the data bandwidth of the physical link through the border gateway protocol and the routing map, and obtain the used bandwidth and remaining bandwidth of the physical link; based on the used bandwidth and remaining bandwidth of the physical link, allocate the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools.

[0079] For example, if the total bandwidth of the terminal interfaces under the leaf switch is greater than the uplink bandwidth from the leaf switch to the spine switch, network congestion and packet loss will inevitably occur. In order to solve the problem of network congestion, the embodiment of the present application performs a completely equal design for the uplink and downlink physical links from the leaf switch to the spine switch (i.e., the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch) to ensure that no bandwidth bottleneck occurs. And by using the Border Gateway Protocol (BGP) and the Route Map method to enable the link to have the ability to perceive data bandwidth, all services can be evenly distributed to the existing paths (i.e., the terminals containing the resource pool) as much as possible based on the used bandwidth and the remaining bandwidth, while the bandwidth carried by each path is basically kept balanced.

[0080] In some embodiments, the program processing system further includes: a clock system for synchronizing the clock of the content exchange network so that the content exchange network sends program resource signals required by multiple resource pools based on the synchronized clock.

[0081] It should be noted that a unified and stable clock is an important basis for the normal operation of a system and the synchronization of signals between nodes. By synchronizing the clock of the content exchange network, the content exchange network sends the program resource signals required by multiple resource pools based on the synchronized clock, thereby ensuring that the program resource signals received by the terminals containing the resource pools can remain synchronized.

[0082] In some embodiments, the clock system includes a master clock, a backup clock, and a boundary clock; the clock system is also used to synchronize the clock of the content exchange network based on the master clock and the backup clock in conjunction with the boundary clock, so that the content exchange network sends the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools based on the synchronized clocks, so that the clock references restored by the multiple terminals containing the resource pools remain synchronized.

[0083] For example, the program processing system in the embodiment of the present application uses GB / T 25931 (IEEE1588v2) as the clock transmission and synchronization standard, ST.2059-2 as the video synchronization profile, and selects the system clock according to the Best Master Clock Algorithm (BMCA) to determine the master and backup clocks. Based on the application of the master and backup clocks in conjunction with the boundary clock, the collapse of any clock distribution node will not affect the stable continuation of the system benchmark, and the entire network uses a unique valid clock (synchronized clock) for release to ensure that the clock benchmark recovered from each terminal is also completely consistent, thereby ensuring the synchronization of video and audio. Among them, ST.2022-7 provides a new reference standard for link redundancy design. The 1:1 redundant network designed based on this supports the splicing processing of multi-path sources from terminal to terminal, and seamless switching.

[0084] In some embodiments, the types of resource pools include at least one of the following: external signal resource pool, studio camera resource pool, codec resource pool, switching production resource pool, virtual resource pool, graphic packaging resource pool, video playback resource pool, audio resource pool, media storage resource pool, and picture division resource pool; the terminal including the media storage resource pool is also used to transcode the collected original media materials to obtain transcoded files; perform intelligent cataloging on the transcoded files, and store the obtained cataloging results in the cloud.

[0085] For example, on the content exchange network, resource pools are used to virtually classify various types of signals and terminals of different application scenarios, and independent resource pool systems can interact smoothly through the content exchange network under unified standards such as ST.2110-20 and ST.2110-30 to achieve sharing between resource pools.

[0086] Among them, the external signal resource pool includes more than 140 external signals from satellite, dedicated line, and public network. Among them, the channels that do not have ST.2110 encapsulation output will be uniformly encapsulated by the SDI-IP gateway device via the digital serial interface (SDI) network. Among them, the studio camera resource pool includes more than 60 camera channels distributed in various studios / public areas, and the video is delivered to the IP network through the ST.2110-20 protocol. Among them, the encoder resource pool contains more than 40 channels of transmission and more than 120 live encoding channels, which can support ST.2110-20 / 30 input. The content is finally distributed to the video transcoding middle station and content distribution network, and then to the end users. Among them, the switching production resource pool includes 2 large IP ultra-high definition (UHD) switchers, all input and output channels support ST.2110-20 / 30 / 40, and can be flexibly allocated by each studio according to program requirements, and the signal can be switched through both physical and virtual panels. Among them, the virtual or graphic packaging or video playback resource pool includes a server cluster with more than 110 inputs and 50 outputs, all of which interact with signals through ST.2110-20 / 30. Among them, the audio resource pool includes 100 wireless pickup channels, no less than 2 512*512 audio matrices, no less than 4 64*64 call matrices, no less than 160 channels of audio call transceiver streams, and a maximum of 128 channels of audio call system cascading capacity (transceiver stream mode). Among them, the media storage resource pool covers 500TB of online storage space, 2PB (petabyte) of near-line management storage space, and 2PB of offline backup storage space. Among them, the picture division resource pool includes a picture division cluster that supports more than 800 ST.2110-20 / 30 signal acquisition, fully realizing IP monitoring. Among them, the converter resource pool includes more than 30 high-density integrated processing gateway devices, which are responsible for IP encapsulation and also have functions such as up and down conversion / system conversion / high dynamic range image (HDR, High-Dynamic Range) conversion.

[0087] It should be noted that the media storage resource pool in the related art has the problem of local storage capacity limitation. To solve the above problem, the terminal including the media storage resource pool in the embodiment of the present application transcodes the collected original media materials to obtain transcoded files; performs intelligent cataloging on the transcoded files, and stores the obtained cataloging results in the cloud, realizing the cloud function for the media part to solve the problem of local storage capacity limitation.

[0088] In some embodiments, the program processing system also includes: a content distribution network, which is used to send source data of the program obtained from the acquisition device to a terminal containing a resource pool; and send the program for broadcast obtained from the terminal containing the resource pool to a user terminal; wherein the data transmission performed by the content distribution network supports formats including at least one of the Advanced Video Coding Format and the High Efficiency Video Coding Format, and the data transmission supports protocols including at least one of the Secure and Reliable Transport Protocol, the Hypertext Transfer Protocol, the Real-Time Messaging Protocol, and the Reliable Internet Transport Protocol.

[0089] like Figure 1B As shown, the content distribution network is an extension of the content exchange network and an extension of the program processing system. It is the only way for source data to pass through and the only channel for broadcasting programs to the user side. The program production and dissemination system provided in the embodiment of the present application benefits from the support of the cloud Internet Data Center (IDC) in the external reception and external distribution links, and smoothly receives, distributes and delivers real-time streams.

[0090] In the real-time stream receiving link (source data transmission link), the embodiment of the present application supports compression methods such as Advanced Video Coding (AVC) and High Efficiency Video Coding (HEVC), supports access to multiple network transmission protocols such as Secure Reliable Transport (SRT), Hypertext Transfer Protocol (HTTP), Real Time Messaging Protocol (RTMP) and Reliable Internet Stream Transport (RIST), and injects source data into the terminal including the resource pool through SDI and decoding devices that support ST.2110-20 / 30.

[0091] In the program delivery stage (program playback stage), the multi-screen encoder that supports ST.2110-20 / 30 input can freely select the source under the scheduling of the scheduling controller through the NMOS protocol, and then distribute and deliver it to the content distribution network through AVC, HEVC compression methods and RTMP, HLS, FLV and other network protocols.

[0092] In summary, the embodiments of the present application have the following beneficial effects: the production data of the program is uniformly scheduled through the scheduling controller to achieve unified control of the data by the scheduling controller, and the scheduling signals of the program are centrally processed through the content exchange network to send the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools, thereby forming a unified signal domain and management domain, simplifying the information transmission logic, and thereby improving the efficiency of program production, playback, and dissemination.

[0093] It should be noted that the integrated service hybrid network, scheduling controller, content exchange network, and terminal including resource pool in the embodiment of the present application can be implemented in software (for example, in the form of application, software, software module, script or code, etc.), and deployed to electronic devices (i.e., the various forms of servers mentioned above) to implement the program processing method. The structure of the electronic device for program processing provided in the embodiment of the present application is described below, see Figure 2 , Figure 2 1 is a schematic diagram of the structure of an electronic device 500 for program processing provided in an embodiment of the present application, and takes the electronic device 500 as a server as an example. Figure 2 The electronic device 500 for program processing shown includes: at least one processor 510, a memory 550, at least one network interface 520 and a user interface 530. The various components in the electronic device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 540 is not described in detail. Figure 2 Various buses are labeled as bus system 540 .

[0094] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0095] The memory 550 includes a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 550 described in the embodiment of the present application is intended to include any suitable type of memory. The memory 550 optionally includes one or more storage devices that are physically far away from the processor 510.

[0096] In some embodiments, the memory 550 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplarily described below.

[0097] Operating system 551, including system programs for processing various basic system services and performing hardware-related tasks, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0098] A network communication module 552, for reaching other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 include: Bluetooth, Wireless Compatibility Certification (WiFi), and Universal Serial Bus (USB);

[0099] In some embodiments, the program processing device provided in the embodiments of the present application can be implemented in software, for example, it can be an application, module or plug-in in the server mentioned above. Of course, it is not limited to this, and the program processing device provided in the embodiments of the present application can be provided as various software embodiments, including various forms including application, software, software module, script or code.

[0100] Figure 2 The program processing device 555 stored in the memory 550 is shown, which can be software in the form of programs and plug-ins, and includes a series of modules, including an integrated service mixing module 5551, a scheduling control module 5552, a content exchange module 5553, and a resource module 5554 including a resource pool. When the integrated service mixing module 5551 is deployed in a network, the corresponding network can be called an integrated service mixing network, and when the scheduling control module 5552 is deployed in a network, the corresponding network can be called a scheduling control network. Similarly, a network deployed with the content exchange module 5553 is implemented as a content exchange network, and a terminal deployed with the resource module 5554 including a resource pool is implemented as a terminal including a resource pool.

[0101] The following describes the program processing method provided in the embodiment of the present application, which is applied to the program processing system, in combination with the exemplary application and implementation of the program processing system provided in the embodiment of the present application. Figure 3 , Figure 3 is a flowchart of a program processing method provided by an embodiment of the present application, combined with Figure 3 The steps shown are explained.

[0102] In the following steps, the program processing system includes: a content exchange network, an integrated service hybrid network, a scheduling controller, and multiple terminals including a resource pool.

[0103] In step 101, the scheduling controller obtains the production data of the program from the integrated service hybrid network, and performs scheduling processing on the production data of the program to obtain a scheduling signal of the program.

[0104] In some embodiments, the scheduling controller includes an upper-level scheduling controller and multiple lower-level sub-controllers, wherein the multiple lower-level sub-controllers correspond to different resource pools respectively, and the upper-level scheduling controller is connected to the multiple lower-level sub-controllers through an Internet protocol; the upper-level scheduling controller obtains program production data from the integrated service hybrid network, and maps the program production data for the multiple lower-level sub-controllers to obtain mapping data corresponding to the multiple lower-level sub-controllers, and sends the mapping data corresponding to the multiple lower-level sub-controllers to the corresponding lower-level sub-controllers; the lower-level sub-controllers perform data update processing on the received mapping data to obtain a scheduling signal for the program, and send the scheduling signal for the program to the content exchange network.

[0105] For example, the upper-level scheduling controller, as the main control of the entire program processing system, can obtain the production data of the program from the integrated service hybrid network, and map the production data of the program to multiple lower-level sub-controllers in the form of matrix crosspoints, obtain the mapping data corresponding to the multiple lower-level sub-controllers, and send the mapping data corresponding to the multiple lower-level sub-controllers to the corresponding lower-level sub-controllers. The lower-level sub-controller fills the address, format and other data of the signal required by each terminal into the signal request list to perform data update processing, obtain the program scheduling signal, and send the program scheduling signal to the content exchange network.

[0106] In some embodiments, the scheduling controller performs real-time monitoring and processing on the content exchange network, the integrated service hybrid network, and multiple terminals containing resource pools, obtains monitoring data, and displays the monitoring data through a control interface; wherein the dimensions of real-time monitoring and processing include at least one of the following: network topology, device ports, routing flows, service status, and system events.

[0107] For example, by implementing a monitoring mechanism through a scheduling controller, it is possible to monitor content switching networks, integrated service hybrid networks, and multiple terminals containing resource pools in real time, as well as to conduct comprehensive monitoring of network traffic and bandwidth performance. The scheduling controller can monitor system availability and monitoring data such as equipment and link status from multiple dimensions such as network topology, device ports, routing directions, service status, and system events.

[0108] In step 102, the content exchange network performs signal exchange based on the scheduling signal of the program, obtains program resource signals required by multiple resource pools, and sends the program resource signals required by the multiple resource pools to the corresponding terminals containing the resource pools.

[0109] In some embodiments, the scheduling controller writes the scheduling signal of the program into a signal request list; the terminal containing the resource pool performs signal switching based on the signal request list, obtains the group management protocol request of the program, and sends the group management protocol request of the program to the content exchange network; the content exchange network parses the group management protocol request of the program, obtains the program resource signals required by multiple resource pools, and sends the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools.

[0110] For example, the scheduling controller writes the scheduling signal of the program into the signal request list, and the terminal containing the resource pool performs signal switching based on the signal request list, obtains the group management protocol (IGMP) request of the program, and sends the group management protocol request of the program to the content switching network. The content switching network obtains the program resource signals required by multiple resource pools (i.e., the multicast signals corresponding to the resource pools) based on the group management protocol request of the program and according to multicast routing addressing, and sends the program resource signals required by multiple resource pools to the corresponding interfaces of the terminals containing the resource pools.

[0111] In some embodiments, the content switching network includes a primary domain spine switch, a backup domain spine switch, multiple first leaf switches and multiple second leaf switches, and the primary domain spine switch, the backup domain spine switch, multiple first leaf switches and multiple second leaf switches all use ports of a three-layer domain structure; the content switching network enables multicast routing by utilizing the connection relationship between the primary domain spine switch and the multiple first leaf switches, the connection relationship between the backup domain spine switch and the multiple second leaf switches, and a routing-independent multicast protocol; based on multicast routing, signal exchange is performed on the scheduling signals of the program to obtain program resource signals required by multiple resource pools; based on the three-layer domain structure, three-layer addressing processing is performed on the program resource signals required by the multiple resource pools to obtain the forwarding address of each program resource signal, and based on the forwarding address of each program resource signal, the program resource signal is sent to the corresponding terminal containing the resource pool.

[0112] In some embodiments, the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; the content switching network determines the data bandwidth of the physical link through a professional media network architecture and non-blocking multicast to obtain the used bandwidth and remaining bandwidth of the physical link; based on the used bandwidth and remaining bandwidth of the physical link, the program resource signals required by multiple resource pools are distributed to the corresponding terminals containing the resource pools.

[0113] For example, in order to solve the problem of network congestion, the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch in the embodiment of the present application adopt a completely equal design to ensure that no bandwidth bottleneck is generated. And by using the professional media network architecture (PMN) and non-blocking multicast (NBM) method, the link has the ability to perceive data bandwidth, so that all services can be evenly distributed to the existing paths (i.e., the terminals containing the resource pool) as much as possible according to the used bandwidth and the remaining bandwidth, and the bandwidth carried by each path is basically balanced.

[0114] In some embodiments, the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; the content switching network determines the data bandwidth of the physical link through the border gateway protocol and the routing map, and obtains the used bandwidth and remaining bandwidth of the physical link; based on the used bandwidth and remaining bandwidth of the physical link, the program resource signals required by multiple resource pools are distributed to the corresponding terminals containing the resource pools.

[0115] For example, by using the Border Gateway Protocol (BGP) and the route map method to enable the link to have the ability to perceive data bandwidth, all services can be distributed as evenly as possible to the existing paths (that is, the terminals containing the resource pool) based on the used bandwidth and the remaining bandwidth, while the bandwidth carried by each path remains basically balanced.

[0116] In some embodiments, the clock system synchronizes the clock of the content exchange network so that the content exchange network sends program resource signals required by multiple resource pools based on the synchronized clock.

[0117] Among them, the clock system includes a master clock, a backup clock and a boundary clock; the clock system synchronizes the clock of the content switching network based on the application of the master clock and the backup clock in conjunction with the boundary clock. The content switching network sends the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools based on the synchronized clocks, and the clock references restored by the multiple terminals containing the resource pools remain synchronized.

[0118] In step 103, the terminal including the resource pool performs program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtains the program for broadcasting, and sends the program for broadcasting to the user terminal.

[0119] Among them, the types of resource pools include at least one of the following: external signal resource pool, studio camera resource pool, codec resource pool, switching production resource pool, virtual resource pool, graphic packaging resource pool, video playback resource pool, audio resource pool, media storage resource pool, and picture division resource pool; the terminal containing the media storage resource pool transcodes the collected original media materials to obtain transcoded files; the transcoded files are intelligently cataloged and the obtained cataloging results are stored in the cloud.

[0120] In some embodiments, the content distribution network sends source data of a program obtained from an acquisition device to a terminal including a resource pool; and sends a program for broadcast obtained from a terminal including a resource pool to a user terminal; wherein the data transmission performed by the content distribution network supports formats including at least one of an advanced video coding format and a high efficiency video coding format, and supports protocols including at least one of a secure and reliable transmission protocol, a hypertext transfer protocol, a real-time messaging protocol, and a reliable Internet transmission protocol.

[0121] For example, in the real-time stream receiving link (source data transmission link), the embodiments of the present application support compression methods such as Advanced Video Coding (AVC) and High Efficiency Video Coding (HEVC), support access to multiple network transmission protocols such as Secure Reliable Transport (SRT), Hypertext Transfer Protocol (HTTP), Real Time Messaging Protocol (RTMP) and Reliable Internet Stream Transport (RIST), and injects source data into terminals including resource pools through SDI and decoding devices that support ST.2110-20 / 30.

[0122] In the program delivery stage (program playback stage), the multi-screen encoder that supports ST.2110-20 / 30 input can freely select the source under the scheduling of the scheduling controller through the NMOS protocol, and then distribute and deliver it to the content distribution network through AVC, HEVC compression methods and RTMP, HLS, FLV and other network protocols.

[0123] In summary, the embodiments of the present application have the following beneficial effects: the production data of the program is uniformly scheduled through the scheduling controller to achieve unified control of the data by the scheduling controller, and the scheduling signals of the program are centrally processed through the content exchange network to send the program resource signals required by multiple resource pools to the corresponding terminals containing the resource pools, thereby forming a unified signal domain and management domain, simplifying the information transmission logic, and thereby improving the efficiency of program production, playback, and dissemination.

[0124] The following is an explanation of an exemplary application of the embodiments of the present application in a practical application scenario.

[0125] like Figure 4 As shown, the system architecture in the related technology isolates the production domain system, the master control system, the broadcast system, and the transmission system from each other. The core matrix capacity between each system is only responsible for the signal routing of the corresponding part. Each system also works under a different clock system, and the upstream and downstream signal transmission is transmitted and communicated across domains through baseband signals. Secondly, in the audio production domain of each department, its clock synchronization is usually provided by the baseband word clock, and audio and video embedding and de-embedding also use baseband embedding and de-embedding equipment. The management and monitoring parts are also independent of each other.

[0126] The relevant technical solutions have the following technical problems: since the production domain system, master control system, broadcast system, and transmission system are isolated from each other, a unified signal domain, clock domain, and management domain cannot be formed, and the signal transmission logic is complex and inefficient; the baseband system capacity is limited, and it is impossible to expand the bandwidth and interface of a large number of signal interactions in response to the emergence of standards such as high frame rate and high dynamic range; there are barriers to sharing between resource pools, and the packaging and media resources can only provide baseband signal interaction, and they are all local applications that cannot be put on the cloud; it is impossible to connect upstream and downstream businesses in the same domain.

[0127] In order to solve the above problems, an embodiment of the present application provides a program production and dissemination system, which fundamentally changes this state from the architectural perspective, integrates various departments and subsystems into the same content exchange system, and at the same time, the management and monitoring of each terminal node and exchange node are also brought under the scheduling controller for unified control, and the cloud function is realized for the packaging and media resources to solve the problem of local storage capacity limitation.

[0128] The program production and dissemination system provided by the embodiment of the present application is described in detail below:

[0129] like Figure 5 As shown, the program production and dissemination system includes an integrated production, broadcasting and transmission switching network (i.e., content switching network, IP Fabric), various resource pool subsystems and an out-of-band integrated service hybrid network (i.e., integrated service hybrid network).

[0130] It should be noted that the integrated content exchange network for production, broadcasting and transmission covers network infrastructure such as content core spine switches and leaf switches.

[0131] Among them, each resource pool subsystem includes an external signal resource pool, an Internet Protocol Gateway (IPG) and converter (Converter) resource pool, a studio camera resource pool, a codec resource pool, a switching production resource pool, a virtual (AR) resource pool, a graphic packaging (CG) resource pool, a video playback (PLAY OUT) resource pool, an IP picture division resource pool, a media storage resource pool, an IP audio and call resource pool and other types of sending and receiving terminals.

[0132] Among them, the out-of-band integrated service hybrid network covers the information release system network, image modulation and lighting network, file transfer network, intelligent camera control network, switch and video control network, monitoring equipment network, IP network monitoring, etc., as well as related network security deployment.

[0133] It should be noted that the integrated content exchange network for production, broadcasting and transmission is the underlying foundation of the program production and transmission system. Through network architecture design, routing design, transmission and encapsulation protocol design, primary and standby domain redundancy design, and clock transmission design, it creates basic conditions for overall signal scheduling and interaction, and formulates negotiation and transmission standards. Each resource pool is divided according to different signal sources, signal types and usage methods, and each sub-resource pool can achieve unimpeded interaction at the network level. The out-of-band integrated service hybrid network is independent of the content exchange network. It uses the out-of-band management interface of each switching core and terminal to form a network of its own, realizing top-down unified scheduling and monitoring management of each switching core and signal terminal.

[0134] The program production and transmission system provided by the embodiment of the present application focuses on the entire process, is new in full IP, focuses on ultra-high definition, and serves the entire process of production, broadcasting, and transmission. According to the application scenarios and actual functions of the studio center, the production, broadcasting, and transmission systems are merged into one domain (clock domain), all nodes share resources, and the resource pool is divided based on the device function. The resources required by each studio can also be arbitrarily allocated according to the actual needs of the program, and the channel or input and output scale of each studio is not fixed.

[0135] like Figure 6 As shown in the figure, taking the program broadcasting scenario as an example, an all-IP program production and dissemination system is introduced, which uses the ST.2110-20 / 30 / 40 protocol as the signal interaction standard, HD / UHD SDR / HDR as the signal production standard, and GB / T 25931 (IEE E1588v2) as the clock transmission and synchronization standard:

[0136] 1. As the main control of the entire production and communication system, the upper-level scheduling controller can receive scheduling plans from the reservation system, real-time instructions from operators in the studio or the master control platform, program data shared from the data background, and send signal switching / receiving instructions (i.e., scheduling signals) to the lower-level sub-scheduling controllers.

[0137] 2. After receiving the scheduling signal, the lower-level controller (i.e., the controller to which the signal transceiver terminal in each resource pool belongs) immediately sends updated address information to the various terminals under its control, and returns the updated information of the matrix intersection to the upper-level controller.

[0138] 3. The signal transceiver terminals in each resource pool update the receiving address lists in their respective channels according to the signals sent by the lower-level controllers in their respective domains to achieve signal switching.

[0139] 4. The content switching network, as the infrastructure for signal transmission, is located under the signal transceiver terminal in each resource pool. It receives the Internet Group Management Protocol (IGMP) request from each terminal and forwards the multicast signal in the corresponding resource pool to the corresponding terminal interface based on multicast routing addressing.

[0140] 5. The clock system is the only effective synchronization source in the entire content exchange network. It uses the master clock (GrandMaster) and the boundary clock (Boundary Clock) to use the only effective clock for publishing, ensuring that the clock reference recovered from each terminal is completely consistent, thereby ensuring the synchronization of video and audio.

[0141] 6. The out-of-band integrated service hybrid network is not only the basic architecture for realizing all network management and monitoring, but also an important link connecting the information release system, data background and reservation system.

[0142] 7. The content distribution network is an extension of the content exchange network and an extension of the program production and dissemination platform. It is the only way for external signals to pass and the only channel for broadcast signals to reach the user side.

[0143] The following is a detailed description of the content exchange network, clock system, resource pooling, out-of-band integrated service hybrid network, upper-layer scheduling controller, and content distribution network involved in the program production and dissemination system:

[0144] 1) Content exchange network (full-process ST.2110 standard integrated production, broadcasting and transmission exchange network with a capacity of more than 200T)

[0145] like Figure 7As shown, the core of the integrated production and broadcasting switching network has a total switching throughput of more than 200T, including active and standby dual-spine switches (active domain spine switch and standby domain spine switch), each spine exceeds 100T, and has 44 leaf switches, covering the entire production and broadcasting process of 8 studios, 4 sets of safe broadcasting units, 8 commentary rooms, and 1 recording studio. For example, the leaf switches are respectively connected to encoders, decoders, receivers, cameras, multiviewers, intercoms, replay equipment, computer animation equipment, recording equipment, editing equipment, archiving equipment, mixers, audio nodes, gateways, etc.

[0146] The embodiment of the present application adopts a full three-layer routing architecture design. Under the leaf-spine architecture, each switching unit (i.e., switch) is connected to all switching units at the next level, and a fixed number of hops is used to resolve the uncertainty of delay and reduce the range of jitter.

[0147] Although the Layer 2 network is relatively simple in design and implementation, the entire Layer 2 domain will become a super-large error domain when a fault occurs. Any improper behavior from the terminal may cause a broadcast storm in the entire network. Similarly, when there is a multicast service in the Layer 2 domain, even if the service has no actual receiver, the multicast query, queue, and flooding may endanger any switching node in the network, eventually causing congestion or even collapse.

[0148] Therefore, the entire network of the embodiment of the present application adopts a three-layer routing design, and each switch port is set as a three-layer domain. Each three-layer domain is an independent error domain. In this way, a minimum three-layer domain is formed between the ports (each port and the IP on the terminal use a 30-bit mask, and rely on the routing protocol to communicate with other IPs). Not only can errors between different terminals not be transmitted through the domain, but different ports on the same device are also isolated from each other and can only communicate through three layers, thereby minimizing the possibility of data flooding.

[0149] At the same time, the embodiment of the present application uses the routing-independent multicast protocol (PIM) to enable multicast routing in the network, and uses the Open Shortest Path First (OSPF) protocol or the Border Gateway Protocol (BGP) to enable unicast routing and automatically announce the routing status, so that the three-layer addressing can be performed in the entire network in conjunction with PIM, and deterministic forwarding can be achieved. The application of the Internet Group Management Protocol (IGMP) ensures that the receiver's request to join and leave a specific multicast can get a correct response from the switch, and is compatible with IGMPv2 / v3 at the same time.

[0150] Since the program production and dissemination system mainly carries single-stream ultra-large bandwidth forwarding and routing in the production and broadcasting domain, it can be seen from the above introduction that the three-layer forwarding has been used to isolate the error domain to the greatest extent, and the PIM and three-layer routing design have been used to ensure accurate forwarding to specific receiving devices and compatible support for IGMP v2 and v3. Figure 8 As shown in the figure, if the sum of the terminal interface bandwidths (video, audio, link (LINK), analog network coding (ANC)) attached to the leaves is greater than the uplink bandwidth from the leaves to the spine, network congestion and packet loss will inevitably occur.

[0151] Therefore, if Fig. 9 As shown in the figure, the upper and lower physical links from leaf to spine are designed to be completely equal to ensure that no bandwidth bottleneck occurs. At the same time, the Professional Media Network Architecture (PMN) and Non-Blocking Multicast (NBM), or Border Gateway Protocol (BGP) and Route Map are used to make the link capable of sensing data bandwidth, so that all services can be evenly distributed to the existing paths as much as possible based on the used bandwidth and the remaining bandwidth, while the bandwidth carried by each path is basically balanced.

[0152] The operating terminals and user display interfaces in the system are distributed in the control rooms and shooting areas, and the rest of the equipment is deployed in the core room. Due to the use of a super-large core, it can be connected to the spine switch or leaf switch according to the terminal interface type and convergence rules. Most of the terminals with 100G interfaces in the system are directly connected to the spine switch, saving a lot of leaf deployment and connection between leaf and spine.

[0153] 2) Clock system PTP and 2022-7 redundancy design

[0154] It should be noted that a unified and stable clock is an important basis for the normal operation of a system and signal synchronization between nodes.

[0155] The program production and transmission system in the embodiment of the present application uses GB / T 25931 (IEEE1588v2) as the clock transmission and synchronization standard, ST.2059-2 as the video synchronization profile, and selects the system clock according to the Best Master Clock Algorithm (BMCA). With the application of the boundary clock, the collapse of any clock distribution node will not affect the stable continuation of the system benchmark, and the entire network uses a unique valid clock for release, ensuring that the clock benchmark recovered from each terminal is also completely consistent, thereby ensuring the synchronization of video and audio. ST.2022-7 provides a new reference standard for link redundancy design. The 1:1 redundant network designed based on this supports the splicing of multi-path sources from terminal to terminal, and seamless switching.

[0156] like Fig.10 As shown in the figure, the Grand Master Clock (GM) is the most important time reference source in the same clock domain, and the clock signals are taken from the Global Positioning System (GPS). The master clock is connected to the 1G port of the spine or leaf of the master and backup domain. At the same time, the spine or leaf connected to the master and backup domain is configured with only the high-precision time synchronization protocol (PTP ONLY). The most efficient way is to only allow PTP intercommunication. When any node or line in the system collapses, it will not affect the output stability of each terminal (Host) and the system operation. The key role in this is the priority calculation rule of BMCA. According to this rule, the priorities of GM and boundary clock (BC) in the system are set accordingly. P1 of clocks at the same level is guaranteed to be the same, but P2 is different. At the same time, the settings of PTP-related parameters on GM, including Announce Interval (0), Sync Interval (-3), Delay-req Interval (-3), Announce Ti meout (3), etc., are guaranteed to be the same as those of BC and Host. Ultimately, no matter if GPS, GM or one of the links fails, the system clock and the clock on each BC and terminal Host can be smoothly transitioned without affecting the use of the system.

[0157] The PTP clock transmission order is: GM→spine→leaf / terminal directly connected to the spine→terminal directly connected to the leaf (all terminal access points are forced to be PTP Slave). The spine and leaf are locked to the upper-level master clock as BC.

[0158] Among them, the PTP transfer process after the primary domain GPS antenna is offline is as follows: the clock level of GM A drops from the highest to GPS hold → the clock level transitions from GM A to the primary domain spine, backup domain spine, and GM B in sequence → GM B determines that it is the best clock in the entire domain through BMCA calculation → GM B changes from passive to active → the backup domain spine determines the best clock from GM B, and immediately converts the interface facing GM B to a slave interface, and at the same time, the interface facing the primary domain spine is converted to a master interface, and the GM ID in the system is also converted to GM B at the same time → the terminal determines that the GM ID facing the backup domain spine is converted to GM B → the primary domain spine determines the best clock from the backup domain spine, updates its own GM ID and the corresponding port of the slave → the terminal determines that the GM ID facing the primary domain spine is changed to GM B.

[0159] 3) Resource pooling

[0160] On top of the content exchange network, resource pools are used to virtually classify various types of signals and terminals of different application scenarios, and independent resource pool systems can interact smoothly under unified standards such as ST.2110-20 and ST.2110-30 through the content exchange network.

[0161] Among them, the external signal resource pool includes more than 140 external signals from satellites, dedicated lines, and public networks. Among them, the channels that do not have ST.2110 encapsulation output will be uniformly encapsulated by SDI-IP gateway devices via the digital serial interface (SDI, Serial Digital Interface) network; the converter resource pool includes more than 30 high-density integrated processing gateway devices, which are responsible for IP encapsulation and also have functions such as up and down conversion / system conversion / HDR conversion; the studio camera resource pool includes more than 60 camera channels distributed in various studios / public areas, and delivers video to the IP network through the ST.2110-20 protocol; the IP frame division resource pool includes a frame division cluster that supports more than 800 ST.2110-20 / 30 signal acquisition, fully realizing IP monitoring; the switching production resource pool includes 2 large IP UHD switcher, all input and output channels support ST.2110-20 / 30 / 40, and can be flexibly allocated by each studio according to program requirements, and signals can be switched through both physical and virtual panels; virtual or graphic packaging or video playback resource pool includes a server cluster with more than 110 inputs and 50 outputs, all of which interact with signals through ST.2110-20 / 30; audio resource pool includes 100 wireless pickup channels, no less than 2 512x512 audio matrices, and 64x64 call There are no less than 4 matrices, no less than 160 channels of audio call sending and receiving streams, and a maximum of 128 channels of audio call system cascading capacity (sending and receiving stream mode). The media storage resource pool covers 500TB of online storage space, 2PB of near-line management storage space, and 2PB of offline backup storage space. The codec resource pool contains more than 40 channels of transmission and more than 120 live encoding channels, which can support ST.2110-20 / 30 input. The content is ultimately distributed to the video transcoding middle station and CDN, and then to end users.

[0162] The following is a detailed description of the integrated design of packaging rendering and storage resource pool:

[0163] Among the many resource pools, the full ST.2110 IP design of the packaging rendering and storage resource pool and the cloud-based application architecture not only break the barrier that packaging and storage devices are difficult to IP-ize, but also set an example for the cloud migration of heavy resources.

[0164] like Fig.11 As shown in the figure, in the file delivery link, the fully IP-based media asset system will transcode the original materials collected by ST.2110-20 / 30 into files, and enter the media asset system through cataloging for subsequent program editing. Video materials can also access existing materials through APP, and can access the original film through an encrypted link. During the film review process, the original film material can be protected by real-time watermarking.

[0165] Among them, augmented reality (AR), packaging (CG) and video servers are based on ST.2110-20 / 30, and are connected to the leaf switch through the SFP25G module of the IP board on the engine to provide IP input and output. AR's tracking data is connected to the engine and tracker through an out-of-band switch. Similarly, pan-tilt control also uses an out-of-band switch to achieve single-person control of all indoor camera positions in the studio. In order to achieve free switching of AR or CG input signals, some IPG NAT (address translation) channels are specially designed for use, so AR or CG only needs to pull a fixed IP multicast sent by an IPG, and the actual switching is achieved by the scheduling controller controlling the quiet switching of the IPG.

[0166] The following is a detailed description of the cross-layer network IP audio and call system:

[0167] Even in other IP-based production and broadcasting systems, the audio and call resource pool still uses the local Dante protocol as the main means of interaction, and is usually converted into baseband form whenever it crosses domains. The embodiment of the present application uses ST.2110-30 as the core protocol to build an IP production cluster system, and the program production and transmission system covers both the audio and call functions in these areas. Although some audio and call equipment in the program production and transmission system do not comply with the -30 audio protocol and do not support the standard IEEE 1588-2008 synchronization protocol, data communication across network segments cannot be achieved, and only PTP V1 can be supported.

[0168] In order to enable it to have the ability to meet the standards, the embodiment of the present application uses the Leaf-connected sub-Leaf switch architecture to achieve this. A set of two-layer switch networks capable of exchanging data is built for devices that do not support the -30 standard, and a spine-leaf architecture is established in the two-layer network. Finally, the two-layer spine is connected to the three-layer spine (total spine) to achieve overall architecture standardization of audio data and synchronous data. Equipment with a control interface connects all control ports to the out-of-band integrated service network to complete centralized control. Using this special network architecture, the system successfully realizes the IP networking of two-system signals for audio calls. Ultimately, system debugging, signal scheduling and monitoring of the entire production cluster can be achieved at any location in the production area, and any location in the system interface has the input and output capabilities of -30 protocol signals.

[0169] like Figure 12-13As shown, the IP audio matrix is ​​divided into two groups of modules for use, and each core is connected to the Layer 2 network and the Layer 3 network at the same time. The module located in the Layer 3 network (pulling and sending editable multicast streams) is responsible for realizing the functions of embedding and de-embedding of bound video devices and the networked call system, and the module located in the Layer 2 network (unicast and automatic multicast routing) solves the cross-production area networking of various audio devices. The two modules are interconnected through audio signals, only transmitting audio signals, without the need for synchronization information (PTP), and no settings are required for module interconnection.

[0170] In addition to core production equipment and audio peripherals, all pickup equipment uses IP-enabled products. Antenna systems are also spread throughout the production area, and wireless pickup equipment is also networked.

[0171] like Fig.14 As shown, the process architecture is very clear for each production area. Under the IP network architecture, the application of the call system has also been expanded, and the PROD and ENG calls of all CCUs in the system are also completed by sending and receiving multicast streams through the call matrix. At the same time, the interconnection of IP audio and intercom systems can not only transmit the intercom interruptible monitoring (IFB) function based on the audio system (such as audio optical fiber), but also quickly realize the temporary needs of the program, such as a certain workstation monitoring a certain audio signal, giving the call content to a certain point in the audio system, etc. These functions are not limited by specific locations and can be realized at all points in the production system within the cluster.

[0172] 4) Comprehensive business hybrid network with full equipment coverage

[0173] like Fig.15As shown in the figure, the integrated business hybrid network serves as the network foundation for realizing the monitorable and controllable network of all nodes in the system. It carries the monitoring and management of thousands of terminals and more than 40 types of equipment, including the access of control terminals such as information release system stream transmission, lighting console, and intelligent PTZ. Various types of equipment are organized into exclusive resource pools, and the resource pools are connected through the switch virtual interface (SVI) to meet the necessary cross-domain intercommunication and centralized management of the underlying devices by upper-layer devices such as scheduling controllers; secondly, the virtual port channel (VPC) technology and hot standby router protocol (HSRP) technology are used to realize the active and standby redundancy of the core switch, and the link aggregation control protocol (LACP) is used to realize link redundancy. Finally, the security of the access terminal and the stability of the network are guaranteed through physical address (MAC address) binding, access control list (ACL, Access Control Lists) and other related technologies.

[0174] like Fig.16 As shown in the figure, the entire business network deploys a dedicated platform suitable for the workflow, integrating reservation, approval, data linkage, resource allocation, task execution, equipment detection, and alarm push, so as to complete a large amount of daily program production work with a small amount of manpower. For example, the business department initiates the process online, the person in charge of the studio completes the approval, allocates the studio equipment resources by himself, automatically dispatches the signal according to the rules, and synchronizes the program parameters to the video background and sports background in real time, so as to ensure that hundreds of millions of users can see the program information in time and complete the program production. During this period, the master control platform monitors the equipment in full coverage, and immediately notifies if the equipment alarms. The master control platform also links with the asset management system to ensure that any equipment can be traced back to the source, realizes the synchronization of sports and video data, ensures the accuracy and completeness of program information, and completes related functions such as task issuance and equipment monitoring, saving a lot of labor costs and operation and maintenance costs, and avoiding unnecessary errors caused by human factors.

[0175] It should be noted that the out-of-band integrated business hybrid network, production domain network, Internet Data Center (IDC), and public Internet need to be securely isolated. However, due to program requirements, some devices such as packaging servers, multi-screen encoders, and information release system servers need to use multiple network cards to simultaneously access multiple types of the above four networks to obtain or push data. In order to solve the security risks of this problem, the device is entered into the domain and self-developed monitoring software is installed. It is strictly required that the device can only access Internet resources through the proxy and firewall. At the same time, all external services must be connected to the security gateway system to ensure that all applications are protected by the firewall. For example, when personnel are working remotely or debugging equipment, they must go through the intelligent gateway system and use self-developed software and embedded jump server functions to ensure that all logins can be traced.

[0176] 5) IP network monitoring and upper-layer scheduling controller design

[0177] Such a huge production network involves all aspects of production, broadcasting, and transmission, and it can be said that one move affects the entire system. Therefore, it is essential to give this new architecture a complete monitoring mechanism, which can not only monitor network node devices in real time, but also conduct comprehensive monitoring of the entire network traffic and bandwidth performance. Through the network monitoring platform based on the out-of-band integrated service hybrid network, the system availability and equipment and link status can be monitored from multiple dimensions such as network topology, device ports, routing flow, business status, system events, etc.

[0178] In order to solve the problem of unified control between different control systems of products of different brands in the system, the embodiment of the present application brings together different control systems through an upper-level scheduling controller (i.e., a scheduling controller), while taking into account various protocols, and forming a unified control interface through the standardized design of the management and control interface.

[0179] like Fig.17 As shown in the figure, the Broadcast Controller connects the bottom independent control system or stand-alone controller in series from top to bottom through the IP control protocol to form a unified operation interface for operators. It is widely supported in the NMOS protocol cluster. Each protocol (including NMOS, Generic X-Switch, nVision, LRC, TSL, Ember+, Pro-bel, etc.) has its own support camp, and the Broadcast Controller implements complex logic applications in a streamlined control system through internal logic sources, logic triggers, one-button follow-up, system snapshots, layered co-cutting and other technologies.

[0180] As an example, the physical and logical correspondence of cameras is assigned, the source name of the media disc (UMD) is transmitted across systems, the TALLY system display not triggered by the switcher, the audio and video follow or cut together, etc. Originally, it was necessary to use additional general purpose input / output (GPIO) devices, additional TALLY controllers and independent controllers of each subsystem to achieve this. In the embodiment of the present application, all of these functions can be achieved through the upper-level scheduling controller. Even the function of controlling the embedding of non-layered IP audio that cannot be solved by the original controller alone can also be achieved through the scheduling controller.

[0181] 6) Design of transmission platform for content distribution network (CDN)

[0182] The program production and dissemination system provided in the embodiment of the present application benefits from the support of cloud-based IDC in the external reception and external distribution stages, and can smoothly receive, distribute and deliver files and real-time streams.

[0183] like Fig.18 As shown, in the real-time stream receiving link, the embodiment of the present application supports compression methods such as AVC and HEVC, supports the access of multiple network transmission protocols such as SRT, HTTP, RTMP, RIST, WebRTC, etc., and injects the source signal (ie, source data) into the external signal resource pool through SDI and a decoding device that supports ST.2110-20 / 30.

[0184] In the program delivery stage, multi-screen encoders that support ST.2110-20 / 30 input can freely select sources under the scheduling of the scheduling controller through the NMOS protocol, and then distribute and deliver them to the transcoding center or CDN through AVC, HEVC compression methods and RTMP, HLS, FLV and other network protocols.

[0185] In summary, the embodiment of the present application provides an ultra-large (more than 200T core throughput) full-process signal and data interactive fusion IP-based ultra-high-definition program production and transmission system based on a full IP networking of a COTS switch architecture. The broadcast technology center applies the concept of resource pool, superimposes a distributed network, and deploys from point to surface to form a highly integrated standardized open system that can easily allocate any resources at any node. The entire system uses GB / T 25931 (IEEE1588v2) as the clock transmission and synchronization standard, ST.2059-2 as the video synchronization configuration file, and uses the ST.2110 protocol (video uses ST.2110-20, audio uses ST.2110-30, and auxiliary data uses ST.2110-40) for interconnection, achieving explosive growth in core bandwidth and efficient two-way communication. From signal reception, acquisition, camera channel, signal scheduling, switcher production, audio production, packaging, playback, recording, editing, monitoring to broadcast distribution, the full process application has leaped from the SDI cable connection system to the optical fiber full IP interconnection. At the same time, this system is designed in accordance with the rules of ST.2022-7 and CLOS (multi-stage switching network) architecture, so that security and reliability are also guaranteed. Resource pooling and distributed leaf architecture guarantee the convergence ratio of resources at all levels to the greatest extent, while retaining the possibility of horizontal expansion of the system. In addition, due to the advantages brought by the COTS (common type) architecture, the cost of maintenance and expansion of the entire system will be greatly reduced. The signal exchange network, clock system and management control plane that integrates production, master control, broadcasting and transmission make the entire platform more open and flexible when facing technical standard updates and scale expansion.

[0186] Compared with related technologies, the embodiments of the present application have great advantages in carrying the needs of massive ultra-high-definition program production, breaking down the communication barriers between production, transmission, and broadcasting departments or modules, and improving program production standards (high frame rate, high dynamic range), thereby greatly improving system operation efficiency.

[0187] Problems that have not been solved in the baseband domain in related technologies, such as sharing resources in a resource pool for production, broadcasting, and transmission, and interoperability, centralized placement and management of all core devices, and centralized presentation of the operation interface, are all achieved under the IP process of the embodiment of the present application. Moreover, the working interface of the embodiment of the present application is clearer, with fewer intermediate conversions and cascade lines, which greatly simplifies the system process and improves work efficiency. This network is not only handy in dealing with the interaction of 4K / 8K ultra-high-definition resolution, 100 / 120fps ultra-high resolution, and HDR high dynamic range signals, but can also be upgraded to line cards that support 400G modules in the future, and the throughput can be quadrupled again.

[0188] Therefore, by reorganizing and optimizing the program production and dissemination system architecture, a new system and standards are used to cope with the massive program production and broadcasting needs. This not only improves the efficiency of internal and external communication, expands the throughput bandwidth of the entire system, optimizes management and monitoring methods, and saves rack space in the computer room, but also improves program production standards without changing the operating habits of program producers and system operation and maintenance personnel. It also simplifies the signal interaction process and facilitates system maintenance and expansion.

[0189] So far, the program processing method provided by the embodiment of the present application has been described in combination with the exemplary application and implementation of the electronic device provided by the embodiment of the present application. The embodiment of the present application also provides a program processing device. In actual applications, each functional module in the program processing device can be implemented by hardware resources of the electronic device (such as a terminal, a server or a server cluster), such as computing resources such as a processor, communication resources (such as for supporting various communication methods such as optical cables and cellular), and memory. Figure 2 The program processing device 555 stored in the memory 550 is shown, which can be software in the form of programs and plug-ins, for example, software modules designed in programming languages ​​such as C / C++ and Java, application software designed in programming languages ​​such as C / C++ and Java, or dedicated software modules in large software systems, application programming interfaces, plug-ins, cloud services, etc. Different implementation methods are explained below with examples.

[0190] The program processing device 555 includes a series of modules, including an integrated service mixing module 5551, a scheduling control module 5552, a content exchange module 5553, and a resource module 5554 including a resource pool. The following further describes how the various modules in the program processing device 555 provided in the embodiment of the present application cooperate to implement the program processing solution.

[0191] The integrated service mixing module 5551 is used to collect program production data; the scheduling control module 5552 is used to obtain the program production data from the integrated service mixing module, and schedule the program production data to obtain the scheduling signal of the program; the content exchange module 5553 is used to perform signal exchange based on the scheduling signal of the program, obtain the program resource signals required by multiple resource pools, and send the program resource signals required by the multiple resource pools to the corresponding resource modules containing the resource pools; the resource module 5554 containing the resource pool is used to perform program production processing based on the received program resource signals required by the resource pool and the source data of the program, obtain the program for broadcast, and send the program for broadcast to the user terminal.

[0192] In some embodiments, the scheduling control module includes an upper-level scheduling control module and multiple lower-level sub-controllers, wherein the multiple lower-level sub-controllers correspond to different resource pools respectively, and the upper-level scheduling control module is connected to the multiple lower-level sub-controllers through an Internet protocol; the upper-level scheduling control module is used to obtain the production data of the program from the integrated business mixing module 5551, and map the production data of the program for the multiple lower-level sub-controllers to obtain the mapping data corresponding to the multiple lower-level sub-controllers respectively, and send the mapping data corresponding to the multiple lower-level sub-controllers to the corresponding lower-level sub-controllers; the lower-level sub-controller is used to perform data update processing on the received mapping data to obtain the scheduling signal of the program, and send the scheduling signal of the program to the content exchange module 5553.

[0193] In some embodiments, the scheduling control module 5552 is also used to perform real-time monitoring and processing on the content exchange module, the integrated service mixing module, and the multiple resource modules including the resource pool, obtain monitoring data, and display the monitoring data through a control interface; wherein the dimensions of the real-time monitoring and processing include at least one of the following: network topology, device port, routing flow, service status, and system events.

[0194] In some embodiments, the scheduling control module 5552 is also used to write the scheduling signal of the program into the signal request list; the resource module 5554 containing the resource pool is also used to perform signal switching based on the signal request list, obtain the group management protocol request of the program, and send the group management protocol request of the program to the content exchange module 5553; the content exchange module 5553 is also used to parse the group management protocol request of the program, obtain the program resource signals required by the multiple resource pools, and send the program resource signals required by the multiple resource pools to the corresponding resource modules 5554 containing the resource pools.

[0195] In some embodiments, the content switching module 5553 includes a primary domain spine switch, a backup domain spine switch, multiple first leaf switches and multiple second leaf switches, and the primary domain spine switch, the backup domain spine switch, the multiple first leaf switches and the multiple second leaf switches all use ports of a three-layer domain structure; the content switching module 5553 is also used to: enable multicast routing using the connection relationship between the primary domain spine switch and the multiple first leaf switches, the connection relationship between the backup domain spine switch and the multiple second leaf switches, and a routing-independent multicast protocol; exchange signals of the scheduling signals of the program based on the multicast routing to obtain program resource signals required by multiple resource pools; perform three-layer addressing processing on the program resource signals required by multiple resource pools based on the three-layer domain structure to obtain a forwarding address for each of the program resource signals, and send the program resource signal to the corresponding resource module 5554 containing the resource pool based on the forwarding address of each of the program resource signals.

[0196] In some embodiments, the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; the content exchange module 5553 is also used to: determine the data bandwidth of the physical link through a professional media network architecture and non-blocking multicast to obtain the used bandwidth and remaining bandwidth of the physical link; based on the used bandwidth and remaining bandwidth of the physical link, allocate the program resource signals required by the multiple resource pools to the corresponding resource modules 5554 containing the resource pools.

[0197] In some embodiments, the physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; the content exchange module 5553 is also used to: determine the data bandwidth of the physical link through the border gateway protocol and the routing map, and obtain the used bandwidth and remaining bandwidth of the physical link; based on the used bandwidth and remaining bandwidth of the physical link, allocate the program resource signals required by the multiple resource pools to the corresponding resource modules 5554 containing the resource pools.

[0198] In some embodiments, the system further includes: a clock module, used to synchronize the clock of the content exchange module 5553, so that the content exchange module 5553 sends program resource signals required by the plurality of resource pools based on the synchronized clock.

[0199] In some embodiments, the clock module includes a master-slave clock and a boundary clock; the clock module is also used to synchronize the clock of the content exchange module 5553 based on the application of the master-slave clock in conjunction with the boundary clock, so that the content exchange module 5553 sends the program resource signals required by the multiple resource pools to the corresponding resource modules 5554 containing the resource pools based on the synchronized clock, so that the clock references restored by the multiple resource modules 5554 containing the resource pools remain synchronized.

[0200] In some embodiments, the types of resource pools include at least one of the following: external signal resource pool, studio camera resource pool, codec resource pool, switching production resource pool, virtual resource pool, graphic packaging resource pool, video playback resource pool, audio resource pool, media storage resource pool, and picture division resource pool; the resource module including the media storage resource pool is also used to: transcode the collected original media materials to obtain transcoded files; perform intelligent cataloging on the transcoded files, and store the obtained cataloging results in the cloud.

[0201] In some embodiments, the apparatus further comprises: a content distribution module, used to: send the source data of the program obtained from the acquisition device to the resource module 5554 containing the resource pool; send the program for broadcast obtained from the resource module 5554 containing the resource pool to the user terminal; wherein the data transmission supported by the content distribution network includes at least one of the advanced video coding format and the high efficiency video coding format, and the data transmission supports at least one of the secure and reliable transmission protocol, the hypertext transfer protocol, the real-time messaging protocol and the reliable Internet transmission protocol.

[0202] In summary, the embodiments of the present application have the following beneficial effects: the production data of the program is uniformly scheduled through the scheduling control module to realize the unified control of the data by the scheduling control module, and the scheduling signals of the program are centrally processed through the content exchange module to send the program resource signals required by multiple resource pools to the corresponding resource modules containing the resource pools, thereby forming a unified signal domain and management domain, simplifying the information transmission logic, and thereby improving the efficiency of program production, playback, and dissemination.

[0203] The embodiment of the present application provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of an electronic device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the electronic device executes the program processing method described in the embodiment of the present application.

[0204] The present application embodiment provides a computer-readable storage medium storing executable instructions, wherein the executable instructions are stored. When the executable instructions are executed by a processor, the processor will execute the program processing method provided by the present application embodiment, for example, Figure 3 The program processing method shown.

[0205] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EP ROM, EEPROM, flash memory, magnetic surface storage, optical disk, or CD-ROM; or it may be various devices including one or any combination of the above memories.

[0206] In some embodiments, executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

[0207] As an example, executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).

[0208] As an example, the executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one site, or on multiple electronic devices distributed at multiple sites and interconnected by a communication network.

[0209] The above is only an embodiment of the present application and is not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. A program processing system, characterized in that: include: Content switching network, integrated service hybrid network, scheduling controller, multiple terminals including resource pools; wherein, The integrated business hybrid network is used to collect program production data; The scheduling controller is used to obtain the production data of the program from the integrated service hybrid network, and perform scheduling processing on the production data of the program to obtain a scheduling signal of the program; The content exchange network is used to perform signal exchange based on the scheduling signal of the program, obtain the program resource signals required by the multiple resource pools, perform three-layer addressing processing on the program resource signals required by the multiple resource pools based on the adopted three-layer domain structure, obtain the forwarding address of each of the program resource signals, and send the program resource signals required by each of the resource pools to the corresponding terminals containing the resource pools based on the forwarding address of each of the program resource signals; The terminal including the resource pool is used to perform program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtain the program for broadcasting, and send the program for broadcasting to the user terminal.

2. The system according to claim 1, characterized in that The scheduling controller includes an upper scheduling controller and a plurality of lower sub-controllers, wherein the plurality of lower sub-controllers correspond to different resource pools respectively, and the upper scheduling controller is connected to the plurality of lower sub-controllers via an Internet protocol; The upper scheduling controller is used to obtain the production data of the program from the integrated service hybrid network, and Performing mapping processing on the production data of the program for the multiple lower-level sub-controllers to obtain mapping data corresponding to the multiple lower-level sub-controllers respectively, and sending the mapping data corresponding to the multiple lower-level sub-controllers respectively to the corresponding lower-level sub-controllers; The lower-layer sub-controller is used to perform data update processing on the received mapping data, obtain the scheduling signal of the program, and send the scheduling signal of the program to the content exchange network.

3. The system according to claim 1, characterized in that The scheduling controller is further used to perform real-time monitoring and processing on the content exchange network, the integrated service hybrid network, and the multiple terminals including the resource pool, obtain monitoring data, and display the monitoring data through a control interface; The dimensions of the real-time monitoring processing include at least one of the following: network topology, device ports, routing directions, business status, and system events.

4. The system according to claim 1, characterized in that The scheduling controller is further used to write the scheduling signal of the program into the signal request list; The terminal including the resource pool is further used to perform signal switching based on the signal request list, obtain the group management protocol request of the program, and send the group management protocol request of the program to the content exchange network; The content exchange network is also used to parse the group management protocol request of the program, obtain the program resource signals required by the multiple resource pools, and send the program resource signals required by the multiple resource pools to the corresponding terminals containing the resource pools.

5. The system according to claim 1, characterized in that The content exchange network includes a primary domain spine switch, a backup domain spine switch, a plurality of first leaf switches, and a plurality of second leaf switches, and the primary domain spine switch, the backup domain spine switch, the plurality of first leaf switches, and the plurality of second leaf switches all use ports of a three-layer domain structure; The content exchange network is also used for: Enable multicast routing by using the connection relationship between the primary domain spine switch and the plurality of first leaf switches, the connection relationship between the backup domain spine switch and the plurality of second leaf switches, and a routing-independent multicast protocol; The scheduling signals of the programs are exchanged based on the multicast routing to obtain program resource signals required by the plurality of resource pools.

6. The system according to claim 5, characterized in that The physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; The content exchange network is also used for: Determine the data bandwidth of the physical link through a professional media network architecture and non-blocking multicast, and obtain the used bandwidth and remaining bandwidth of the physical link; Based on the used bandwidth and the remaining bandwidth of the physical link, program resource signals required by the plurality of resource pools are allocated to corresponding terminals containing the resource pools.

7. The system according to claim 5, characterized in that The physical link between the first leaf switch and the primary domain spine switch, and the physical link between the second leaf switch and the backup domain spine switch both adopt a peer structure; The content exchange network is also used for: Determine the data bandwidth of the physical link through the border gateway protocol and the routing map, and obtain the used bandwidth and remaining bandwidth of the physical link; Based on the used bandwidth and the remaining bandwidth of the physical link, program resource signals required by the plurality of resource pools are allocated to corresponding terminals containing the resource pools.

8. The system according to claim 1, characterized in that The system further comprises: The clock system is used to synchronize the clock of the content exchange network so that the content exchange network sends the program resource signals required by the plurality of resource pools based on the synchronized clock.

9. The system according to claim 8, characterized in that The clock system includes a master clock and a standby clock and a boundary clock; The clock system is also used to synchronize the clock of the content switching network based on the application of the master and backup clocks in conjunction with the boundary clock, so that The content exchange network sends program resource signals required by the plurality of resource pools to the corresponding terminals containing the resource pools based on the synchronized clocks, so that the clock references restored by the plurality of terminals containing the resource pools remain synchronized.

10. The system according to claim 1, characterized in that The types of resource pools include at least one of the following: external signal resource pool, studio camera resource pool, codec resource pool, switching production resource pool, virtual resource pool, graphic packaging resource pool, video playback resource pool, audio resource pool, media storage resource pool, and picture division resource pool; The terminal including the media asset storage resource pool is further used for: Transcode the collected original media materials to obtain transcoded files; The transcoded files are intelligently catalogued, and the obtained cataloguing results are stored in the cloud.

11. The system according to claim 1, characterized in that The system further comprises: Content delivery networks for: Sending the source data of the program obtained from the acquisition device to the terminal including the resource pool; Sending the program for broadcasting obtained from the terminal containing the resource pool to the user terminal; Among them, the formats supported by the data transmission performed by the content distribution network include at least one of the advanced video coding format and the high efficiency video coding format, and the protocols supported by the data transmission include at least one of the secure and reliable transmission protocol, the hypertext transfer protocol, the real-time messaging protocol and the reliable Internet transmission protocol.

12. A program processing method, characterized in that: Applied to a program processing system, the program processing system comprises: a content exchange network, an integrated service hybrid network, a scheduling controller, and a plurality of terminals including a resource pool; The method comprises: The integrated business hybrid network collects program production data; The scheduling controller obtains the production data of the program from the integrated service hybrid network, and performs scheduling processing on the production data of the program to obtain a scheduling signal of the program; The content exchange network performs signal exchange based on the scheduling signal of the program to obtain program resource signals required by the plurality of resource pools, performs three-layer addressing processing on the program resource signals required by the plurality of resource pools based on the adopted three-layer domain structure to obtain the forwarding address of each of the program resource signals, and based on the forwarding address of each of the program resource signals, respectively sends the program resource signals required by each of the resource pools to the corresponding terminals containing the resource pools, so that The terminal including the resource pool performs program production processing based on the received program resource signal required by the resource pool and the source data of the program to obtain the program for broadcasting, and sends the program for broadcasting to the user terminal.

13. A program processing device, characterized in that: The device comprises: Integrated business mixing module, used to collect production data of programs; A scheduling control module, used for acquiring the production data of the program from the integrated service mixing module, and performing scheduling processing on the production data of the program to obtain a scheduling signal of the program; A content exchange module, configured to perform signal exchange based on the scheduling signal of the program, obtain program resource signals required by multiple resource pools, perform three-layer addressing processing on the program resource signals required by the multiple resource pools based on the adopted three-layer domain structure, obtain the forwarding address of each of the program resource signals, and send the program resource signals required by each resource pool to the corresponding resource module containing the resource pool based on the forwarding address of each of the program resource signals; The resource module including the resource pool is used to perform program production processing based on the received program resource signal required by the resource pool and the source data of the program, obtain the program for broadcasting, and send the program for broadcasting to the user terminal.

14. An electronic device, characterized in that: The electronic device comprises: A memory for storing executable instructions; The processor is used to implement the program processing method of claim 12 when executing the executable instructions stored in the memory.

15. A computer-readable storage medium, characterized in that: Executable instructions are stored, and are used to implement the program processing method described in claim 12 when executed by a processor.

16. A computer program product comprising computer executable instructions, characterized in that: When the computer executable instructions are executed by a processor, the program processing method according to claim 12 is implemented.

Citation Information

Patent Citations

  • Program production and broadcasting service flow based on TV station converged media cloud platform

    CN109274992A