Audio-video cloud network, access method, routing and forwarding method, and readable storage medium

Abstract

This application discloses an audio-video system, an access method, a routing and forwarding method, and a readable storage medium. The audio-video system includes an audio-video cloud network and an operator network, the audio-video cloud network includes a control center (210) including a scheduling center (211) and a routing center (212), and a media node including a relay node (222) and an edge node (221), the relay node (222) communicates with the routing center (212), the edge node (221) communicates with the relay node (222) and the scheduling center (211), the audio-video cloud network communicates with the operator network, and the network architecture of the audio-video cloud network is consistent with the network architecture of the operator network.

Description

[Technical field]

[0001] This application is filed based on a Chinese patent application bearing application number 202210375838.3 and filing date April 11, 2022, and claims priority to the Chinese patent application, the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the technical field of real-time audio-video communication, and in particular to an audio-video system, an access method, a routing and forwarding method, and a readable storage medium. [Background technology]

[0003] With the popularity of mobile Internet and the commercialization of 5th-generation mobile communication technology (5G), people's demand for low-latency, high-reliability audio-video applications is increasing. Real-time audio-video communication (RTC) has become a hot technology field. In particular, the arrival of the global epidemic has accelerated the development of various industries, such as RTC-based video conferencing, interactive live broadcasting, and video surveillance. At present, RTC has evolved into a complex field that includes related technologies such as network transmission, streaming media processing, transmission protocols, and encoding and decoding algorithms.

[0004] In large-scale RTC business scenarios, the existing audio-video system has become insufficient, and there is still a large gap between it and the intelligent real-time audio-video network system, the main shortcomings of which are as follows:

[0005] The user's audio-video experience cannot reach the level of communication. The data transmission link of audio-video is long, the network structure is complex, and the quality of the underlying network cannot be guaranteed. For example, the transmission delay is large, the ability to withstand a weak network is low, and there are problems such as jitter and blur on the playback side.

[0006] Low performance: The jumps between network element nodes lack an intelligent scheduling and routing system, and the nodes have single-point bottlenecks that cannot support large-scale traffic, for example, all data passes through the optimal link, which quickly becomes saturated while other links remain idle.

[0007] High cost: The transmission network of each business line is separated, some functions are duplicated, and the architecture of each module is highly coupled, resulting in a large operation and maintenance workload. For example, the conference network and the live interactive audio-video network are independent of each other, and the repeated construction leads to high costs. In addition, when an alarm occurs on a specific link, troubleshooting requires a lot of manual effort and the allocation of new resources is also required.

[0008] As technology research and development progresses, in actual projects, the above phenomena and shortcomings have finally evolved into the following: Due to technical challenges such as ensuring Quality of Service (QoS) at each layer of the network, access from the client to the audio-video network at the first (last) kilometer and transmission of internal network links, audio-video communication becomes unstable and the user experience deteriorates. Summary of the Invention [Problem to be solved by the invention]

[0009] The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.

[0010] The present application provides an audio-video system, an access method, a routing and forwarding method, and a readable storage medium. [Means for solving the problem]

[0011] According to a first aspect, an embodiment of the present application is an audio-video system including an audio-video cloud network, the audio-video cloud network comprising: a control center including a scheduling center and a routing center; An audio video system is provided, the system including a media node including a relay node and an edge node, the relay node in communication with the routing center, and the edge node in communication with the relay node and the scheduling center.

[0012] According to a second aspect, an embodiment of the present application is an access method for an audio-video system applied to the scheduling center of the audio-video system according to the first aspect, comprising: obtaining a client access request reported by a client and node information of the edge nodes; generating access scheduling information based on the client access request and the node information, the access scheduling information including target edge node information; sending the access scheduling information to the client and a target edge node corresponding to the target edge node information, and allowing the client to access the target edge node.

[0013] According to a third aspect, an embodiment of the present application is a routing transfer method for an audio-video system applied to the routing center of the audio-video system according to the first aspect, comprising: Obtaining a client access request, starting relay node information, which is node information of a relay node corresponding to the client, and link quality information between any two connected relay nodes; Analyzing the client access request to obtain business demand information and target relay node information; generating routing forwarding path information based on the business demand information, the starting relay node information, the target relay node information and the link quality information, and sending the routing forwarding path information to the relay node.

[0014] According to a fourth aspect, an embodiment of the present application further provides a controller including a memory, a processor, and a computer program stored in the memory and executable by the processor, the controller implementing, when the processor executes the computer program, the audio-video system access method described in the second aspect and / or the audio-video system routing and forwarding method described in the third aspect.

[0015] According to a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium storing computer-executable instructions for causing a computer to execute the audio-video system access method described in the second aspect and / or the audio-video system routing and forwarding method described in the third aspect.

[0016] Other features and advantages of the present application will be set forth in the following specification, and in part will be obvious from the specification, or may be learned by the practice of the present application. The objectives and other advantages of the present application may be realized and obtained by the structure particularly pointed out in the written description, claims and drawings.

[0017] The drawings are used to provide a further understanding of the technical solution of the present application, constitute a part of the specification, and are used to interpret the technical solution of the present application together with the embodiments of the present application, and are not intended to limit the technical solution of the present application. [Brief description of the drawings]

[0018] [Figure 1] 1 is a schematic diagram of a system architecture platform for implementing an access method and / or a routing and forwarding method according to an embodiment of the present application; [Diagram 2] FIG. 1 is an overall framework diagram of an audio-video system according to one embodiment of the present application. [Diagram 3] FIG. 2 is a structural schematic diagram of a cloud network integration model according to an embodiment of the present application; [Figure 4] 2 is a flowchart of an access method for an audio-video system according to an embodiment of the present application; [Diagram 5] FIG. 2 is a structural schematic diagram of an access scheduling model according to an embodiment of the present application; [Figure 6] 4 is a flowchart of an access method for an audio-video system according to another embodiment of the present application; [Figure 7] 4 is a flowchart of an access method for an audio-video system according to another embodiment of the present application; [Figure 8] 2 is a flowchart of a routing transfer method for an audio-video system according to an embodiment of the present application. [Figure 9] FIG. 2 is a structural schematic diagram of a routing and forwarding model according to an embodiment of the present application; [Figure 10] FIG. 2 is a network topology diagram of a relay node according to an embodiment of the present application. [Figure 11] FIG. 2 is a network topology score diagram of a relay node according to an embodiment of the present application. [Figure 12] FIG. 2 is a schematic diagram of multi-path data redundant transmission according to an embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be described in more detail below with reference to the drawings and examples. The specific examples described in this specification are only used to interpret the present application, and are not used to limit the present application.

[0020] In the description of this application, some means one or more, and more means two or more, and terms such as "greater than," "smaller than," "more than," etc. are understood to exclude the number, and terms such as "greater than," "less than," "within," etc. are understood to include the number. Where a first or second statement is made, it is for the purpose of distinguishing technical features only, and should not be understood to indicate or imply relative importance, or to imply the number of technical features shown, or to imply the context of the technical features shown.

[0021] In the description of this application, unless otherwise expressly limited, the terms "provide," "attach," "connect," etc. should be understood in a broad sense, and a person skilled in the art may reasonably determine the meaning of the above terms in this application by referring to the content of the technical solutions.

[0022] With the popularization of mobile Internet and the commercialization of 5G, people's demand for low-latency, high-reliability audio-video applications is increasing. Real-time audio-video communication has become a hot technology field at present. In particular, the advent of the global epidemic has accelerated the development of various industries such as RTC-based video conferencing, interactive live broadcasting, and video surveillance. At present, RTC has evolved into a complex field including network transmission, streaming media processing, transmission protocols, encoding and decoding algorithms and other related technologies. In large-scale RTC business scenarios, the existing audio-video system has become inadequate, and there is still a large gap between it and the intelligent real-time audio-video network system. The user's audio-video experience cannot reach the level of communication. The audio-video data transmission link is long, the network structure is complex, and the underlying network cannot ensure quality. For example, there are problems such as large transmission delay, low ability to tolerate weak networks, jitter on the playback side, and screen blur. Low performance: The jump between network element nodes lacks an intelligent scheduling and routing system, and the nodes have single-point bottlenecks that cannot support large-scale traffic. For example, all data passes through the optimal link, so the link quickly becomes saturated, while other links remain idle. High cost: The transmission network of each business line is separated, some functions are duplicated, and the architecture of each module is highly coupled, resulting in a large operation and maintenance workload. For example, the conference network and the live interactive audio-video network are independent of each other, and repeated construction leads to high costs. In addition, when an alarm occurs on a specific link, troubleshooting requires a lot of manual effort and the allocation of new resources is also required.

[0023] As technology research and development progresses, in actual projects, the above phenomena and shortcomings have finally evolved into the following: technical challenges such as ensuring QoS at each layer of the network, access from the client to the audio-video network at the first (last) kilometer and transmission of internal network links cause audio-video communication to be unstable, resulting in poor user experience.

[0024] In response to the problem that the current audio-video network communication is unstable and affects the user experience, the embodiments of the present application provide an audio-video system, an access method, a routing and forwarding method, and a readable storage medium. An audio-video system including an audio-video cloud network, the audio-video cloud network includes a control center including a scheduling center and a routing center, a relay node and an edge node, the relay node communicates with the routing center, and the edge node includes a media node communicating with the relay node and the scheduling center. The scheduling center obtains a client access request reported by a client and node information of a plurality of edge nodes, generates access scheduling information including target edge node information based on the client access request and the node information, and sends the access scheduling information to a target edge node corresponding to the client and the target edge node information, so that the client accesses the target edge node. The scheduling center generates the access scheduling information from the obtained client access request and node information of a plurality of edge nodes, and sends the access scheduling information to the client and the target edge node, thereby improving the quality of the client accessing the target edge node. In addition, the generated access scheduling information can improve the reliability of rapid switching when an abnormal situation occurs in a client connection, further improve the stability of audio-video communication, and improve the user's usage experience. The routing center obtains a client access request, starting relay node information which is node information of a relay node corresponding to the client, and link quality information between any two connected relay nodes, analyzes the client access request to obtain business demand information and target relay node information, generates routing forwarding path information according to the business demand information, starting relay node information, target relay node information, and link quality information, and sends the routing forwarding path information to the relay node.The routing center obtains the access request and link quality information of the client, generates routing forwarding path information, and sends the routing forwarding path information to the relay node, thereby realizing the planning of the routing forwarding path inside the audio-video cloud network, improving the transmission reliability inside the audio-video cloud network, further improving the stability of audio-video communication, and improving the user usage experience.

[0025] Hereinafter, the embodiments of the present application will be further described with reference to the drawings.

[0026] As shown in FIG. 1, FIG. 1 is a schematic diagram of a system architecture platform for implementing an access method and / or a routing and forwarding method according to an embodiment of the present application.

[0027] The system architecture platform 100 of the embodiment of the present application includes one or more processors 110 and a memory 120, and in FIG. 1, one processor 110 and one memory 120 are taken as an example.

[0028] The processor 110 and the memory 120 may be connected via a bus or in some other manner, but FIG. 1 illustrates a connection via a bus.

[0029] The memory 120 may be used as a non-transitory computer-readable storage medium to store non-transitory software programs and non-transitory computer-executable programs. In addition, the memory 120 may include high-speed random access memory, and may include non-transitory memories such as at least one magnetic disk memory, flash memory, or other non-transitory solid-state memory. In some embodiments, the memory 120 may include memory 120 located remotely with respect to the processor 110, and these remote memories may be connected to the system architecture platform 100 through a network. The network may include, but is not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0030] As will be appreciated by those skilled in the art, the configuration shown in FIG. 1 is not intended to limit system architecture platform 100, which may include more or fewer components than shown, or may combine certain components, or may include a different arrangement of components.

[0031] As shown in FIG. 2, FIG. 2 is an overall framework diagram of an audio-video system according to one embodiment of the present application.

[0032] In the embodiment of the present application, the audio-video system includes an audio-video cloud network, which includes a control center 210 and a media node (not shown). The media node is responsible for accessing and forwarding data, includes an edge node 221 and a relay node 222, can report node information and link quality information to the control center 210, and can support functions such as data redundancy, horse racing mechanism, routing maintenance, and parallel transmission. The media node embodies the transmission of data itself. The control center 210 is responsible for controlling and managing the media node, and includes a routing center 212 and a scheduling center 211. The scheduling center 211 is mainly an intelligent access edge node 221. The routing center 212 mainly performs routing forwarding path calculation for each relay node 222, plans an optimal routing forwarding path, and forwards data intelligently. The control center 210 embodies the management of data.

[0033] In the embodiment of the present application, the edge node 221 is composed of multiple small nodes, distributed over a wide area, and is the node that is physically closest to the client 230. Its function is to give priority to accessing the closest client 230 and to report its own node information to the scheduling center 211.

[0034] In the embodiment of the present application, the range of the relay node 222 covers all major regions, and the connection relationship between each node is similar to the full connection, which is a many-to-many structure. Its function is to transfer data in the network at high speed and high quality, and report link quality information between them to the routing center 212.

[0035] In the embodiment of the present application, the routing center 212 is responsible for aggregating link quality information mutually detected between relay nodes 222, analyzing information of the entire network, dynamically calculating and planning optimal path policies, and periodically distributing routing forwarding information to the relay nodes 222.

[0036] It should be noted that in the embodiment of the present application, the scheduling center 211 is responsible for aggregating and classifying the node information of the edge node 221. When the client 230 has an access request, the scheduling center 211 performs analysis by combining the client access request with the node information of the edge node 221, and assigns a nearby target edge node or an optimal target edge node to the access.

[0037] It should be noted that in the embodiment of the present application, the audio-video cloud network also includes protocol conversion. In FIG. 2, the adoption of a dashed connection between the client 230 and the edge node 221 indicates that multiple access protocols are supported, and the adoption of a solid connection between the edge node 221 and the relay node 222 indicates that a private protocol is adopted inside the audio-video cloud network. When the client 230 accesses the audio-video cloud network, the edge node 221 performs protocol conversion. The audio-video system supports multiple access protocols to the outside, that is, the protocol of the client 230 may be diverse, such as Web Real-Time Communication (WebRTC), Real Time Messaging Protocol (RTMP), HTTP-based Adaptive Rate Streaming Media Transmission Protocol (HLS), UDP-based Low-Latency Internet Transmission Layer Protocol (QUIC), Real Time Streaming Protocol (RTSP), etc. By adopting a private protocol within the audio-video cloud network and unifying the processing of various external protocols, only one transmission protocol is used internally, thereby avoiding protocol conversion between internal nodes and improving transmission efficiency.

[0038] In addition, in the embodiment of the present application, as shown in FIG. 3, the audio-video system further includes a cloud-network fusion model, and the network structure of the cloud-network fusion model can be abstracted into two layers: an upper layer which is an audio-video cloud network on the application side, and a lower layer which is an operator network. Both the upper layer and the lower layer ensure the service quality of the entire audio-video system. The operator network is a mesh-connected tree network model. A mesh peer-to-peer structure is adopted between the backbone nodes of various major regions, which can realize dynamic path planning to improve the transmission quality and reduce the delay between nodes. A tree-like hierarchical structure is adopted in the provincial-level sinking node to reduce traffic by path compounding. The mesh-like and tree-like characteristics are combined and applied to different areas to increase the speed, reduce the cost, and comprehensively improve the transmission quality of the entire network. The audio-video cloud network communicates with the operator network, and the network architecture of the audio-video cloud network is consistent with the network architecture of the operator network, which can avoid traffic bypass.

[0039] It should be noted that in the embodiment of the present application, the 4th-generation mobile communication technology (4G) / 5G (5th-generation mobile communication technology) network in the operator network can provide different levels of service quality according to business demands. When the upper-layer audio-video cloud network plans relevant transmission paths, it notifies the lower-layer operator network of the relevant transmission path plan, and the lower-layer operator network receives the relevant transmission path plan and dynamically improves the service quality level of the relevant transmission path link, thereby improving the service quality of the link as a whole, ensuring the reliability of the access side network and at the same time ensuring the transmission quality inside the network.

[0040] As shown in FIG. 4, FIG. 4 is a flowchart of an audio-video system access method according to an embodiment of the present application, and the audio-video system access method of the embodiment of the present application includes, but is not limited to, steps S400, S410, and S420.

[0041] Step S400: A client access request reported from a client and node information of a plurality of edge nodes are obtained.

[0042] Step S410: Generate access scheduling information, including target edge node information, based on the client access request and node information.

[0043] Step S420: Send access scheduling information to the target edge node corresponding to the client and the target edge node information, and allow the client to access the target edge node.

[0044] In an embodiment of the present application, the above-mentioned access method of the audio-video system is applied to the scheduling center 211 of the audio-video system shown in FIG. 2. The scheduling center 211 obtains the client access request reported by the client 230 and the node information of the multiple edge nodes 221 before the client 230 makes an access. The scheduling center 211 selects a target edge node that satisfies a preset condition based on the client access request and the node information, and generates access scheduling information based on the target edge node information of the target edge node. The scheduling center 211 transmits the access scheduling information to the client 230 and the target edge node corresponding to the target edge node information in the access scheduling information, so as to allow the client 230 to access the target edge node. This improves the access quality of the client 230 accessing the audio-video cloud network, further improves the stability of the audio-video communication, and improves the user's usage experience.

[0045] It should be noted that in the embodiment of the present application, the access scheduling information includes some target edge node information, that is, some target edge nodes 221 are provided for the client 230 to access. When an unexpected situation such as network jitter occurs in the first target edge node, the scheduling center 211 switches to the second target edge node, thereby saving the time of recalculating the target edge node to be accessed by the client 230, improving the access quality of the client 230 to access the audio-video cloud network, further improving the stability of audio-video communication, and improving the user's usage experience.

[0046] In addition, in the embodiment of the present application, an access scheduling model shown in FIG. 5 is further provided, and the above access method may be understood as one operation mode of the access scheduling model shown in FIG. 5. Here, the client initiates an access request to access the audio-video cloud network, and the scheduling center obtains the client access request, analyzes the access request to obtain information such as the client business, Internet Protocol (IP) address, and simultaneously selects one access mode according to the node information reported by each edge node (edge ​​1 to edge 6 shown in FIG. 5). Then, the scheduling center generates a TOP N access scheduling table and distributes it to the client and the target edge node mutually through signaling. Finally, the client receives the node information of the target edge node to access the target edge node, and the subsequent data transmission channel uses the target edge node.

[0047] As shown in FIG. 5, the above access methods include a nearby access method selected based on geographical location information, and an optimal access method selected based on historical quality information or an active multi-link detection index, which is the real-time link connection status between edge nodes.

[0048] In the proximity access method, the scheduling center performs classification management based on the node location information of edge nodes, which is equivalent to maintaining a static IP access library. When the scheduling center receives an access request from a client, it analyzes the access request to obtain the geographic location information of the client, and selects and assigns a physically nearby edge node from the static IP library.

[0049] Unlike the neighborhood access method that maintains a static IP access library, the optimal access method maintains a dynamic IP access library, and is not preset and unchanging, but dynamically analyzes and manages based on the node location information and historical quality information of the edge node to generate an optimal high-precision access method for the current client. When the scheduling center receives an access request from a client, it generates an access black and white list based on the historical quality information of the edge node to which the client is connected, such as the login success rate, audio video freeze rate, etc., or the real-time link connection status from the client to the edge node, i.e., the active multi-link detection index in FIG. 5. The whitelist node represents a link with good quality from the client to the edge node, and can be preferentially assigned even if it is not the node physically closest to the client. The blacklist node represents a link with poor quality from the client to the node. In addition, the capacity of the whitelist node may be expanded, and the blacklist node may be selected to form a horse racing mechanism.

[0050] It should be noted that in the embodiment of the present application, the audio-video system further includes an operator network, which generates access scheduling information according to the client access request and the node information, and then notifies the access scheduling information to the operator network, so that the operator network adjusts the service quality level of the link corresponding to the access scheduling path for the client 230 to access the target edge node, thereby improving the overall service quality of the link and ensuring the reliability of the access side network.

[0051] As shown in FIG. 6, FIG. 6 is a flowchart of an audio-video system access method according to another embodiment of the present application, and the audio-video system access method of the embodiment of the present application includes, but is not limited to, steps S600, S610, S620, and S630.

[0052] Step S600: Obtain node location information and geographic location information.

[0053] Step S610: Calculate the physical distance between the edge node and the client based on the geographical location information and the node location information.

[0054] Step S620: Select some edge nodes whose physical distance is less than or equal to a preset distance as target edge nodes.

[0055] Step S630: Generate access scheduling information based on target edge node information corresponding to the target edge node.

[0056] In the embodiment of the present application, the above access method of the audio-video system is applied to the scheduling center 211 of the audio-video system shown in FIG. 2. The scheduling center 211 analyzes the acquired client access request to acquire the physical location information of the client 230 and acquire the node location information in the node information. The scheduling center 211 calculates the physical distance between the edge node 221 and the client 230 from the geographical location information and the node location information, selects some edge nodes 221 whose physical distance is less than a preset distance as target edge nodes, and generates access scheduling information based on the target edge node information corresponding to the target edge nodes. The access method according to the embodiment of the present application is a neighborhood access method, which obtains the physical distance between the edge node 221 and the client 230 based on the geographical location information and the node location information of the client 230, selects some edge nodes 221 whose physical distance is less than a preset distance as target edge nodes, and allows the client 230 to access the target edge node. This avoids unstable data transmission caused by an excessively long distance between the client 230 and the edge node 221, improves the quality of the client 230's access to the audio-video cloud network, further improves the stability of audio-video communication, and improves the user experience.

[0057] It should be noted that in the embodiment of the present application, the access scheduling information includes some target edge node information, that is, some target edge nodes are provided for the client 230 to access. When an unexpected situation such as network jitter occurs in the first target edge node, the scheduling center 211 switches to the second target edge node, thereby saving the time of recalculating the target edge node to be accessed by the client 230, improving the access quality of the client 230 to access the audio-video cloud network, further improving the stability of audio-video communication, and improving the user's usage experience.

[0058] It should be noted that in the embodiment of the present application, the audio-video system further includes an operator network, which generates access scheduling information according to the client access request and the node information, and then notifies the access scheduling information to the operator network, so that the operator network adjusts the service quality level of the link corresponding to the access scheduling path for the client 230 to access the target edge node, thereby improving the overall service quality of the link and ensuring the reliability of the access side network.

[0059] As shown in FIG. 7, FIG. 7 is a flowchart of an audio-video system access method according to another embodiment of the present application, and the audio-video system access method of the embodiment of the present application includes, but is not limited to, steps S700, S710, S720, and S730.

[0060] Step S700: Obtain historical quality information or real-time link connection status between a client and an edge node.

[0061] Step S710: Based on the historical quality information or the real-time link connection status between the client and the edge node, generate a client access black / white list including some edge nodes, with a corresponding access priority set for each edge node.

[0062] Step S720: Select some edge nodes in the client access black / white list whose access priority satisfies the preset priority as target edge nodes.

[0063] Step S730: Generate access scheduling information based on target edge node information corresponding to the target edge node.

[0064] In an embodiment of the present application, the above-mentioned access method of the audio-video system is applied to the scheduling center 211 in the audio-video system shown in Fig. 2. When the scheduling center 211 receives a client access request, it acquires historical quality information of the edge node 221 connected by the client 230, such as a login success rate, an audio-video freeze rate, etc., or a real-time link connection status between the client 230 and the edge node 221, generates a client access black-white list including some edge nodes 221 and having an access priority set for each edge node 221 based on the historical quality information or the real-time link connection status between the client 230 and the edge node 221, selects some edge nodes 221 whose access priority satisfies the preset priority in the client access black-white list as target edge nodes, i.e., whitelist nodes, and generates access scheduling information based on target edge node information corresponding to the target edge node. The access method according to this embodiment is an optimal access method, which generates a client access black / white list based on historical quality information or a real-time link connection status between the client 230 and the edge node 221, selects an edge node 221 whose access priority in the client access black / white list satisfies a preset priority as a target edge node, and generates access scheduling information, thereby enabling the client 230 to always connect to an optimal target edge node, improving the access quality of the client 230 accessing the audio-video cloud network, further improving the stability of audio-video communication, and improving the user usage experience.

[0065] In the embodiment of the present application, the whitelist node is an edge node 221 that satisfies a preset priority and can be preferentially assigned even if it is not the edge node 221 physically closest to the client 230. The blacklist node is an edge node 221 that does not satisfy a preset priority. The whitelist node and the blacklist node may form a horse race mechanism to expand the capacity for the whitelist node and to select the blacklist node, instead of being fixed to one or more edge nodes 221.

[0066] It should be noted that in the embodiment of the present application, the access scheduling information includes some target edge node information, that is, some target edge nodes are provided for the client 230 to access. When an unexpected situation such as network jitter occurs in the first target edge node, the scheduling center 211 switches to the second target edge node, thereby saving the time of recalculating the target edge node to be accessed by the client 230, improving the access quality of the client 230 to access the audio-video cloud network, further improving the stability of audio-video communication, and improving the user's usage experience.

[0067] It should be noted that in the embodiment of the present application, the audio-video system further includes an operator network, which generates access scheduling information according to the client access request and the node information, and then notifies the access scheduling information to the operator network, so that the operator network adjusts the service quality level of the link corresponding to the access scheduling path for the client 230 to access the target edge node, thereby improving the overall service quality of the link and ensuring the reliability of the access side network.

[0068] As shown in Figures 8 and 9, Figure 8 is a flow chart of a routing and forwarding method of an audio-video system according to an embodiment of the present application, and Figure 9 is a structural schematic diagram of a routing and forwarding model according to an embodiment of the present application. The routing and forwarding method of the audio-video system according to the embodiment of the present application includes, but is not limited to, steps S800, S810, S820, and S830.

[0069] Step S800: Obtain a client access request, initiating relay node information, and link quality information between any two connected relay nodes.

[0070] Step S810: Analyze the client access request to obtain business demand information and target relay node information.

[0071] Step S820: Generate routing forwarding path information according to the business demand information, the starting relay node information, the target relay node information and the link quality information.

[0072] Step S830: Send the routing forwarding path information to the relay node.

[0073] In an embodiment of the present application, the above routing and forwarding method is applied to a routing center 212 in an audio-video system shown in Fig. 2. The routing center 212 obtains a client access request, starting relay node information, which is node information of a relay node corresponding to the client 230, and link quality information between any two connected relay nodes 222. The link quality information includes, but is not limited to, metric indicators such as packet loss rate, delay, jitter, distance between nodes, available bandwidth, etc.

[0074] The client access request is analyzed to obtain business demand information and target relay node information, and a routing forwarding path information is generated according to the business demand information, the start relay node information, and the link quality information. The routing center 212 selects a corresponding path planning policy according to the business demand information, for example, selects a quality-first path planning policy when the business demand information is business quality-first demand information, selects a cost-first path planning policy when the business demand information is business cost-first demand information, and selects a capacity-first path planning policy when the business demand information is business capacity-first demand information. According to the path planning policy, a plurality of corresponding routing forwarding paths are selected based on the link quality information, and a routing forwarding path information corresponding to the routing forwarding path is generated, where a starting point of the routing forwarding path is determined by the start relay node information, and an end point of the routing forwarding path is determined by the target relay node information. The routing center 212 transmits the generated routing forwarding path information to the relay node 222, thereby effectively reducing the network delay, improving the transmission reliability inside the audio-video cloud network, and further improving the stability of the audio-video communication, thereby improving the user's usage experience.

[0075] In the embodiment of the present application, the above routing forwarding path information is the path planning table of Fig. 9. The above path planning policy is the path planning scheme of Fig. 9.

[0076] In the embodiment of the present application, link quality detection is periodically performed between any two connected relay nodes, link quality information is acquired, and the link quality information is uploaded to the data platform. The routing center acquires the link quality information from the data platform.

[0077] In the embodiment of the present application, the routing center 212 performs path calculation based on the link quality information. The routing center 212 extracts metric indicators from the link quality information, combines and weights them, constructs a mathematical model, maps them to dimensions such as quality, cost, and capacity, and quantifies them as a link score. When selecting a quality-first path planning policy, a mathematical model is constructed for packet loss rate, delay, jitter, etc. in the link quality information and mapped to the quality score of the link, and a lower quality score indicates better link quality. Similarly, other path planning policies can be obtained by constructing and mapping mathematical models for different combinations of metric indicators.

[0078] In the embodiment of the present application, a current link score map of each link in the entire network can be obtained by path calculation, and the shortest routing path between the current relay nodes 222 can be planned using Dijkstra's algorithm. However, when planning a routing path, the routing center 212 does not only generate one shortest routing path based on the score, but also obtains multiple routing paths and distributes some routing path information generated based on the multiple routing paths to the relay nodes 222. The relay nodes 222 maintain their own routing path information, and when an abnormality occurs in the link between the relay nodes 222 or in the relay nodes 222, causing deterioration in connection quality, the relay nodes 222 can avoid network delay and jitter by switching based on the maintained routing path information.

[0079] In some embodiments, the network topology diagram between the current relay nodes 222 is shown in FIG. 10, where A to F can go through the arrangement and combination of B, C, D, E nodes, and multiple paths such as ABEF, ADBCF, etc. can be selected. If the quality-first path planning policy is selected, the link quality information between each relay node 222, such as metric indicators such as packet loss rate, delay, jitter, etc., is mapped to a quality score, and the quality score table shown in the table below is obtained. Based on the quality score table, the Dijkstra's algorithm is used to plan the routing forwarding path of the current network topology, and the routing forwarding paths from node A to other nodes, namely AD, ADB, ADE, ADEC, ADECF, are obtained, as shown in the solid line path in FIG. 11. [Table 1]

[0080] In the embodiment of the present application, as shown in Fig. 12, the routing center 212 performs a slice process on the data via the relay node 222 to obtain multiple data slices, and expands the data slices, selects a first routing forwarding path to transmit a first number of data slices, selects a second routing forwarding path to transmit a second number of data slices, and the transmission quality of the first routing forwarding path is higher than that of the second routing forwarding path, the first number is greater than the second number, the transmission quality is determined by the link quality information, and performs a splice process on the received data slices via the target relay node. By expanding the data before transmission, even if a part of the data is lost during transmission, it can be completely restored at the receiving side, ensuring the reliability of data transmission.

[0081] It should be noted that in the embodiment of the present application, the audio-video system further includes an operator network, which generates routing forwarding path information according to the business demand information, the starting relay node information, the target relay node information and the link quality information, and then notifies the routing forwarding path information to the operator network, so that the operator network adjusts the service quality level of the link corresponding to the routing forwarding path, thereby ensuring the transmission quality in the network.

[0082] An embodiment of the present application also provides a controller including a processor, a memory, and a computer program stored in the memory and executable by the processor.

[0083] The processor and memory may be connected by a bus or in other ways.

[0084] In addition, the controller in this embodiment may include a processor and a memory as in the embodiment shown in FIG. 1, and since both belong to the same concept, they have the same realization principle and effect, and will not be described in detail here.

[0085] The non-transitory software programs and instructions necessary to realize the audio-video system access method and / or the audio-video system routing and forwarding method of the above embodiments are stored in a memory and, when executed by a processor, perform the audio-video system access method and / or the audio-video system routing and forwarding method of the above embodiments.

[0086] In addition, since the controller of the embodiments of the present application can execute the audio-video system access method and / or the audio-video system routing and forwarding method of the above embodiments, reference may be made to the embodiments and technical effects of the audio-video system access method and / or the audio-video system routing and forwarding method of any of the above embodiments for the embodiments and technical effects of the controller of the embodiments of the present application.

[0087] Furthermore, an embodiment of the present application also provides a computer-readable storage medium having computer-executable instructions stored thereon, the computer-executable instructions being executed by a processor or controller, for example, a processor or controller in the controller embodiments described above, to cause the processor to execute the audio-video system access method and / or the audio-video system routing and forwarding method of any of the embodiments described above, for example, method steps S400 and S420 of FIG. 4, method steps S600 to S630 of FIG. 6, method steps S700 to S730 of FIG. 7, and method steps S800 to S830 of FIG. 8.

[0088] An embodiment of the present application is an audio-video system including an audio-video cloud network, the audio-video cloud network including a control center including a scheduling center and a routing center, a relay node and an edge node, the relay node communicates with the routing center, and the edge node includes a media node communicating with the relay node and the scheduling center. The scheduling center obtains a client access request reported by a client and node information of a plurality of the edge nodes, generates access scheduling information including target edge node information based on the client access request and the node information, and transmits the access scheduling information to a target edge node corresponding to the client and the target edge node information, so that the client accesses the target edge node. The scheduling center generates the access scheduling information from the obtained client access request and node information of the plurality of edge nodes, and transmits the access scheduling information to the client and the target edge node, thereby improving the quality of the client accessing the target edge node. In addition, the generated access scheduling information can improve the reliability of rapid switching when an abnormal situation occurs in a client connection, further improve the stability of audio-video communication, and improve the user's usage experience. The routing center obtains a client access request, starting relay node information which is node information of a relay node corresponding to the client, and link quality information between any two of the connected relay nodes, analyzes the client access request to obtain business demand information and target relay node information, generates routing forwarding path information based on the business demand information, the starting relay node information, the target relay node information, and the link quality information, and sends the routing forwarding path information to the relay node.The routing center obtains the access request and link quality information of the client, generates routing forwarding path information, and sends the routing forwarding path information to the relay node, thereby realizing the planning of the routing forwarding path inside the audio-video cloud network, improving the transmission reliability inside the audio-video cloud network, further improving the stability of audio-video communication, and improving the user usage experience.

[0089] All or part of the steps in the methods and systems disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processor, digital signal processor, microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (e.g., computer readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or any other medium that can be used to store the desired information and that can be accessed by a computer. Additionally, communication media typically includes computer readable instructions, data structures, program modules or other data in a modulated data signal, such as a carrier wave or other transmission mechanism, and may include any information delivery media as known to those skilled in the art.

[0090] Although several implementations of the present application have been specifically described above, the present application is not limited to the above embodiments, and a person skilled in the art may make various equivalent modifications or substitutions without departing from the scope of the present application, and all of these equivalent modifications or substitutions are intended to be included within the scope defined by the claims of the present application.

Claims

1. 1. An audio-video system including an audio-video cloud network, the audio-video cloud network comprising: a control center including a scheduling center and a routing center; 1. An audio video system comprising: a media node including a relay node and an edge node, the relay node in communication with the routing center, and the edge node in communication with the relay node and the scheduling center.

2. 10. The audio-video system of claim 1, further comprising an operator network, the audio-video cloud network communicating with the operator network, and a network architecture of the audio-video cloud network matching a network architecture of the operator network.

3. 3. An access method for an audio-video system, which is applied to the scheduling center of the audio-video system according to claim 1 or 2, comprising the steps of: obtaining a client access request reported by a client and node information of the edge nodes; generating access scheduling information based on the client access request and the node information, the access scheduling information including target edge node information; sending the access scheduling information to the client and a target edge node corresponding to the target edge node information, and causing the client to access the target edge node.

4. The client access request includes geographic location information, and the node information of the edge node includes node location information; The step of generating access scheduling information based on the client access request and the node information includes: acquiring the node location information and the geographical location information, and calculating a physical distance between the edge node and the client from the geographical location information and the node location information; selecting some of the edge nodes whose physical distance is equal to or less than a preset distance as the target edge node; The access method of claim 3, further comprising: generating the access scheduling information based on target edge node information corresponding to the target edge node.

5. The node information of the edge node includes historical quality information, The step of generating access scheduling information based on the client access request and the node information includes: obtaining the historical quality information or real-time link connection status between the client and the edge node; generating a client access black / white list including some of the edge nodes according to the historical quality information or the real-time link connection status between the client and the edge node, the client access black / white list having a corresponding access priority set for each of the edge nodes; selecting some of the edge nodes whose access priority satisfies a preset priority in the client access black / white list as the target edge nodes; The access method of claim 3, further comprising: generating the access scheduling information based on target edge node information corresponding to the target edge node.

6. The audio-video system further includes an operator network, and the audio-video cloud network communicates with the operator network, and a network architecture of the audio-video cloud network is consistent with a network architecture of the operator network; after the step of generating access scheduling information based on the client access request and the node information, The access method of claim 3, further comprising: notifying the access scheduling information to the operator network so that the operator network adjusts a service quality level of a link corresponding to an access scheduling path for the client to access the target edge node.

7. A routing and transfer method for an audio-video system, which is applied to the routing center of the audio-video system according to claim 1 or 2, comprising the steps of: Obtaining a client access request, starting relay node information, which is node information of a relay node corresponding to the client, and link quality information between any two connected relay nodes; Analyzing the client access request to obtain business demand information and target relay node information; generating routing forwarding path information based on the business demand information, the starting relay node information, the target relay node information and the link quality information, and sending the routing forwarding path information to the relay node.

8. The step of generating routing forwarding path information based on the business demand information, the starting relay node information, the target relay node information, and the link quality information includes: selecting a corresponding path planning policy based on the business demand information; The routing and forwarding method of claim 7, further comprising: a step of selecting a plurality of corresponding routing and forwarding paths according to the path planning policy and based on the link quality information, and generating routing and forwarding path information corresponding to the routing and forwarding paths, wherein a starting point of the routing and forwarding path is determined by the starting relay node information and an ending point of the routing and forwarding path is determined by the target relay node information.

9. The step of selecting a corresponding path planning policy based on the business demand information includes: Contains any of the following: selecting a quality-first path planning policy when the business demand information is business quality-first demand information; selecting a cost-priority path planning policy if the business demand information is business cost-priority demand information; and 9. The method for routing and transferring an audio-video system according to claim 8, further comprising one of: selecting a capacity-first path planning policy if the business demand information is business capacity-first demand information.

10. performing a slicing process on the data via the relay node to obtain a plurality of data slices; selecting a first routing forwarding path to transmit a first number of said data slices and selecting a second routing forwarding path to transmit a second number of said data slices, wherein a transmission quality of said first routing forwarding path is higher than a transmission quality of said second routing forwarding path, said first number is greater than said second number, and said transmission quality is determined by said link quality information; The routing and forwarding method for an audio-video system according to claim 7, further comprising the step of: performing a splicing process on the received data slice via the target relay node.

11. The audio-video system further includes an operator network, the audio-video cloud network is in communication with the operator network, and a network architecture of the audio-video cloud network is consistent with a network architecture of the operator network; After the step of generating routing forwarding path information based on the business demand information, the starting relay node information, the target relay node information and the link quality information, 9. The routing and forwarding method of claim 8, further comprising the step of: notifying the routing and forwarding path information to the operator network, so that the operator network adjusts a service quality level of a link corresponding to the routing and forwarding path.

12. A controller comprising a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein when the processor executes the computer program, it realizes the audio-video system access method described in any one of claims 3 to 6 and / or the audio-video system routing and transfer method described in any one of claims 7 to 11.

13. A computer-readable storage medium storing computer-executable instructions for causing a computer to execute the audio-video system access method described in any one of claims 3 to 6 and / or the audio-video system routing and transfer method described in any one of claims 7 to 11.

Images