Data transmission method and system for real-time network

Abstract

The embodiments of the present disclosure provide a data transmission method and system for a real-time network. The method comprises: receiving from the previous-hop node a first session message which carries first data; and on the basis of a processing task pre-issued by a routing and scheduling center, and the first session message, determining whether the first data is to be processed by the current node; when the determination result indicates "yes", processing the first data on the basis of the processing task, so as to obtain second data; and sending to the next-hop node a second session message which carries the second data.

Description

A data transmission method and system for real-time audio and video transmission network

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This disclosure is based on Chinese patent application CN202311186209.7, filed on September 14, 2023, entitled “A data transmission method and system for a real-time audio and video transmission network”, and claims the priority of the patent application, and all the contents disclosed therein are incorporated into this disclosure by reference. Technical Field

[0003] The present disclosure relates to the field of communications, and in particular to a data transmission method and system for a real-time audio and video transmission network. Background Art

[0004] With the continuous development of the internet, audio and video media data has become the majority of internet traffic. In recent years, the growth of scenarios such as cloud gaming, interactive live streaming, cloud computing, distance education, and video conferencing has also driven the rapid development of real-time audio and video transmission network (RTN) technology. Currently, RTN development trends are primarily driven by two key areas: First, the demand for low-latency transmission and high bandwidth is increasing. For example, scenarios such as live broadcasting, cloud gaming, 4K / 8K HD, and AR / VR / XR require both low latency and high bandwidth. Second, there is an increasing number of scenarios requiring computing power for media processing, such as video transcoding, image synthesis, image quality enhancement, and intelligent review. To address these trends, the industry's common approach is to establish low-latency media transmission networks to address low-latency transmission scenarios. For intelligent scenarios requiring computing power, centralized computing processing units are established in the central cloud to handle intelligent media processing.

[0005] However, the above solution has a significant drawback: it leads to the separation of media transmission and computation. Because media transmission primarily occurs between edges, if intelligent computation is involved, the media stream must be forwarded to the center, computed, and then forwarded back to the edge's media transmission network. This results in high media transmission latency. For example, in a pure forwarding scenario, a client sends an RTP (720P) media stream, which is forwarded by Edge 1, forwarded, and then forwarded by Edge 2 before being sent to Client B. In a scenario requiring intelligent computation at the center (e.g., transcoding), Client A sends the RTP (720P) media stream to Edge 1. After forwarding, Edge 2 sends it to the center, and after transcoding (super-resolution), the RTMP (360P) media stream is returned to Edge 2. Edge 2 then forwards the RTMP (360P) media stream to Client B, resulting in high latency.

[0006] In summary, there is no good solution to the above problems.

[0007] Summary of the Invention

[0008] The embodiments of the present disclosure provide a data transmission method and system for a real-time audio and video transmission network, so as to at least solve the problem in the related art of separation of the media transmission network and the computing unit and high data transmission delay.

[0009] According to one embodiment of the present disclosure, a data transmission method for a real-time audio and video transmission network is provided, which is applied to a node. The method includes: receiving a first session message carrying first data from a previous-hop node; determining whether the first data is processed by the current node based on a processing task pre-issued by a routing scheduling center and the first session message; if the determination result is yes, processing the first data according to the processing task to obtain second data; and sending a second session message carrying the second data to a next-hop node.

[0010] According to another embodiment of the present disclosure, a data transmission method for a real-time audio and video transmission network is provided, which is applied to a routing scheduling center, and the method includes: receiving a service request sent by an initial node; obtaining a pre-saved network topology relationship, link detection data, operators, and operator usage reported by each node; performing path planning based on the service request, network topology relationship, link detection data, operators, and operator usage, and generating transmission path information and a processing task for a target node; sending the transmission path information to the initial node, and sending the processing task to the target node, wherein the initial node is configured to send first data according to the transmission path information, and the target node is configured to process the first data according to the processing task when the first data passes through.

[0011] According to another embodiment of the present disclosure, a data transmission system for a real-time audio and video transmission network is provided, the system comprising: a routing scheduling center and multiple nodes; the routing scheduling center is configured to receive a service request sent by an initial node, obtain a pre-saved network topology relationship, link detection data reported by each node, operators, and operator usage, perform path planning based on the service request, network topology relationship, link detection data, operators, and operator usage, generate transmission path information and a processing task for a target node, send the transmission path information to the initial node, and send the processing task to the target node, wherein the initial node is configured to send first data based on the transmission path information, and the target node is configured to process the first data based on the processing task when the first data passes through; the node is configured to receive a first session message carrying the first data from a previous hop node, determine whether the first data is processed by the current node based on the processing task and the first session message, and if the determination result is yes, process the first data based on the processing task to obtain second data, and send a second session message carrying the second data to the next hop node.

[0012] According to another embodiment of the present disclosure, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above method embodiments are executed.

[0013] According to another embodiment of the present disclosure, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] FIG1 is a hardware structure block diagram of a data transmission method of an RTN network according to an embodiment of the present disclosure;

[0015] FIG2 is a flowchart of a data transmission method of a node according to an embodiment of the present disclosure;

[0016] FIG3 is a flow chart of a data transmission method of a routing scheduling center according to an embodiment of the present disclosure;

[0017] FIG4 is a schematic structural diagram of a real-time audio and video transmission network according to an embodiment of the present disclosure;

[0018] FIG5 is a structural block diagram of a routing and scheduling center according to an embodiment of the present disclosure;

[0019] FIG6 is a structural block diagram of a client according to an embodiment of the present disclosure;

[0020] FIG7 is a structural block diagram of an RTN network node according to an embodiment of the present disclosure;

[0021] FIG8 is a schematic diagram of transmission path encapsulation according to an embodiment of the present disclosure;

[0022] FIG9 is a schematic diagram of the overall flow of a data transmission method according to an embodiment of the present disclosure;

[0023] FIG10 is a partial flow diagram of a data transmission method according to an embodiment of the present disclosure (I);

[0024] FIG11 is a partial flow diagram of a data transmission method according to an embodiment of the present disclosure (II);

[0025] FIG12 is a partial flow diagram of a data transmission method according to an embodiment of the present disclosure (III);

[0026] FIG13 is a partial flow chart of a data transmission method according to an embodiment of the present disclosure (IV). DETAILED DESCRIPTION

[0027] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and in conjunction with embodiments.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0029] The method embodiments provided in the present disclosure are applied to a real-time audio and video transmission network (RTN) and can be executed by network devices in the RTN network, such as nodes, servers, switches, and user terminals. User terminals can include mobile terminals, computer terminals, and the like. Taking a computer terminal as an example, FIG1 is a hardware block diagram of the data transmission method for an RTN network according to the present disclosure. As shown in FIG1 , the hardware board may include one or more (only one is shown in FIG1 ) processors 12 (processor 12 may include, but is not limited to, a microprocessor (MCU) or a processing device such as a programmable logic device) and a memory 14 for storing data. The mobile terminal may also include a transmission device 16 and input / output devices 18 for communication functions. Those skilled in the art will appreciate that the structure shown in FIG1 is merely illustrative and does not limit the structure of the computer terminal described above. For example, the mobile terminal may include more or fewer components than shown in FIG1 , or have a configuration different from that shown in FIG1 .

[0030] The memory 14 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the data transmission method in the embodiment of the present disclosure. The processor 12 executes various functional applications and data transmission methods by running the computer programs stored in the memory 14, that is, implements the above-mentioned method. The memory 14 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 14 may further include a memory remotely located relative to the processor 12, and these remote memories may be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0031] The transmission device 16 is used to receive or send data via a network. Specific examples of the aforementioned network may include a wireless network provided by a communications provider. In one embodiment, the transmission device 16 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the transmission device 16 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0032] In one embodiment of the present disclosure, a data transmission method for a real-time audio and video transmission network is provided, which is applied to a node. FIG2 is a flow chart of the data transmission method for a node according to an embodiment of the present disclosure. As shown in FIG2 , the flow includes the following steps:

[0033] Step S202: receiving a first session message carrying first data from a previous hop node;

[0034] Step S204: determining whether the first data is to be processed by the current node based on the processing task pre-issued by the routing scheduling center and the first session message;

[0035] Step S206: If the judgment result is yes, the first data is processed according to the processing task to obtain second data;

[0036] Step S208: Send the second session message carrying the second data to the next hop node.

[0037] In the embodiment of the present disclosure, through the above steps S202 to S208, media data can be processed (such as rendering, encoding and decoding, etc.) according to the processing tasks pre-issued by the routing scheduling center, thereby realizing the integration of transmission and computing, thereby solving the problems of separation of media transmission network and computing unit and high data transmission delay in related technologies, and improving user experience.

[0038] The embodiments of the present disclosure can be applied to scenarios related to real-time audio and video communication, such as augmented reality (AR), virtual reality (VR), cloud gaming, interactive live broadcasting, cloud computing, distance education, video conferencing, video surveillance, and various applications that provide various application services to users through the Internet (Over The Top, OTT).

[0039] In some embodiments, the processing task includes: a session identifier, an operator type, and task description information. The session message includes: a session identifier, a path length, and a transmission path, wherein the session message includes the first session message and the second session message.

[0040] In an exemplary embodiment, operator types can be configured based on business processing requirements. Operator types include, but are not limited to, intelligent computing capabilities such as video transcoding, image synthesis, image enhancement, and intelligent review. Task description information is specific information about the operator, including, but not limited to, information such as input format, output format, or algorithm parameters.

[0041] In some embodiments, the nodes include an initial node, a destination node, and an RTN network node. The initial node or the destination node may be a client, specifically an audio or video terminal or a related software development kit (SDK). The first data is the original data generated by the client, and the second data is the data processed by the operator.

[0042] In some embodiments, step S204 may include the following steps:

[0043] Step S2042: comparing the session identifier of the processing task with the session identifier of the first session message;

[0044] Step S2044: When the session identifier of the processing task is the same as the session identifier of the first session message, determining that the first data is processed by the current node;

[0045] Step S2046: When the session identifier of the processing task is different from the session identifier of the first session message, it is determined that the first data is not processed by the current node.

[0046] In some embodiments, step S206 processes the first data according to the processing task to obtain the second data, which may include the following steps:

[0047] Step S2062: determining a target operator from the operators pre-issued by the routing scheduling center according to the operator type;

[0048] Step S2064: input the first data into the target operator according to the task description information to obtain the second data output by the target operator.

[0049] In some embodiments, before step S208, the method further includes step S207, determining a next hop node according to the first data packet. Step S207 may include the following steps:

[0050] Step S2072: Remove the path information of the current node from the transmission path of the first session message to obtain the transmission path of the second session message.

[0051] Step S2074: Subtract one from the path length of the first session message to obtain the path length of the second session message, where the path length indicates the number of nodes included in the transmission path.

[0052] Step S2076: Determine the next hop node according to the transmission path of the second session message.

[0053] In some embodiments, after step S204, the method further includes: if the judgment result is no, sending a second session message carrying the first data to the next hop node.

[0054] In this embodiment, the routing and dispatching center can select appropriate computing resources for media data during the path planning phase, determine the nodes that will process the media data, and issue processing tasks. During data transmission, the node that receives the processing task must first perform computational processing on the data according to the task before forwarding the processed data. Other nodes directly forward the original data.

[0055] In some embodiments, the method also includes: step S203, obtaining the processing task from the routing scheduling center, wherein the routing scheduling center is used to perform path planning based on the service request, network topology relationship, link detection data, operators of each node, and operator usage after receiving the service request of the initial node, and generate the processing task and transmission path information.

[0056] In some embodiments, the method further comprises the steps of:

[0057] Step S2001: registering with the routing scheduling center, wherein the routing scheduling center is used to save the network topology relationship between each node and the operator of each node according to the user configuration result after each node is registered.

[0058] In some embodiments, the method further comprises the steps of:

[0059] Step S2002: obtaining a network topology relationship related to the current node issued by the routing scheduling center;

[0060] Step S2003: Perform network detection based on the network topology relationship related to the current node to obtain link detection data of the current node;

[0061] Step S2004: reporting the link detection data of the current node to the routing scheduling center on a regular basis.

[0062] In some embodiments, the method further comprises the steps of:

[0063] Step S2005: obtaining an operator issued by the routing scheduling center, wherein the operator includes an algorithm type and algorithm parameters;

[0064] Step S2006: reporting the operator usage of the current node to the routing scheduling center on a regular basis.

[0065] Through the embodiments of the present disclosure, computing units can be deployed in various nodes of the transmission network. When planning paths, business needs and node computing power are combined to achieve integrated scheduling of transmission and computing, so that both transmission and computing can adapt to resources most effectively. This solves the problems of separation of media transmission networks and computing units and high data transmission delay in related technologies, and achieves the technical effect of improving the overall service capabilities and user experience of the RTN network.

[0066] In another embodiment of the present disclosure, a data transmission method for a real-time audio and video transmission network is provided, which is applied to a routing and scheduling center. FIG3 is a flow chart of the data transmission method for a routing and scheduling center according to an embodiment of the present disclosure. As shown in FIG3 , the flow includes the following steps:

[0067] Step S302: receiving a service request sent by an initial node;

[0068] Step S304: Obtain the pre-stored network topology, link detection data reported by each node, operators, and operator usage;

[0069] Step S306: performing path planning based on the service request, the network topology, the link detection data, the operator, and the operator usage, and generating transmission path information and a processing task for a target node;

[0070] Step S308: Send the transmission path information to the initial node, and send the processing task to the target node, wherein the initial node is used to send the first data according to the transmission path information, and the target node is used to process the first data according to the processing task when the first data passes through.

[0071] In the embodiment of the present disclosure, through the above steps S302 to S308, the service requirements and node computing power can be combined during path planning to achieve integrated scheduling of transmission and computing, so that both transmission and computing can adapt to resources most effectively, thereby solving the problems of separation of media transmission network and computing unit and high data transmission delay in related technologies, and achieving the technical effect of improving the overall service capabilities of the RTN network and user experience.

[0072] In this embodiment, the service request in step S302 is used to request a transmission path for media data from the routing scheduling center. The initial node and the destination node may be clients, specifically audio and video terminals or related software development kits (SDKs).

[0073] In some embodiments, the service request may include node identifiers of the originating node and the destination node, and may also include a service type.

[0074] In some embodiments, the processing task includes: session identifier, operator type, and task description information; the transmission path information includes: session identifier, path length, and transmission path.

[0075] In some embodiments, before step S302, the method further includes the following steps:

[0076] Step S3001: receiving registration information of each node to register the node, wherein the registration information includes at least one of the following: node identification, node computing capability, and node service capability;

[0077] Step S3002 : performing user configuration on the network topology relationship between the nodes and the operator of each node according to the registration information, and saving the network topology relationship and the operator according to the user configuration result.

[0078] In an exemplary embodiment, the nodes include a client and an RTN network node. The client may have business capabilities such as acquisition (generating media data), rendering, encoding and decoding, and the RTN network node may have computing capabilities such as video transcoding, picture synthesis, picture enhancement, and intelligent review.

[0079] In an exemplary embodiment, the node computing capability can be measured using specific computing power indicators, such as memory capacity, number of threads, etc., which is not limited in this disclosure.

[0080] In some embodiments, the method further comprises the steps of:

[0081] Step S3003: Send the corresponding network topology relationship to each node according to the user configuration result;

[0082] Step S3004: instruct each node to perform network detection according to the corresponding network topology relationship to obtain link detection data, wherein the link detection data includes at least one of the following: packet loss rate, delay data, jitter data, and audio and video freeze rate;

[0083] Step S3005: Receive the link detection data regularly reported by each node respectively.

[0084] In some embodiments, the method further comprises the steps of:

[0085] Step S3006: Sending corresponding operators to each node according to the user configuration result, wherein the operators include algorithm type and algorithm parameters;

[0086] Step S3007: Receive the operator usage reported regularly by each node respectively.

[0087] In some embodiments, step S306 may include the following steps:

[0088] Step S3062: Generate the transmission path information according to the service request, the network topology and the link detection data;

[0089] Step S3064: Generate a processing task for the target node according to the service request, the operator, and the operator usage.

[0090] In some embodiments, step S3064 may also include: determining a processing task for the first data based on the business request, wherein the processing task includes an operator type and task description information; and determining the target node from the transmission path information based on the operator type, the operator, and the operator usage.

[0091] In some embodiments, the routing scheduling center can first select the best transmission path, and then select suitable nodes from the transmission path for data calculation and processing. If none of the nodes in the transmission path meet the computing power requirements, the transmission path can be replanned.

[0092] In another embodiment, the routing scheduling center may first select a node with appropriate computing power and then perform path planning.

[0093] In an exemplary embodiment, operator usage can be measured using specific computing power indicators. For example, if the total number of threads of a node is 8 and 2 threads are occupied, when allocating new processing tasks, the routing scheduling center will refer to the remaining computing power of each node to allocate tasks.

[0094] Through the embodiments of the present disclosure, the integrated scheduling of transmission and computing can be realized, solving the problems of separation of media transmission network and computing unit and high data transmission delay in related technologies, and achieving the technical effect of improving the overall service capability and user experience of the RTN network.

[0095] According to another aspect of the present disclosure, a data transmission system for a real-time audio and video transmission network is provided, the system comprising:

[0096] Routing scheduling center and multiple nodes.

[0097] In this embodiment, the routing scheduling center is used to receive a service request sent by an initial node; obtain a pre-saved network topology relationship, link detection data reported by each node, an operator, and operator usage; perform path planning based on the service request, the network topology relationship, the link detection data, the operator, and the operator usage, and generate transmission path information and a processing task for a target node; send the transmission path information to the initial node, and send the processing task to the target node, wherein the initial node is used to send the first data according to the transmission path information, and the target node is used to process the first data according to the processing task when the first data passes through.

[0098] In this embodiment, the node is configured to receive a first session message carrying the first data from a previous-hop node; determine, based on the processing task and the first session message, whether the first data is processed by the current node; if the determination result is yes, process the first data according to the processing task to obtain second data; and send a second session message carrying the second data to a next-hop node.

[0099] FIG4 is a schematic diagram of the structure of a real-time audio and video transmission network according to an embodiment of the present disclosure. As shown in FIG4 , the network includes the following structures:

[0100] Routing scheduling center 42 , RTN network node 44 and client 46 .

[0101] In some embodiments, the RTN network node 44 and the client 46 are both nodes. The RTN network node and the client can perform the steps in any of the above method embodiments.

[0102] In some embodiments, RTN network nodes include edge nodes and intermediate forwarding nodes, which are responsible for client access and data forwarding, and have intelligent computing capabilities such as video transcoding, picture synthesis, picture enhancement, and intelligent review. They are also responsible for receiving data detection requests from the routing scheduling center. The detection data includes packet loss, delay, jitter, available bandwidth, node load, etc., and the detection results are combined with the node's intelligent computing capabilities (represented by operators, different intelligent computing capabilities are abstracted into different types of operators) and reported to the routing scheduling center.

[0103] In some embodiments, the client can be an audio / video terminal or a related software development kit (SDK). It is primarily responsible for generating or displaying audio / video media data, processing audio / video services (including acquisition, encoding / decoding, and rendering), querying data transmission paths and assembling packets, and transmitting and receiving audio / video data. It also detects and reports the link quality between the client and the RTN network node.

[0104] In an exemplary embodiment, the client types uniformly cover the audio and video media display part and the audio and video media generation part. For example, a video conferencing scenario may include a PC client, a mobile client, and a conference terminal in a conference room; a cloud desktop scenario includes a thin terminal, a PC terminal, and a back-end server; and an AR / VR scenario includes VR glasses, a head-mounted terminal, and a back-end server.

[0105] In some embodiments, the routing scheduling center is responsible for the management of the overall network topology, the management and distribution of operators, and also distributes link detection requests to clients, edge nodes, and transit nodes and collects link detection data reported by clients, edge nodes, and forwarding nodes. It uniformly plans the data transmission path based on the link detection data, network topology relationship, and operator requirements between each node, and distributes the planned path to the client.

[0106] In some embodiments, the routing scheduling center may further quantify the link detection data and convert it into a specific link quality index. The routing scheduling center may further perform path planning based on the quantified link quality index.

[0107] FIG5 is a structural block diagram of a routing and scheduling center according to an embodiment of the present disclosure. As shown in FIG5 , the routing and scheduling center may be composed of the following functional modules:

[0108] Topology management module 51 , detection management module 52 , operator management module 53 , data quantization module 54 , path planning module 55 , and operator task issuing module 56 .

[0109] The topology management module 51 is responsible for managing the topology of the entire RTN network, including operations such as adding and deleting RTN network nodes and changing the connection relationship between nodes.

[0110] The detection management module 52 is responsible for sending detection requests to the client and the RTN network node, and is responsible for receiving detection data reported by the client and the RTN network node.

[0111] The operator management module 53 is responsible for the unified management of operators in the RTN network, including the deployment and usage of operators in each RTN network node, and receives the operator types and usage reported by the operator synchronization module in the RTN network node.

[0112] The data quantization module 54 is responsible for quantifying the received link detection data such as packet loss, delay, jitter, available bandwidth, node load, etc. to obtain the quality index of the corresponding link.

[0113] The path planning module 55 is responsible for planning paths based on the network topology between the client and RTN nodes, link quality, and the computing power of the RTN nodes, forming the optimal transmission path and specific operator tasks. The transmission path information and operator tasks are associated through a unique session identity document (ID).

[0114] The operator task delivery module 56 is responsible for synchronizing the operator tasks from the path planning module and then delivering them to the operator task synchronization module in the RTN network node to implement the delivery of intelligent computing tasks.

[0115] FIG6 is a structural block diagram of a client according to an embodiment of the present disclosure. As shown in FIG6 , the client may be composed of the following functional modules:

[0116] Media content module 62 , path control module 64 , first data transceiver module 66 , and first link detection module 68 .

[0117] The media content module 62 is responsible for processing related services such as the production / display of audio and video media.

[0118] The path control module 64 is responsible for receiving the data transmission path issued by the routing scheduling center and encapsulating the original data into a new data packet according to the path.

[0119] The first data transceiver module 66 is responsible for data transmission and reception, and sends the encapsulated data to the next hop according to the path information indicated in the transmission path.

[0120] The first link detection module 68 is responsible for registering with the detection management of the routing scheduling center and receiving the detection request instructions issued by it. The instructions will include the specific nodes that need to be detected, such as the edge nodes directly associated with the client. After receiving the instructions, link detection will be performed immediately. The detection indicators include packet loss, delay, jitter, available bandwidth, node load, etc. After the detection is completed, the specific detection parameters will be sent to the detection management module of the routing scheduling center at a regular interval.

[0121] In one exemplary embodiment, the packet format encapsulated by the path control module primarily consists of three parts: a session identifier, transmission path information, and raw data. The session identifier and transmission path information are issued by the routing scheduling center. The raw data is generated by the client. The transmission path information includes the path length and specific transmission path information, such as the node's IP address and port information.

[0122] FIG7 is a structural block diagram of an RTN network node according to an embodiment of the present disclosure. As shown in FIG7 , the RTN network node may be composed of the following functional modules:

[0123] A transmission module and a calculation module, wherein the transmission module is composed of a second data transceiver module 72 and a second link detection module 74 ; the calculation module is composed of an operator execution module 76 and an operator task synchronization module 78 .

[0124] The second data transceiver module 72 is responsible for client access, data reception, path data decapsulation, new path data encapsulation, and data forwarding.

[0125] The second link detection module 74 is responsible for registering with the detection management module of the routing scheduling center and receiving the detection request instruction. The instruction will contain the node information that needs to be detected. After receiving the instruction, the link detection will be carried out immediately. The detection indicators include packet loss, delay, jitter, available bandwidth, node load, etc. After the detection is completed, the specific detection parameters will be sent to the detection management module of the routing scheduling center at a regular interval.

[0126] The operator execution module 76 is responsible for executing intelligent computing tasks such as video transcoding, image synthesis, image enhancement, and intelligent review. The tasks are provided by the operator task synchronization module.

[0127] The operator task synchronization module 78 is responsible for reporting the operator type and usage of this node, and reporting the relevant information to the operator management module of the routing scheduling center. It is also responsible for receiving the computing tasks issued by the operator task issuance module of the routing scheduling center, and is responsible for associating the data stream that needs to be calculated according to the session identifier, and calling the operator execution module to perform specific intelligent calculations.

[0128] FIG8 is a schematic diagram of transmission path encapsulation according to an embodiment of the present disclosure. As shown in FIG8 , the data encapsulation packet at client A includes a session identifier, a path length, a transmission path, and original data.

[0129] In this embodiment, the solid line represents the transmission path decided by the routing scheduling center, and the dotted line represents the network topology relationship of the RTN network.

[0130] In this embodiment, the transmission path planned by the routing scheduling center is client A-1-4-8-9-client B. Client A encapsulates the original data.

[0131] In this embodiment, the processing task is to perform transcoding at node 8 (the transcoding task will be sent to node 8 by the routing scheduling center. After receiving the data, node 8 identifies the data that needs to be transcoded based on the session identifier, and sends the data to the next node 9 after transcoding).

[0132] In this embodiment, the transmission path information includes the path length and the IP address and port information of the specific node.

[0133] FIG9 is a schematic diagram of the overall process of a data transmission method according to an embodiment of the present disclosure. As shown in FIG9 , the process includes the following steps:

[0134] Step S1: The client and RTN network node register with the topology management module of the routing scheduling center;

[0135] Step S2: Set the RTN network topology and computing power deployment information through the portal;

[0136] Step S3: The routing scheduling center sends the network topology and operators to each node;

[0137] Step S4: Network detection and detection data reporting, operator status reporting;

[0138] Step S5: Business request, determine whether intelligent computing is required;

[0139] Step S6: The routing and dispatching center sends the path to the client and, when intelligent computing is required, sends the processing task to the RTN network node.

[0140] Step S7: The RTN network node performs intelligent calculation processing on the data according to the processing task;

[0141] Step S8: forward the processed data and the encapsulated path to the next hop node;

[0142] Step S9: The client receives the data and decapsulates it to obtain the original data.

[0143] Through the embodiments of the present disclosure, the integrated scheduling of transmission and computing can be realized, solving the problems of separation of media transmission network and computing unit and high data transmission delay in related technologies, and improving the overall service capability and user experience of the RTN network.

[0144] FIG10 is a partial flow diagram (I) of a data transmission method according to an embodiment of the present disclosure. As shown in FIG10 , the process includes the registration, configuration, and delivery processes in steps S1 to S3 above. The specific contents are as follows:

[0145] Step S1: The client and RTN network node register with the topology management module of the routing scheduling center;

[0146] Step S2: After registration is completed, the topology management module of the routing scheduling center saves the client, RTN network nodes and the link relationship between them in the RTN system configured by the user, and saves part of the computing power of the computing module in each RTN network node.

[0147] In step S3, after the topology relationship and computing power capacity configuration are completed, the detection management module of the routing scheduling center sends the relevant network topology link relationship to the client and RTN network node, and instructs them to start detection; at the same time, the operator management module of the routing scheduling center sends operators to each RTN network node according to the pre-configured capabilities.

[0148] In this embodiment, the operator is a specific algorithm unit, including algorithm type, input and output and other related parameters.

[0149] FIG11 is a partial flow diagram (II) of the data transmission method according to an embodiment of the present disclosure. As shown in FIG11 , the process includes the network detection, detection data, and operator status reporting processes in step S4 above. The specific contents are as follows:

[0150] Step S4-1: After receiving the detection request from the routing scheduling center, the link detection module of the client and the RTN network node immediately starts the detection request of the link network parameters;

[0151] Step S4-2, reporting the detection results to the path planning module of the routing scheduling center at regular intervals;

[0152] In step S4-3, the operator task synchronization module of each RTN network node reports the operator capability and operator usage of the current node to the operator management module of the routing scheduling center.

[0153] FIG12 is a partial flow diagram (III) of the data transmission method according to an embodiment of the present disclosure. As shown in FIG12 , the process includes the task issuing process in steps S5 to S6 above. The specific contents are as follows:

[0154] In step S5, when client A sends data to other clients via the RTN network, it first sends a service request to the routing and dispatching center. The routing and dispatching center's path planning module determines whether intelligent computing processing is required based on the client's service needs. The routing and dispatching center's path planning module plans the path based on the topological relationship between the client and RTN network nodes, real-time detection data, and the RTN network node operators, and then generates an operator execution task.

[0155] In step S6, the routing scheduling center returns the real-time calculated transmission path to client A and simultaneously issues a processing task (including session identifier, operator type, computing task description, and other information) to the designated RTN network node. The processing task is associated with the data packet carrying the media data through the session identifier.

[0156] FIG13 is a partial flow diagram (IV) of the data transmission method according to an embodiment of the present disclosure. As shown in FIG13 , the flow includes the path encapsulation and intelligent calculation process in steps S7 to S9 above. The specific contents are as follows:

[0157] In step S7, the path control module of the client encapsulates the session identifier, path length, and transmission path into the original data, and then the transceiver module of the client sends the encapsulated data to the next hop (edge ​​node in the RTN network).

[0158] In step S8, after receiving the forwarded data, the RTN network node first decapsulates the data and then, based on the session identifier, queries whether the current node has a processing task to perform. If there is no processing task, the current node's information in the transmission path is removed and the path length field is updated. This exposes the information of the next node in the path to facilitate rapid data forwarding. The data is then encapsulated and forwarded to the next hop. If there is a processing task requiring intelligent computation at the current node, the data is input into a designated operator for intelligent computation based on the specific processing task. After processing is complete, the processed data is encapsulated and forwarded to the next hop.

[0159] Step S9: After receiving the data, the destination client (client B) decapsulates the encapsulated data, obtains the processed data, and continues to display the relevant content on client B.

[0160] In an exemplary embodiment, the data packet encapsulated in step S7 includes: a session identifier, a path length, a transmission path, and the original data. The transmission path for the original data obtained from the routing scheduling center is 1-2-3-B (indicating that it passes through RTN network nodes 1 to 3 in sequence and ultimately reaches client B). During the transmission process, each RTN network node is deleted from the transmission path, and the path length is reduced by one.

[0161] An embodiment of the present disclosure further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above method embodiments are executed.

[0162] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.

[0163] An embodiment of the present disclosure further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments.

[0164] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0165] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0166] Obviously, those skilled in the art should understand that the modules or steps of the present disclosure described above can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices, they can be implemented using program code executable by the computing device, and thus, they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be performed in a different order than herein, or they can be fabricated into separate integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module for implementation. Thus, the present disclosure is not limited to any particular combination of hardware and software.

[0167] The above description is merely a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Those skilled in the art will readily appreciate that the present disclosure is susceptible to various modifications and variations. Any modifications, equivalent substitutions, or improvements made within the principles of the present disclosure shall be within the scope of protection of the present disclosure.

Claims

1. A data transmission method for a real-time audio and video transmission network, applied to a node, the method comprising: receiving, from a previous hop node, a first session message carrying first data; Determining whether the first data is processed by the current node according to the processing task pre-issued by the routing scheduling center and the first session message; If the judgment result is yes, the first data is processed according to the processing task to obtain second data; Sending the second session message carrying the second data to the next hop node.

2. The method according to claim 1, wherein: The processing task includes: a session identifier, an operator type, and task description information; the session message includes: a session identifier, a path length, and a transmission path, wherein the session message includes the first session message and the second session message.

3. The method according to claim 2, wherein: Determining whether the first data is processed by the current node according to the processing task pre-issued by the routing scheduling center and the first session message includes: comparing the session identifier of the processing task with the session identifier of the first session message; When the session identifier of the processing task is the same as the session identifier of the first session message, determining that the first data is processed by the current node; When the session identifier of the processing task is different from the session identifier of the first session message, it is determined that the first data is not processed by the current node.

4. The method according to claim 2, wherein: Processing the first data according to the processing task to obtain second data includes: Determining a target operator from operators pre-issued by the routing scheduling center according to the operator type; The first data is input into the target operator according to the task description information to obtain the second data output by the target operator.

5. The method according to claim 2, wherein: Before sending the second session message carrying the second data to the next hop node, the method further includes: removing the path information of the current node from the transmission path of the first session message to obtain the transmission path of the second session message; Subtracting one from the path length of the first session message to obtain the path length of the second session message, wherein the path length is used to indicate the number of nodes included in the transmission path; The next hop node is determined according to a transmission path of the second session message.

6. The method according to claim 5, wherein: After determining whether the first data is processed by the current node according to the processing task pre-issued by the routing scheduling center and the first session message, the method further includes: If the judgment result is no, the second session message carrying the first data is sent to the next hop node.

7. The method according to claim 1, wherein: Before determining whether the first data is processed by the current node according to the processing task pre-issued by the routing scheduling center and the first session message, the method further includes: The processing task is obtained from the routing scheduling center, wherein the routing scheduling center is used to perform path planning according to the service request, network topology, link detection data, operators of each node, and operator usage after receiving the service request of the initial node, and generate the processing task and transmission path information.

8. The method according to claim 7, wherein: Before obtaining the processing task from the routing scheduling center, the method further includes: Register with the routing scheduling center, wherein the routing scheduling center is used to save the network topology relationship between each node and the operator of each node according to the user configuration result after each node is registered.

9. The method according to claim 8, wherein: After registering with the routing scheduling center, the method further includes: Obtaining a network topology relationship related to the current node issued by the routing scheduling center; Performing network detection according to a network topology relationship related to the current node to obtain link detection data of the current node; The link detection data of the current node is reported to the routing scheduling center at regular intervals.

10. The method according to claim 8, wherein: After registering with the routing scheduling center, the method further includes: Obtaining the operator sent by the routing scheduling center, wherein the operator includes an algorithm type and algorithm parameters; The operator usage of the current node is reported to the routing scheduling center regularly.

11. A data transmission method for a real-time audio and video transmission network, applied to a routing dispatch center, the method comprising: Receive a service request sent by an initial node; Obtain the pre-saved network topology, link detection data reported by each node, operators, and operator usage; Perform path planning according to the service request, the network topology, the link detection data, the operator, and the operator usage, and generate transmission path information and a processing task of a target node; The transmission path information is sent to the initial node, and the processing task is sent to the target node, wherein the initial node is used to send the first data according to the transmission path information, and the target node is used to process the first data according to the processing task when the first data passes through.

12. The method according to claim 11, wherein: The processing task includes: session identifier, operator type, and task description information; the transmission path information includes: session identifier, path length, and transmission path.

13. The method according to claim 11, wherein: Before receiving the service request sent by the initial node, the method further includes: Receiving registration information of each node to register the node, wherein the registration information includes at least one of the following: node identification, node computing capability, and node service capability; The network topology relationship between the nodes and the operator of each node are user-configured according to the registration information, and the network topology relationship and the operator are saved according to the user configuration result.

14. The method according to claim 13, wherein: After performing user configuration on the network topology relationship between the nodes and the operator of each node according to the registration information, and saving the network topology relationship and the operator according to the user configuration result, the method further includes: Sending corresponding network topology relationship to each node according to the user configuration result; Instructing each node to perform network detection according to the corresponding network topology relationship to obtain link detection data, wherein the link detection data includes at least one of the following: packet loss rate, delay data, jitter data, and audio and video freeze rate; The link detection data reported periodically by each of the nodes is received respectively.

15. The method according to claim 13, wherein: After performing user configuration on the network topology relationship between the nodes and the operator of each node according to the registration information, and saving the network topology relationship and the operator according to the user configuration result, the method further includes: According to the user configuration result, the corresponding operator is respectively sent to each node, wherein the operator includes an algorithm type and an algorithm parameter; The operator usage status reported regularly by each node is received respectively.

16. The method according to claim 11, wherein: Performing path planning according to the service request, the network topology relationship, the link detection data, the operator, and the operator usage, generating transmission path information and a processing task of a target node, including: Generate the transmission path information according to the service request, the network topology relationship and the link detection data; A processing task for the target node is generated according to the service request, the operator, and the usage of the operator.

17. The method according to claim 16, generating a processing task for the target node according to the service request, the operator, and the usage of the operator, comprises: Determine a processing task for the first data according to the business request, wherein the processing task includes an operator type and task description information; The target node is determined from the transmission path information according to the operator type, the operator, and the operator usage.

18. A data transmission system for a real-time audio and video transmission network, the system comprising: Routing dispatch center, multiple nodes; A routing scheduling center is configured to receive a service request sent by an initial node; Obtaining the pre-saved network topology relationship, the link detection data reported by each node, the operator and the operator usage; performing path planning according to the service request, the network topology relationship, the link detection data, the operator and the operator usage, and generating the transmission path information and the processing task of the target node; Sending the transmission path information to the initial node, and sending the processing task to the target node, wherein the initial node is used to send the first data according to the transmission path information, and the target node is used to process the first data according to the processing task when the first data passes through; The node is configured to receive a first session message carrying the first data from a previous hop node; determine whether the first data is processed by a current node according to the processing task and the first session message; if the determination result is yes, process the first data according to the processing task to obtain second data; and send a second session message carrying the second data to a next hop node.

19. A computer-readable storage medium, wherein a computer program is stored in the storage medium, wherein: When the computer program is executed by a processor, the method described in any one of claims 1 to 17 is executed.

20. An electronic device comprising a memory and a processor, wherein: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 17.

Images