Data transmission method and system for real-time audio and video transmission network

Abstract

The embodiments of the present disclosure provide a data transmission method and system for a real-time audio and video transmission network. The method comprises: obtaining a first data packet carrying initial data, wherein the initial data comprises media data of various different data types; on the basis of pre-detected network status information of a next-hop node, determining a network evaluation score of the next-hop node; on the basis of a pre-configured weak network resistance strategy and the network evaluation score, determining a plurality of target strategies, wherein each target strategy corresponds to media data of one data type; and on the basis of the plurality of target strategies, processing the media data of various different data types, and sending a second data packet carrying the processed data to the next-hop node.

Description

A data transmission method and system for real-time audio and video transmission network

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This disclosure is based on Chinese patent application CN202311178375.2, filed on September 13, 2023, entitled “A data transmission method and system for a real-time audio and video transmission network”, and claims the priority of the patent application, and all the contents disclosed therein are incorporated into this disclosure by reference. Technical Field

[0003] The present disclosure relates to the field of communications, and in particular to a data transmission method and system for a real-time audio and video transmission network. Background Art

[0004] With the continuous development of the Internet, audio and video media data has become the main part of Internet traffic. In recent years, the development of scenarios such as cloud gaming, interactive live broadcasting, cloud computing, distance education, and video conferencing has also promoted the rapid development of real-time audio and video transmission network (RTN) technology.

[0005] The current RTN system lacks targeted anti-weak network strategies for various scenarios, various media streams, and various video frame types. The same anti-weak network strategy is adopted for different services, different media streams, and different video frame types. As a result, the overall transmission effect of the RTN network is poor when the RTN network transmission capacity approaches saturation or in some weak network environments.

[0006] In summary, there is no good solution to the above problems.

[0007] Summary of the Invention

[0008] The embodiments of the present disclosure provide a data transmission method and system for a real-time audio and video transmission network, so as to at least solve the problem in the related art that the RTN network adopts a unified anti-weak network strategy, resulting in poor data transmission effect in a weak network environment.

[0009] According to one embodiment of the present disclosure, a data transmission method for a real-time audio and video transmission network is provided, the method comprising: obtaining a first data packet carrying initial data, wherein the initial data includes media data of multiple different data types; determining a network evaluation score of the next hop node based on network status information of the next hop node detected in advance; determining multiple target strategies based on a pre-configured anti-weak network strategy and the network evaluation score, wherein each target strategy corresponds to media data of one data type; processing the media data of multiple different data types according to the multiple target strategies, and sending a second data packet carrying the processed data to the next hop node.

[0010] According to another embodiment of the present disclosure, a data transmission system for a real-time audio and video transmission network is provided, the system comprising: a routing scheduling center and multiple real-time audio and video transmission network (RTN) nodes; the routing scheduling center is configured to configure network topology relationships and weak network resistance strategies for the multiple RTN nodes, and instruct the multiple RTN nodes to perform network detection based on the network topology relationships to obtain link detection data; the RTN nodes are configured to obtain a first data packet carrying initial data, wherein the initial data includes media data of multiple different data types; determine a network evaluation score of the next hop node based on pre-detected network status information of the next hop node, wherein the link detection data includes the network status information of the next hop node; determine multiple target strategies based on the pre-configured weak network resistance strategies and network evaluation scores, wherein each target strategy corresponds to media data of a data type; process the multiple different data types of media data according to the multiple target strategies, and send a second data packet carrying the processed data to the next hop node.

[0011] According to another embodiment of the present disclosure, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above method embodiments are executed.

[0012] According to another embodiment of the present disclosure, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] FIG1 is a hardware structure block diagram of a data transmission method of an RTN network according to an embodiment of the present disclosure;

[0014] FIG2 is a flow chart of a data transmission method of a real-time audio and video transmission network according to an embodiment of the present disclosure;

[0015] FIG3 is a schematic diagram of a weak network resistance strategy for a video conferencing scenario according to an embodiment of the present disclosure;

[0016] FIG4 is a schematic structural diagram of a real-time audio and video transmission network according to an embodiment of the present disclosure;

[0017] FIG5 is a structural block diagram of a routing and scheduling center according to an embodiment of the present disclosure;

[0018] FIG6 is a structural block diagram of a client according to an embodiment of the present disclosure;

[0019] FIG7 is a structural block diagram of an RTN network node according to an embodiment of the present disclosure;

[0020] FIG8 is a schematic diagram of the overall flow of a data transmission method according to an embodiment of the present disclosure;

[0021] FIG9 is a partial flow diagram of a data transmission method according to an embodiment of the present disclosure (I);

[0022] FIG10 is a partial flow diagram of a data transmission method according to an embodiment of the present disclosure (II);

[0023] FIG11 is a partial flow diagram of a data transmission method according to an embodiment of the present disclosure (III);

[0024] FIG12 is a partial flow chart of a data transmission method according to an embodiment of the present disclosure (IV). DETAILED DESCRIPTION

[0025] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and in conjunction with embodiments.

[0026] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0027] The method embodiments provided in the present disclosure are applied to a real-time audio and video transmission network (RTN) and can be executed by network devices in the RTN network, such as nodes, servers, switches, and user terminals. User terminals can include mobile terminals, computer terminals, and the like. Taking a computer terminal as an example, FIG1 is a hardware block diagram of the data transmission method for an RTN network according to the present disclosure. As shown in FIG1 , the hardware board may include one or more (only one is shown in FIG1 ) processors 12 (processor 12 may include, but is not limited to, a microprocessor (MCU) or a processing device such as a programmable logic device) and a memory 14 for storing data. The mobile terminal may also include a transmission device 16 and input / output devices 18 for communication functions. Those skilled in the art will appreciate that the structure shown in FIG1 is merely illustrative and does not limit the structure of the computer terminal described above. For example, the mobile terminal may include more or fewer components than shown in FIG1 , or have a configuration different from that shown in FIG1 .

[0028] The memory 14 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the data transmission method in the embodiment of the present disclosure. The processor 12 executes various functional applications and data transmission methods by running the computer programs stored in the memory 14, that is, implementing the above-mentioned method. The memory 14 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 14 may further include a memory remotely located relative to the processor 12, and these remote memories may be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0029] The transmission device 16 is used to receive or send data via a network. Specific examples of the aforementioned network may include a wireless network provided by a communications provider. In one embodiment, the transmission device 16 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the transmission device 16 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0030] In one embodiment of the present disclosure, a data transmission method for a real-time audio and video transmission network is provided. FIG2 is a flow chart of the data transmission method for a real-time audio and video transmission network according to an embodiment of the present disclosure. As shown in FIG2 , the flow chart includes the following steps:

[0031] Step S202: obtaining a first data packet carrying initial data, wherein the initial data includes media data of multiple different data types;

[0032] Step S204, determining a network evaluation score of the next hop node based on the pre-detected network status information of the next hop node;

[0033] Step S206, determining a plurality of target strategies according to the pre-configured weak network resistance strategy and the network evaluation score, wherein each target strategy corresponds to a data type of media data;

[0034] Step S208: Process the media data of the multiple different data types according to the multiple target policies, and send a second data packet carrying the processed data to the next hop node.

[0035] In the embodiment of the present disclosure, through the above steps S202 to S208, different weak network resistance strategies can be formulated for different media data. During the data transmission process, the media data is adaptively adjusted according to the real-time network status and specific data type of the next hop node. This solves the problem in the related art that the RTN network adopts a unified weak network resistance strategy, resulting in poor data transmission performance in a weak network environment. This improves the data transmission performance of the RTN network and ensures user experience.

[0036] The embodiments of the present disclosure can be applied to scenarios related to real-time audio and video communications, such as augmented reality (AR), virtual reality (VR), cloud gaming, interactive live broadcasting, cloud computing, distance education, video conferencing, video surveillance, and various applications that provide various application services to users through the Internet (Over The Top, OTT).

[0037] In some embodiments, the first data packet also carries the service type of the initial data. The service type may include video conferencing, video surveillance, or other RTN network application scenarios. The present disclosure does not limit the RTN network application scenarios.

[0038] In this embodiment, step S206 may include the following steps:

[0039] Step S2062, determining a target weak network resistance strategy corresponding to the service type according to the preset weak network resistance strategy;

[0040] Step S2064 : determining a plurality of target strategies corresponding to the media data of the plurality of different data types according to the target weak network resistance strategy, the network evaluation score, and the data type.

[0041] In some embodiments, the data type includes at least one of the following: audio stream, auxiliary video stream I frame, auxiliary video stream P frame, auxiliary video stream B frame, main video stream I frame, main video stream P frame, main video stream B frame.

[0042] In the disclosed embodiments, different media streams have different priorities in different business scenarios. For example, in a video conference, the audio stream has a higher priority than the video stream. Among video streams, the auxiliary video stream has a higher priority than the main video stream. Among video frames, I frames have a higher priority than P frames, and P frames have a higher priority than B frames. By formulating different weak network protection strategies for different media data, higher priority data can be provided with more weak network protection, which can improve data transmission efficiency and ensure user experience.

[0043] In some embodiments, the target strategy includes at least one of the following: normal packet transmission, retransmission (RTX) upon packet loss, forward error correction (FEC), and frame loss.

[0044] In some embodiments, the first data packet and the second data packet further carry a path length and a transmission path.

[0045] In this embodiment, after step S202, the method may further include step S203 of determining a next hop node according to the first data packet.

[0046] In some embodiments, step S203 may include the following steps:

[0047] Step S2032: removing the path information of the current node from the transmission path of the first data packet to obtain the transmission path of the second data packet;

[0048] Step S2034: Subtract one from the path length of the first data packet to obtain the path length of the second data packet, wherein the path length is used to indicate the number of nodes included in the transmission path;

[0049] Step S2036: Determine the next hop node according to the transmission path of the second data packet.

[0050] In some embodiments, the network status information in step S204 includes at least one of the following: round-trip delay, maximum round-trip delay, packet loss rate, and retransmission rate.

[0051] In some embodiments, step S204 may include: determining a network evaluation score of the next hop node according to the round-trip delay, the maximum round-trip delay, the packet loss rate, and the retransmission rate.

[0052] In some embodiments, step S204 may further include: determining a network evaluation score of the next hop node according to the ratio of the round-trip delay to the maximum round-trip delay, the packet loss rate, the retransmission rate, and a preset weight value.

[0053] In an exemplary embodiment, the network evaluation score of the next hop node may be calculated using the following formula: net_score=1 / exp(k1*rtt / rtt_max+k2*loss_rate+k3*retrans_rate)*100;

[0054] Where net_score is the network evaluation score, k1, k2, and k3 are the weights of round-trip delay, packet loss rate, and retransmission rate, respectively. The specific values ​​can be configured according to the needs of different scenarios. rtt is the round-trip delay, rtt_max is the maximum round-trip delay, loss_rate is the packet loss rate, and retrans_rate is the retransmission rate.

[0055] In some embodiments, before step S202, the method further includes step S2002, registering with a routing scheduling center, wherein the routing scheduling center is used to save the network topology relationship between each node and the anti-weak network strategy of each node according to the user configuration result after each node is registered.

[0056] In some embodiments, after step S2002, the method further includes the following steps:

[0057] Step S2004: obtaining the network topology relationship associated with the current node and the corresponding weak network resistance strategy issued by the routing scheduling center;

[0058] Step S2006: Perform network detection according to the network topology relationship to obtain link detection data of the current node, wherein the link detection data includes network status information of the next hop node;

[0059] Step S2008: reporting the link detection data of the current node to the routing scheduling center on a regular basis.

[0060] Through the disclosed embodiments, different weak network protection strategies can be formulated for media stream types and video frame types. When the RTN network's transmission capacity approaches saturation or in some weak network environments, high-priority data can be given more weak network protection. This can address the problem of RTN networks using a unified weak network protection strategy in related technologies, resulting in poor data transmission performance in weak network environments. This improves the data transmission performance of the RTN network and ensures a better user experience.

[0061] FIG3 is a schematic diagram of a weak network resistance strategy for a video conferencing scenario according to an embodiment of the present disclosure. As shown in FIG3 , the weak network resistance strategy can be formulated for different business scenarios, different media streams, and different video frames.

[0062] In some embodiments, the network evaluation score (eg, 0-100) can be divided into multiple network ratings, such as excellent, good, medium, and poor. During the user configuration phase, it is only necessary to configure an anti-weak network strategy for each network rating.

[0063] In some embodiments, data types can be distinguished according to media stream type and video frame type. Data types may include: audio stream, auxiliary video stream I frame, auxiliary video stream P frame, auxiliary video stream B frame, main video stream I frame, main video stream P frame, and main video stream B frame.

[0064] In some embodiments, the processing strategy may include one or a combination of normal packet transmission, normal retransmission, no retransmission, forward error correction (FEC), and frame loss. Forward error correction adds redundant code to the original data to improve the success rate of data transmission. The coding redundancy can be configured in the processing strategy, such as 40% FEC.

[0065] In some embodiments, multiple RTN nodes in the RTN network may be configured with the same or different weak network resistance strategies respectively.

[0066] According to another aspect of the embodiments of the present disclosure, a data transmission system for a real-time audio and video transmission network is provided.

[0067] In this embodiment, the system includes: a routing scheduling center and a plurality of real-time audio and video transmission network RTN nodes.

[0068] In this embodiment, the routing scheduling center is used to configure the network topology relationship and weak network resistance strategy of multiple RTN nodes, and instruct the multiple RTN nodes to perform network detection according to the network topology relationship to obtain link detection data.

[0069] In this embodiment, an RTN node is configured to obtain a first data packet carrying initial data, wherein the initial data includes media data of multiple different data types; determine a network evaluation score of the next hop node based on pre-detected network status information of the next hop node, wherein the link detection data includes the network status information of the next hop node; determine multiple target strategies based on a pre-configured weak network resistance strategy and the network evaluation score, wherein each target strategy corresponds to media data of a data type; process the media data of the multiple different data types according to the multiple target strategies, and send a second data packet carrying the processed data to the next hop node.

[0070] FIG4 is a schematic diagram of the structure of a real-time audio and video transmission network according to an embodiment of the present disclosure. As shown in FIG4 , the network includes the following structures:

[0071] Routing scheduling center 42 , RTN network node 44 and client 46 .

[0072] In some embodiments, the RTN network node 44 and the client 46 are both a type of RTN node. The RTN network node and the client can perform the steps in any of the above method embodiments.

[0073] In some embodiments, RTN network nodes include edge nodes and intermediate forwarding nodes, which are responsible for client access and data forwarding, and perform anti-weak network processing on different data according to preset strategies; they are also responsible for receiving data detection requests from the routing scheduling center, detecting the network parameters of the clients and transit nodes connected to them, and reporting the detection results to the routing scheduling center.

[0074] In some embodiments, the client can be an audio / video terminal or a related software development kit (SDK). It is primarily responsible for generating or displaying audio / video media data, processing audio / video services (including acquisition, encoding / decoding, and rendering), querying data transmission paths and assembling packets, and transmitting and receiving audio / video data. It also detects and reports the link quality between the client and the RTN network node.

[0075] In an exemplary embodiment, the client types uniformly cover the audio and video media display part and the audio and video media generation part. For example, a video conferencing scenario may include a PC client, a mobile client, and a conference terminal in a conference room; a cloud desktop scenario includes a thin terminal, a PC terminal, and a back-end server; and an AR / VR scenario includes VR glasses, a head-mounted terminal, and a back-end server.

[0076] In an exemplary embodiment, the client may also receive the anti-weak network strategy issued by the routing scheduling center, and process the original data in advance according to the network status of the next hop node before encapsulating the original data.

[0077] In some embodiments, the routing scheduling center is responsible for the management of the overall network topology, the management and distribution of the overall flow-level anti-weak network strategy, and distributes link detection requests to clients, edge nodes, and transit nodes, and collects link detection data reported by clients, edge nodes, and forwarding nodes. The data transmission path is uniformly planned based on the link detection data and network topology relationships between each node, and the planned path is distributed to the client.

[0078] In some embodiments, the routing scheduling center may further quantify the link detection data and convert it into a specific link quality index. The routing scheduling center may further perform path planning based on the quantified link quality index.

[0079] FIG5 is a structural block diagram of a routing and scheduling center according to an embodiment of the present disclosure. As shown in FIG5 , the routing and scheduling center may be composed of the following functional modules:

[0080] Topology management module 51 , anti-weak network strategy management module 52 , detection management module 53 , data quantization module 54 , and path planning module 55 .

[0081] The topology management module 51 is responsible for managing the topology of the entire RTN network, including operations such as adding and deleting RTN network nodes and changing the connection relationship between nodes.

[0082] The weak network resistance strategy management module 52 is responsible for managing the weak network resistance strategy of the entire RTN system, formulating corresponding weak network resistance strategies for different service scenarios, and issuing the weak network resistance strategies to clients and RTN network nodes.

[0083] The detection management module 53 is responsible for sending detection requests to the client and the RTN network node, and is responsible for receiving detection data reported by the client and the RTN network node.

[0084] The data quantization module 54 is responsible for quantifying the received link detection data such as packet loss, delay, jitter, available bandwidth, node load, etc. to obtain the quality index of the corresponding link.

[0085] The path planning module 55 is responsible for planning the path according to the network topology relationship between the client and the RTN network nodes and the quality of the link to form the optimal forwarding path.

[0086] FIG6 is a structural block diagram of a client according to an embodiment of the present disclosure. As shown in FIG6 , the client may be composed of the following functional modules:

[0087] Media content module 62 , path control module 64 , first data transceiver module 66 , and first link detection module 68 .

[0088] The media content module 62 is responsible for processing related services such as the production / display of audio and video media.

[0089] The path control module 64 is responsible for receiving the data forwarding path sent by the routing scheduling center and encapsulating the original data into a new data packet according to the path.

[0090] The first data transceiver module 66 is responsible for data transmission and reception, sending the encapsulated data to the next hop according to the path information indicated in the transmission path, and is responsible for completing the execution of the flow-level anti-weak network strategy.

[0091] The first link detection module 68 is responsible for registering with the detection management of the routing scheduling center and receiving the detection request instructions issued by it. The instructions will include the specific nodes that need to be detected, such as the edge nodes directly associated with the client. After receiving the instructions, link detection will be performed immediately. The detection indicators include packet loss, delay, jitter, available bandwidth, node load, etc. After the detection is completed, the specific detection parameters will be sent to the detection management module of the routing scheduling center at a regular interval.

[0092] In an exemplary embodiment, the format of the data packet encapsulated by the path control module mainly includes four parts: service type, data type, transmission path information, and original data.

[0093] Service Type: Used to indicate different service types. Different service types have different weak network protection strategies, such as video conferencing and video surveillance.

[0094] Data type: used to indicate different data types, media stream types, and video frame types, such as audio stream, auxiliary video stream I-frame, auxiliary video stream P-frame, auxiliary video stream B-frame, primary video stream I-frame, primary video stream P-frame, and primary video stream B-frame.

[0095] Transmission path information: includes path length and transmission path. The path length indicates the number of subsequent path hops to be transmitted. The transmission path records specific node information, including the IP address and port information of the specific node. Each time the data is forwarded through a network node, the path length is reduced by one, and the current node is removed from the transmission path. For example, if the transmission path is 1-2-3, after being forwarded through node 1, the new transmission path is 2-3.

[0096] Raw data: original media data.

[0097] FIG7 is a structural block diagram of an RTN network node according to an embodiment of the present disclosure. As shown in FIG7 , the RTN network node may be composed of the following functional modules:

[0098] The second link detection module 72 , the anti-weak network strategy synchronization module 74 , and the second data transceiver module 76 .

[0099] The second link detection module 72 is responsible for registering with the detection management module of the routing scheduling center and receiving the detection request instruction. The instruction will include the specific forwarding node that needs to be detected. After receiving the instruction, the link detection will be performed immediately. The detection indicators include packet loss, delay, jitter, available bandwidth, node load, etc. After the detection is completed, the specific detection parameters will be sent to the detection management module of the routing scheduling center at a regular interval.

[0100] The anti-weak network policy synchronization module 74 is responsible for receiving anti-weak network policies of different service types from the anti-weak network policy management module of the routing scheduling center.

[0101] The second data transceiver module 76 is responsible for client access, data reception, path data decapsulation, new path data encapsulation, data forwarding, and is responsible for performing anti-weak network operations according to the anti-weak network strategy.

[0102] FIG8 is a schematic diagram of the overall process of a data transmission method according to an embodiment of the present disclosure. As shown in FIG8 , the process includes the following steps:

[0103] Step S1: The client and RTN network node register with the topology management module of the routing scheduling center;

[0104] Step S2: Set the RTN network topology and anti-weak network configuration information for different business scenarios through the portal;

[0105] Step S3: The routing scheduling center sends a detection request and a weak network resistance strategy to each node;

[0106] Step S4: network detection and detection data reporting;

[0107] Step S5: The routing dispatch center performs path planning;

[0108] Step S6: The client obtains the transmission path information from the routing scheduling center, encapsulates the original data, and adds information such as service type, data type, path length, and transmission path;

[0109] Step S7: The client and the RTN network node perform weak network resistance processing on the data according to the network evaluation of the next hop node and the weak network resistance strategy of the corresponding service;

[0110] Step S8: forward the processed data and the encapsulated path to the next hop node;

[0111] Step S9: The client receives the data and decapsulates it to obtain the original data.

[0112] Through the embodiments of the present disclosure, different weak network resistance strategies can be formulated for different media data. During the data transmission process, the corresponding weak network resistance strategy is determined based on the real-time network status of the next-hop node and the specific data type. This solves the problem in related technologies that the RTN network adopts a unified weak network resistance strategy, resulting in poor data transmission performance in weak network environments. This improves the data transmission performance of the RTN network and ensures user experience.

[0113] FIG9 is a partial flow diagram of a data transmission method according to an embodiment of the present disclosure (I). As shown in FIG9 , the process includes the registration, configuration, and delivery processes in steps S1 to S3 above. The specific contents are as follows:

[0114] Step S1: The client and RTN network node register with the topology management module of the routing scheduling center;

[0115] Step S2: After registration is completed, the network topology configuration and anti-weak network policy configuration are performed through the portal configuration. The topology management module of the routing scheduling center saves the network topology relationship configured by the user, and the anti-weak network policy management module of the routing scheduling center saves the anti-weak network policy configuration under different scenarios.

[0116] In step S3, after the network topology and weak network protection policy are configured, the detection management module of the routing scheduling center sends the relevant network topology to the client and RTN network nodes and instructs them to start detection. At the same time, the weak network protection policy management module of the routing scheduling center sends the policy to the client and each RTN network node based on the pre-configured weak network protection policy.

[0117] FIG10 is a partial flow diagram (II) of the data transmission method according to an embodiment of the present disclosure. As shown in FIG10 , the process includes the network detection and data reporting process in step S4 above. The specific contents are as follows:

[0118] Step S4-1: After receiving the detection request from the routing scheduling center, the link detection module of the client and the RTN network node immediately starts the detection request of the link network parameters;

[0119] Step S4-2: reporting the detection results to the path planning module of the routing scheduling center at regular intervals.

[0120] FIG11 is a partial flow diagram (III) of a data transmission method according to an embodiment of the present disclosure. As shown in FIG11 , the flow includes the path query and packetization processes in steps S5 to S7 above. The specific contents are as follows:

[0121] In step S5, when client A sends data to client B through the RTN network, client A queries the path planning module of the routing scheduling center for the transmission path. The path planning module of the routing scheduling center plans the path based on the topological relationship between the client and the RTN network nodes and the real-time detection data.

[0122] In step S6, the routing scheduling center returns the transmission path calculated in real time to client A.

[0123] In step S7, the client path control module encapsulates the service type, data type, path length, and transmission path into the original data, and then the client's transceiver module sends the encapsulated data to the next-hop edge node.

[0124] In an exemplary embodiment, the transmission path information sent by the routing scheduling center in step S6 includes: service type, path length and specific transmission path. The encapsulated data packet in step S7 includes: service type, data type, path length, transmission path and original data.

[0125] FIG12 is a partial flow diagram (IV) of the data transmission method according to an embodiment of the present disclosure. As shown in FIG12 , the flow includes the data processing flow of the anti-weak network in steps S8 to S9 above, and the specific contents are as follows:

[0126] Step S8: After receiving the forwarded data, the RTN network node calculates the network status of the next hop and performs different weak network protection processing according to different network ratings.

[0127] In step S9, after receiving the data, the destination client decapsulates the encapsulated data, obtains the original data, and then continues to display the relevant content.

[0128] In one exemplary embodiment, the original media data (A+V1+V2) obtained from the routing and scheduling center has a service type of 01 (indicating video conferencing) and a transmission path of 1-2-3-B (indicating it passes sequentially through RTN network nodes 1 to 3 and ultimately reaches client B). During transmission, RTN network node 2 obtains a medium real-time network rating between RTN network nodes 2 and 3. Based on the corresponding service scenario's anti-weak network strategy, the anti-weak network strategy is to discard the primary video data frame V2 and forward audio A and auxiliary video V1. Furthermore, the path information of this node is removed from the transmission path, and the path length field is updated. This exposes the information of the next node in the path to facilitate rapid data forwarding. The data is then encapsulated and forwarded to the next hop. This completes the data's flow-level anti-weak network transmission process within the RTN network.

[0129] The disclosed embodiments address the problem that the current RTN system lacks targeted weak network mitigation strategies for various scenarios, media streams, and video frame types. The same weak network mitigation strategy is adopted for different services, media streams, and video frame types, resulting in poor overall transmission performance of the RTN network when the RTN network transmission capacity approaches saturation or in some weak network environments. The disclosed embodiments propose a flow-level weak network mitigation system in the RTN network. By formulating targeted weak network mitigation strategies for different service scenarios, media streams, and video frames, this system fully utilizes the RTN network's carrying capacity while ensuring user experience and overall improving the RTN network's transmission capacity.

[0130] An embodiment of the present disclosure further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above method embodiments are executed.

[0131] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.

[0132] An embodiment of the present disclosure further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0133] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0134] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0135] Obviously, those skilled in the art should understand that the modules or steps of the present disclosure described above can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices, they can be implemented using program code executable by the computing device, and thus, they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be performed in a different order than herein, or they can be fabricated into separate integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module for implementation. Thus, the present disclosure is not limited to any particular combination of hardware and software.

[0136] The foregoing description is merely a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Those skilled in the art will readily appreciate that various modifications and variations of the present disclosure are possible. Any modifications, equivalent substitutions, or improvements made within the principles of the present disclosure shall be included within the scope of protection of the present disclosure.

Claims

1. A data transmission method for a real-time audio and video transmission network, the method comprising: Acquire a first data packet carrying initial data, wherein the initial data includes media data of multiple different data types; Determine a network evaluation score of the next hop node according to the network status information of the next hop node detected in advance; Determine a plurality of target strategies according to a pre-configured weak network resistance strategy and the network evaluation score, wherein each of the target strategies corresponds to media data of a data type; The media data of the multiple different data types are processed according to the multiple target strategies, and a second data packet carrying the processed data is sent to the next hop node.

2. The method according to claim 1, wherein: The first data packet also carries the service type of the initial data, and multiple target strategies are determined according to the pre-configured weak network resistance strategy and the network evaluation score, including: Determine a target weak network resistance strategy corresponding to the service type according to a preset weak network resistance strategy; A plurality of target strategies corresponding to the media data of the plurality of different data types are respectively determined according to the target weak network resistance strategy, the network evaluation score, and the data type.

3. The method according to claim 1, wherein: The data type includes at least one of the following: audio stream, auxiliary video stream I frame, auxiliary video stream P frame, auxiliary video stream B frame, main video stream I frame, main video stream P frame, main video stream B frame.

4. The method according to claim 1, wherein: The target strategy includes at least one of the following: normal packet transmission, packet loss retransmission, forward error correction coding, and frame loss.

5. The method according to claim 1, wherein: The first data packet and the second data packet also carry a path length and a transmission path. After acquiring the first data packet carrying the initial data, the method further includes: removing the path information of the current node from the transmission path of the first data packet to obtain the transmission path of the second data packet; Subtract one from the path length of the first data packet to obtain the path length of the second data packet, wherein the path length is used to indicate the number of nodes included in the transmission path; The next hop node is determined according to the transmission path of the second data packet.

6. The method according to claim 1, wherein: The network status information includes at least one of the following: round-trip delay, maximum round-trip delay, packet loss rate, and retransmission rate.

7. The method according to claim 6, wherein: Determining a network evaluation score of the next hop node according to the pre-detected network status information of the next hop node includes: A network evaluation score of the next hop node is determined according to the round-trip delay, the maximum round-trip delay, the packet loss rate, and the retransmission rate.

8. The method according to claim 7, wherein: Determining a network evaluation score of the next hop node according to the pre-detected network status information of the next hop node includes: The network evaluation score of the next hop node is determined according to the ratio of the round-trip delay to the maximum round-trip delay, the packet loss rate, the retransmission rate, and a preset weight value.

9. The method according to claim 1, wherein: Before obtaining the first data packet carrying the initial data, the method further includes: Register with the routing scheduling center, wherein the routing scheduling center is used to save the network topology relationship between each node and the weak network resistance strategy of each node according to the user configuration result after each node is registered.

10. The method according to claim 9, wherein: After registering with the routing scheduling center, the method further includes: Obtaining the network topology relationship associated with the current node and the corresponding weak network resistance strategy issued by the routing scheduling center; Performing network detection according to the network topology relationship to obtain link detection data of the current node, wherein the link detection data includes network status information of the next hop node; The link detection data of the current node is reported to the routing scheduling center at regular intervals.

11. A data transmission system for a real-time audio and video transmission network, the system comprising: Routing dispatch center and multiple real-time audio and video transmission network RTN nodes; The routing scheduling center is configured to configure the network topology relationship and the weak network resistance strategy of the multiple RTN nodes, and instruct the multiple RTN nodes to perform network detection according to the network topology relationship to obtain link detection data; The RTN node is configured to obtain a first data packet carrying initial data, wherein the initial data includes media data of multiple different data types; determine a network evaluation score of the next hop node according to pre-detected network status information of the next hop node, wherein the link detection data includes the network status information of the next hop node; determine multiple target strategies according to a pre-configured anti-weak network strategy and the network evaluation score, wherein each target strategy corresponds to media data of one data type; process the media data of the multiple different data types according to the multiple target strategies, and send a second data packet carrying the processed data to the next hop node.

12. A computer-readable storage medium, wherein a computer program is stored in the storage medium, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 10 is executed.

13. An electronic device comprising a memory and a processor, wherein: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 10.

Images