Data transmission method, system, equipment and medium
By establishing multiple communication links at the application layer, ensuring that redundant data packets are transmitted through at least two links, the problem of kernel-level implementation methods being susceptible to environmental impact in the prior art is solved, and the stability and reliability of data transmission are improved sex.
Patent Information
- Application Number
- CN202411009584.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-25
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-07-25
AI Technical Summary
The existing network redundant transmission methods require deep network layout structures, and are easily affected by the system and network environment, resulting in transmission interruption and other failures, and have reliability problems.
By establishing multiple communication links at the application layer, redundant data packets between the sending and receiving ends, ensuring that data packets are transmitted through at least two links, improving the reliability and flexibility of transmission.
It improves the stability and reliability of redundant data transmission, avoids the complexity of kernel-level implementation methods and the problems of being susceptible to the environment, and provides more flexible communication link management and correction.
Smart Images

Figure CN118944828A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to the field of communication technology, and more particularly to a data transmission method, system, device and medium. Background Art
[0002] With the development of communication technology, data transmission technology based on network communication is also developing continuously.
[0003] In order to ensure the reliability of data transmission in network communication, network redundant transmission is often used to transmit data. In related technologies, network redundant transmission includes an implementation based on Linux kernel level through network card binding (BONDING), which requires the support of Linux kernel. For example, the Linux kernel needs to have a kernel compilation environment, etc., so that network redundant transmission can be realized.
[0004] However, since the kernel-level implementation often involves the deep layout structure of the network layer, for example, at least in the second or third layer of the network layer, it is strongly related to the physical link. Therefore, redundant data transmission is very susceptible to the influence of the system and network environment, resulting in transmission interruption and other failures. Therefore, the reliability of this network redundant transmission method has certain problems. Summary of the invention
[0005] In view of the above-mentioned defects or deficiencies in the related art, it is desired to provide a data transmission method, system, device and medium that can solve the problem that the kernel-level implementation often needs to involve the deep layout structure of the network layer, which is very susceptible to the influence of the system and network environment, thereby causing transmission interruption and other failures, and can greatly improve the stability of redundant data transmission.
[0006] In a first aspect, a data transmission method is provided, which is applied to a sending end, and the method includes:
[0007] Generate redundant data packets for the target session;
[0008] A plurality of communication links are established between the application layer and the application layer of the receiving end, and the redundant data packets are sent through at least two communication links among the plurality of communication links.
[0009] In the present application, after generating redundant data packets of the target session, the sending end will establish multiple communication links between the application layer of the sending end and the application layer of the receiving end, and send the redundant data packets of the target session through at least two communication links among the multiple communication links. In this way, the redundant data packets of the target session can be sent through at least two communication links in the application layer. On the one hand, due to the communication links established in the application layer, the scalability of the communication links will be more flexible, and the modifiability of the application layer will be more convenient than that of the physical layer. On the other hand, since there are at least two communication links, that is, multi-communication link communication, the reliability of the redundant data packet sending process of the target session can also be guaranteed.
[0010] In a second aspect, a data transmission method is provided, which is applied to a receiving end, and the method includes:
[0011] Establishing multiple communication links with the application layer of the sending end through the application layer;
[0012] monitoring the plurality of communication links;
[0013] In the case that each of the at least two communication links receives a redundant data packet of the target session, the redundant data packet is received and read.
[0014] In the present application, the receiving end first establishes multiple communication links with the application layer of the sending end through the application layer, and then monitors the multiple communication links, and receives and reads the redundant data packet when each of the at least two communication links receives the same data packet. In this way, since the receiving end includes multiple communication links between the application layer and the application layer of the sending end in the application layer, the redundant data packet of the target session can be transmitted through at least two of the multiple communication links. Therefore, when any communication link is monitored to receive the redundant data packet of the target session, the redundant data packet can be received and read in time. Since the redundant data packet of the target session can be transmitted through at least two communication links in the application layer, on the one hand, due to the communication link established in the application layer, the scalability of the communication link will be more flexible, and the modifiability of the application layer is more convenient than the physical layer. On the other hand, since there are at least two communication links, that is, multi-communication link communication, the reliability of the redundant data packet transmission process of the target session can also be guaranteed.
[0015] In a third aspect, a data transmission system is provided, the data transmission system comprising an application layer, the application layer comprising a link management module and a data management module;
[0016] The data management module is used to generate redundant data packets for the target session;
[0017] The link management module is used to establish multiple communication links between the application layer and the application layer of the receiving end through the application layer, and send the redundant data packets through at least two communication links among the multiple communication links.
[0018] In a fourth aspect, a data transmission system is provided, the data transmission system comprising an application layer, the application layer comprising a link management module;
[0019] The link management module is used to establish multiple communication links between the application layer of the sending end and the application layer of the sending end through the application layer;
[0020] The link management module is further used to monitor the multiple communication links;
[0021] The link management module is further configured to receive and read the redundant data packet when the at least one communication link receives the redundant data packet of the target session.
[0022] In a fifth aspect, a data transmission system is provided, the data transmission system comprising a sending end and a receiving end, the sending end comprising a sending end application layer, the receiving end comprising a receiving end application layer, the sending end executing the method as described in the first aspect, and the receiving end executing the method as described in the second aspect.
[0023] In a sixth aspect, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first aspect or the second aspect is implemented.
[0024] In a seventh aspect, a computer-readable storage medium is provided, on which a computer program is stored, characterized in that when the program is executed by a processor, the method described in the first aspect or the second aspect is implemented.
[0025] In an eighth aspect, a computer program product is provided. The computer program product includes instructions, and the instructions are executed by a processor to implement the method described in the first aspect or the second aspect.
[0026] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:
[0028] Figure 1 One of the flowcharts of the data transmission method provided in the embodiment of the present application;
[0029] Figure 2 A schematic diagram of a receiving end and a transmitting end provided in an embodiment of the present application;
[0030] Figure 3 A schematic diagram of a module of the application layer provided in an embodiment of the present application;
[0031] Figure 4 A second flowchart of a data transmission method provided in an embodiment of the present application;
[0032] Figure 5 The third flowchart of the data transmission method provided in the embodiment of the present application;
[0033] Figure 6 A fourth flowchart of a data transmission method provided in an embodiment of the present application;
[0034] Figure 7 One of the structural diagrams of the data transmission system provided in the embodiment of the present application;
[0035] Figure 8 A second structural diagram of a data transmission system provided in an embodiment of the present application;
[0036] Fig. 9 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0037] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the invention are shown in the accompanying drawings.
[0038] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The application scenario of the present application will be described below.
[0039] In the field of network high availability technology, in order to ensure the reliability of network communication data transmission, network redundant transmission mode is often used to perform redundant data transmission.
[0040] The redundant data transmission process is usually executed at the Linux kernel level, and is often performed in a physical layer deeper than the application layer, including the implementation of network card binding (BONDING), PRIP, HSR, or secondary modification based on BONDING. The redundant data transmission process between the sender and the receiver is often to encapsulate and compile the redundant data from the application layer of the sender, place the redundant data in the physical layer of the sender, and then transmit the redundant data from the physical layer of the sender to the physical layer of the receiver, and then unpack and decode, and place the redundant data in the application layer so that the receiver can read it. Among them, there are many other protocol layers between the physical layer and the application layer. Therefore, the redundant data on the sender side and the receiver side need to pass through these other protocol layers layer by layer during the transmission process, that is, the redundant data needs to be processed accordingly (such as encapsulation, etc.). Therefore, the entire redundant data transmission process is actually more complicated and cumbersome.
[0041] Furthermore, since the above-mentioned kernel-level implementation methods require corresponding support and dependencies from the kernel, kernel-level implementation cannot be performed without such support. For example, kernel compilation environment, kernel module compilation cannot be performed without kernel compilation environment, or kernel-level implementation cannot be performed without such support, as kernel-level implementation requires relevant support for kernel compilation configuration.
[0042] In addition, the kernel-level implementation involves the second or third layer of the network layer and is strongly related to the physical link. Therefore, it is very susceptible to the influence of the system and network environment, resulting in transmission interruption and other failures. Moreover, due to its location at a relatively low level, its scalability is not flexible, its implementation is difficult, and it has high requirements on personnel in application and daily maintenance.
[0043] In summary, there are certain problems with the reliability of this network redundant transmission method.
[0044] Based on this, the present application proposes a data transmission method, system, device and medium, which can solve the problem that the kernel-level implementation often needs to involve the deep layout structure of the network layer, which is very susceptible to the influence of the system and network environment, thus causing transmission interruption and other failures, and can greatly improve the stability of redundant data transmission.
[0045] Figure 3 FIG. 1 is a flow chart of a data transmission method provided by an embodiment of the present application. Figure 3 As shown, the method includes the following steps 301 and 302:
[0046] Step 301: Generate redundant data packets for a target session.
[0047] In an embodiment of the present application, the target session may be a session between the same application between the receiving end and the sending end.
[0048] For example, a session between a first application at a receiving end and a first application at a sending end.
[0049] In the embodiment of the present application, the above-mentioned sending end can be a terminal, a server, or a virtual node, which is not limited in the embodiment of the present application.
[0050] In one example, when the above-mentioned sending end is a terminal, it can be a desktop computer, a laptop computer, or a mobile phone terminal, and the embodiment of the present application does not limit this.
[0051] In an embodiment of the present application, the above-mentioned redundant data packet means that in a target session, at least two data packets are set for transmission for the same data. Since the same data will be transmitted at least twice, the data is redundant data, and accordingly, the redundant data constitutes a redundant data packet.
[0052] It is understandable that the reason for setting the above-mentioned redundant data packets in the target session is that the data transmitted in the target session is very large. In order to ensure that all data can be transmitted successfully (that is, the sender sends it to the receiver, and the receiver can successfully receive and read it), the data can be encapsulated and sent multiple times, that is, redundant data packets are formed in the target session.
[0053] In the related technologies before the embodiments of the present application, the same data is transmitted only once. In order to avoid data transmission failure, the receiving end corresponding to the sending end in the target session needs to test the packet loss of the transmitted data. When packet loss is detected, the receiving end needs to transmit information to the sending end to inform the sending end to resend the relevant packet loss data. In the embodiments of the present application, there is no need to detect packet loss. The same data is directly transmitted at least twice in the form of redundant data packets to ensure the integrity and reliability of data transmission.
[0054] Step 302: Establish multiple communication links between the application layer and the application layer of the receiving end, and send the redundant data packets through at least two communication links among the multiple communication links.
[0055] In order to ensure that the transmission path is unobstructed and uncongested during the transmission of redundant data packets, and to ensure the flexibility of the transmission path correction and expansion process of the redundant data packets, multiple communication links are established between the application layer of the sending end and the application layer of the receiving end, and the redundant data packets are sent through at least two of the communication links.
[0056] Furthermore, in the process of sending the redundant data packet, it is sent through at least two different communication links.
[0057] It is understandable that, since the redundant data packets are sent through at least two different communication links, the redundant data packets may not be sent on the same communication link, but may be sent from different communication links, thereby avoiding congestion during the sending process.
[0058] In the embodiment of the present application, the types of the multiple communication links established between the application layer of the sending end and the application layer of the receiving end are related to the types of the sending end and the receiving end respectively.
[0059] Optionally, in an embodiment of the present application, the at least two different communication links include at least two of the following: an Internet Protocol IP network communication link, a serial port communication link, and a shared storage communication link.
[0060] In an embodiment of the present application, the above-mentioned IP network communication link may include a public IP network communication link, and may also include a local area network IP network communication link, which is not limited in the embodiment of the present application.
[0061] Exemplarily, in the case where the above-mentioned IP network communication link may include a public IP network communication link, the types of the above-mentioned sending end and receiving end may include: a mobile terminal, a server, a desktop computer, and a virtual node.
[0062] Exemplarily, in the case where the IP network communication link may include a local area network IP network communication link, the types of the sending end and the receiving end may include: a server, a desktop computer, and a virtual node.
[0063] Exemplarily, the types of the transmitting end and the receiving end corresponding to the above serial communication link may include: a server, a desktop computer, and a virtual node.
[0064] Exemplarily, the types of the sending end and the receiving end corresponding to the above-mentioned shared storage communication link may include: a server and a virtual node.
[0065] It is understandable that the above-mentioned shared storage communication link may be a fiber storage communication link. Storage hardware is arranged in the fiber storage communication link.
[0066] like Figure 2 As shown, Figure 2 Four communication link connection modes between the sending end 21 and the receiving end 22 are shown. These four communication link connection modes are located between the application layer 23 of the sending end 21 and the application layer 24 of the receiving end 22, and are respectively a public IP network communication link 25, a local area network IP network communication link 26, a serial port communication link 27, and a shared storage communication link 28. Among them, the public IP network communication link 25 has a public network A, and the shared storage communication link 28 has a shared storage B.
[0067] The application layer in the embodiment of the present application is introduced as follows:
[0068] like Figure 3 As shown, in Figure 3 , the module for sending redundant data packets in the application layer is shown. Specifically, in the application layer 30, a session API (application interface) module 31, a link management module 32, a session management module 33, and a data management module 34 are included. Among them, the link management module includes three submodules, namely: IP network communication module 35, serial port communication module 36, and shared storage communication module 37.
[0069] Specific:
[0070] 1) The session API module 31 is mainly used to provide an API interface between the application corresponding to the target session and the application layer. The API interface mainly includes: session_init, that is, the session initialization interface, which needs to be called once for each target session; session_send, that is, the data sending interface, which can be called multiple times in each target session according to the data sending needs; session_recv, that is, the data receiving interface, the received data is consistent with the sent data; sesssion_close, that is, the session closing interface.
[0071] 2) The link management module 33 needs to manage the status information of specific communication links. For IP networks, it needs to maintain the network on / off status, delay, and data transmission quality. For serial port links, it needs to maintain the serial port on / off status. For shared storage, it needs to maintain whether the shared storage reads and writes normally and the data storage quality. All link status tables are used to determine candidate communication links in a session.
[0072] 3) The session management module 32 can support multiple sessions at the same time, and selects the specific communication link in the target session according to the link status of the communication link. The link status change in the target session will be dynamically added or subtracted into the selection of the communication link. At the same time, the information status of the target session will also be fed back to the link status of the communication link.
[0073] 4) The data management submodule 34 is mainly responsible for checking and sending the data in the redundant data packets, and checking and deduplicating the received data in the redundant data packets.
[0074] 5) The IP network communication module 35 mainly maintains redundant data packet communication based on IP. The IP network communication module 35 supports simultaneous communication of multiple IP links at the session level. A session includes a TCP / UDP connection on each IP link. In the case of Linux, it is mainly an abstract encapsulation of the POSIX network API.
[0075] 6) The serial port communication module 36 is mainly responsible for maintaining serial port operations, including initialization, redundant data packet writing and reading, closing, serial port configuration and other management operations.
[0076] 7) The shared storage communication module 37 is based on the reading and writing of the same block device by both ends of the communication. The storage content of the block device is the communication content, and two independent ring buffers based on the block device are constructed for sending and receiving redundant data packets.
[0077] In the data transmission method provided by the present application, after the sending end generates the redundant data packet of the target session, it will establish multiple communication links between the application layer of the sending end and the application layer of the receiving end, and send the redundant data packet of the target session through at least two communication links among the multiple communication links. In this way, the redundant data packet of the target session can be sent through at least two communication links in the application layer. On the one hand, due to the communication link established in the application layer, the scalability of the communication link will be more flexible, and the modifiability of the application layer will be more convenient than the physical layer. On the other hand, since there are at least two communication links, that is, multi-communication link communication, the reliability of the redundant data packet sending process of the target session can also be guaranteed.
[0078] Optionally, in an embodiment of the present application, a method for sending redundant data packets on the at least two communication links is also provided. Before sending the redundant data packets through at least two of the multiple communication links, the method further includes: obtaining the transmission capacity parameters of each of the at least two communication links; and performing adaptation processing on the redundant data packets according to the transmission capacity parameters of each of the communication links to obtain the redundant data packets corresponding to the communication links.
[0079] Exemplarily, the above transmission capability parameter is used to indicate the link attribute of the communication link.
[0080] In one example, the above transmission capability parameters may include the transmission bandwidth of each communication link, the single transmission capacity, the field corresponding to the transmission data, etc.
[0081] It can be understood that, from the above content, a redundant data packet includes several data packets with the same data content, and different data packets are sent through different communication links. In actual application, since the transmission capacity parameters corresponding to different communication links are different, for example, the single transmission capacity of a shared storage communication link may be greater than the single transmission capacity of an IP network communication link, it is necessary to consider the size relationship between the redundant data packet and the single transmission capacity to determine whether a single transmission can transmit all the data in the redundant data packet to the receiving end; for another example, different communication links have different transmission protocols, therefore, the redundant data packet needs to be encapsulated before transmission, and different communication links are encapsulated through different fields.
[0082] Exemplarily, the above adaptation processing of redundant data packets includes: processing and matching the redundant data packets with the link properties of the communication link to be transmitted according to the transmission capacity parameters of the communication link, so that the redundant data packets can be transmitted in the corresponding communication link.
[0083] Optionally, in an embodiment of the present application, a method for processing redundant data packets in the process of sending redundant data packets on the above-mentioned at least two communication links is also provided. The above-mentioned method of adapting the above-mentioned redundant data packets according to the transmission capacity parameters of each of the above-mentioned communication links to obtain the redundant data packets corresponding to the above-mentioned communication links includes: for each of the above-mentioned at least two communication links, determining the processing mode of the above-mentioned redundant data packets according to the single transmission capacity and transmission format of each of the above-mentioned communication links; according to the above-mentioned processing mode, adapting the above-mentioned redundant data packets to obtain the redundant data packets corresponding to the above-mentioned communication links.
[0084] Exemplarily, the above-mentioned processing mode includes at least one of the following: the format of the above-mentioned redundant data packet, and the number of data packets corresponding to the above-mentioned redundant data packet.
[0085] Exemplarily, when the data capacity of the redundant data packet is greater than the single transmission capacity of any one of the at least two communication links, it is necessary to split the redundant data packet to obtain the redundant data packet corresponding to the communication link so that the redundant data packet can be transmitted in the communication link.
[0086] Exemplarily, when the redundant data packet needs to be transmitted in different communication links, it is necessary to match the format of the redundant data packet according to the link format of the communication link corresponding to the redundant data packet so that it can be transmitted in the communication link corresponding to the format of the processed redundant data packet. For example, the redundant data packet is matched with the link protocol of the communication link so that it can be transmitted in the communication link.
[0087] Optionally, in an embodiment of the present application, when the above-mentioned processing mode includes the processing format of the above-mentioned redundant data packet, the above-mentioned redundant data packet is adapted according to the above-mentioned processing mode, including: adding an encapsulation field to the above-mentioned redundant data packet according to the communication protocol of the communication link corresponding to the above-mentioned redundant data packet.
[0088] It can be understood that, when the above-mentioned redundant data packet is formatted, the formatting processing includes field encapsulation of the redundant data packet, that is, adding a field corresponding to the communication link it is about to enter to the redundant data packet to indicate that the redundant data packet can be sent from the communication link.
[0089] Optionally, in an embodiment of the present application, a method for screening a communication link ultimately used to send a redundant data packet from a plurality of communication links is also provided. Exemplarily, when the number of communication links corresponding to the above-mentioned application layer is greater than 2, before sending the above-mentioned redundant data packet through at least two communication links among the above-mentioned plurality of communication links, the method includes: screening at least two different communication links for transmitting the above-mentioned redundant data packet from the above-mentioned at least three different communication links according to the data parameters of the above-mentioned redundant data packet and the transmission capacity parameters of each communication link.
[0090] Exemplarily, the above transmission capability parameters include: at least one of transmission rate and single transmission capacity.
[0091] It is understandable that, in the process of screening at least two communication links among multiple communication links, the screening criteria may be related only to the transmission capacity parameters of the communication links, or may be related to the transmission capacity parameters of the communication links and the transmission tasks corresponding to the redundant data packets.
[0092] In one example, when the above-mentioned screening criteria are only related to the transmission capacity parameters of the communication link, in the process of screening the communication links, the communication links whose transmission rates rank at least in the top two can be screened out, and the communication links whose single transmission capacities rank at least in the top two can be screened out according to the order from large to small of the single transmission capacities. It is also possible to screen out the communication links whose weighted values corresponding to the above-mentioned transmission rates and the above-mentioned single transmission capacities rank at least in the top two among the above-mentioned multiple communication links.
[0093] In another example, when the above screening criteria are related to the transmission capacity parameters of the communication link and the transmission tasks corresponding to the redundant data packets, in the process of screening the communication links, the transmission capacity parameters that are relatively important to the transmission task need to be considered. That is, different transmission tasks consider different transmission capacity parameters. For example, for some transmission tasks, the transmission rate is the most important to them, so the communication links whose transmission rates rank at least in the top two can be screened out; for some transmission tasks, the single transmission capacity is the most important to them, so the communication links whose single transmission capacity rank at least in the top two can be screened out according to the order from large to small of the single transmission capacity; for some transmission tasks, the screening criteria are related to both the above transmission rate and the above single transmission capacity, and the degree of correlation is different, so the weighted parameters corresponding to the transmission task and the transmission capacity parameters can be used to screen out the communication links whose weighted values corresponding to the above transmission rate and the above single transmission capacity rank at least in the top two among the above multiple communication links.
[0094] Exemplarily, the at least two different communication links include: communication links whose weighted values corresponding to the transmission rate and the single transmission capacity are ranked at least first two among the multiple communication links.
[0095] Exemplarily, the weighted parameters of the transmission rate and the single transmission capacity in the multiple communication links corresponding to the weighted values may be user-defined or preset by the application layer. Specifically, they may be preset by the user or the application layer according to the transmission task. For example, the weighted parameter of the transmission rate is 0.7, and the weighted parameter of the single transmission capacity is 0.3; the weighted parameter of the transmission rate is 0.6, and the weighted parameter of the single transmission capacity is 0.4.
[0096] It can be understood that the above weighted parameters can be determined according to the transmission experience of the redundant data packet transmission process. For example, there are two different communication links, namely communication link 1 and communication link 2, and the single transmission capacity of communication link 1 is greater than the single transmission capacity of communication link 2. At the same time, the transmission rate of communication link 1 is less than the transmission rate of communication link 2. Then, assuming that the transmission experience of the redundant data packet transmission process is the difference between the single transmission capacity of communication link 1 and the single transmission capacity of communication link 2, which is much smaller than the transmission experience of the redundant data packet transmission process is the difference between the transmission rate of communication link 1 and the transmission rate of communication link 2, a larger weighted parameter can be set for the transmission rate, and a smaller weighted parameter can be set for the single transmission capacity. The weighted parameter of the transmission rate is 0.8, and the weighted parameter of the single transmission capacity is 0.2.
[0097] Exemplarily, in order to ensure the sending of redundant data packets and avoid the resource consumption of communication links during the transmission process, communication links with weighted values ranking at least in the top two are finally selected from at least three communication links for the transmission of redundant data packets.
[0098] Figure 5 FIG. 1 is a flow chart of a data transmission method provided by an embodiment of the present application. Figure 5 As shown, applied to the receiving end, the method includes the following steps 401 to 403:
[0099] Step 401: Establish multiple communication links between the application layer and the application layer of the sending end through the application layer.
[0100] Step 402: Monitor the above multiple communication links.
[0101] Step 403: When each of the at least two communication links receives a redundant data packet of the target session, receive and read the redundant data packet.
[0102] In the embodiment of the present application, the above-mentioned application layer, communication link, redundant data packet, and target session can refer to the above description and will not be repeated here.
[0103] In an embodiment of the present application, since the time at which the sending end sends redundant data packets to the receiving end is uncertain after the receiving end establishes a target session with the sending end, the receiving end needs to monitor the above-mentioned multiple communication links, that is, all communication links, so that it can receive the redundant data packets sent by the sending end in a timely manner.
[0104] In the embodiment of the present application, when the receiving end receives the redundant data packet of the target session, the redundant data packet needs to be received and read. It can be understood from the above content that the redundant data packet needs to be adapted during the transmission through any communication link. Therefore, after the receiving end receives the redundant data packet from any communication link, it needs to adapt the redundant data packet again in the same way as the transmitting end in order to read the data content in the redundant data packet.
[0105] In the data transmission method provided by the present application, the receiving end first establishes multiple communication links with the application layer of the sending end through the application layer, and then monitors the multiple communication links, and receives and reads the redundant data packet when each communication link in the at least two communication links receives the same data packet. In this way, since the receiving end includes multiple communication links between the application layer and the application layer of the sending end in the application layer, the redundant data packet of the target session can be transmitted through at least two communication links in the multiple communication links. Therefore, when any communication link is monitored to receive the redundant data packet of the target session, the redundant data packet can be received and read in time. Since the redundant data packet of the target session can be transmitted through at least two communication links in the application layer, on the one hand, due to the communication link established in the application layer, the scalability of the communication link will be more flexible, and the modifiability of the application layer is more convenient than the physical layer. On the other hand, since there are at least two communication links, that is, multi-communication link communication, the reliability of the transmission process of the redundant data packet of the target session can also be guaranteed.
[0106] Optionally, in an embodiment of the present application, a specific method for reading a redundant data packet is also provided. Exemplarily, the above-mentioned reading of the above-mentioned redundant data packet includes: for each of the above-mentioned at least two communication links, according to the transmission capacity parameter of the communication link where the above-mentioned redundant data packet is located, determining the adaptation processing method of the above-mentioned redundant data packet; according to the above-mentioned adaptation processing method, restoring the above-mentioned redundant data packet to the original redundant data packet, and reading the data in the above-mentioned original redundant data packet.
[0107] Exemplarily, the above adaptation processing method corresponds to the adaptation processing method in which the aforementioned sending end processes the redundant data packet.
[0108] It can be understood that since multiple communication links are established between the aforementioned sending end and receiving end, respective processing methods for redundant data packets have been set on both the receiving end and the sending end. Therefore, after the receiving end receives the redundant data packets sent by the sending end, the redundant data packets can be adapted and processed according to the communication link.
[0109] Optionally, in an embodiment of the present application, the redundant data packet is restored to the original redundant data packet according to the adaptation processing method, and the data in the original redundant data packet is read, including: determining the processing mode of the redundant data packet according to the single transmission capacity and transmission format of each of the above communication links; according to the above processing mode, adapting the redundant data packet and restoring the redundant data packet to the original redundant data packet.
[0110] Exemplarily, the processing mode includes at least one of the following: the format of the redundant data packet, and the number of data packets corresponding to the redundant data packet.
[0111] Exemplarily, the above-mentioned single transmission capacity and transmission format can refer to the above description and will not be repeated here.
[0112] In one example, the adaptation processing method performed by the above-mentioned sending end on the redundant data packets is to subpacketize the redundant data packets, and the adaptation processing method performed by the receiving end on the redundant data packets is to reassemble the subpackets corresponding to the subpackets; the adaptation processing method performed by the above-mentioned sending end on the redundant data packets is to encapsulate the redundant data packets corresponding to the communication link, and the adaptation processing method performed by the receiving end on the redundant data packets is to decapsulate the subpackets corresponding to the subpackets.
[0113] Optionally, in an embodiment of the present application, the above-mentioned monitoring of the multiple communication links includes: regularly monitoring all communication links corresponding to the receiving end using heartbeat data packets according to a preset period.
[0114] Exemplarily, the above-mentioned preset period may be preset by a user, or may be a custom setting of the application layer, which is not limited in the embodiments of the present application.
[0115] Exemplarily, the heartbeat data packet is used to periodically monitor the communication link to ensure that the communication link keeps transmitting normal data packets.
[0116] Exemplarily, each of the above-mentioned multiple communication links includes its own heartbeat data packet, and detects whether it is unobstructed according to a preset period.
[0117] Optionally, in an embodiment of the present application, the at least two different communication links include at least two of the following: an Internet Protocol IP network communication link, a serial port communication link, and a shared storage communication link.
[0118] Exemplarily, the IP network communication link, the serial port communication link, and the shared storage communication link can refer to the above description and will not be repeated here.
[0119] The following uses Example 1 and Example 2 to illustrate the process of transmitting redundant data packets through at least two communication links in the above application layer, wherein Example 1 is used to illustrate the process of the sending end sending redundant data packets, and Example 2 is used to illustrate the process of the receiving end receiving redundant data packets.
[0120] Example 1, combined with Figure 5 As shown,
[0121] S101: When a redundant data packet needs to be sent, the sending end calls an API interface through an API module, specifically, calls the session_send data sending interface.
[0122] S102: The data management submodule at the sending end generates a data packet identifier and a check value for the redundant data packet.
[0123] S103: The link management module at the sending end selects at least two different communication links to transmit the redundant data packet.
[0124] S104: The link management module at the transmitting end performs adaptation processing on the redundant data packet according to the capacity of the redundant data packet and the difference between each communication link and the single transmission capacity of each communication link, so that the redundant data packet matches the communication link. Specifically, when the capacity of the redundant data packet is greater than the single transmission capacity of the communication link, the redundant data packet is subjected to packetization processing and format processing; when the capacity of the redundant data packet is less than the single transmission capacity of the communication link, the redundant data packet is subjected to format processing.
[0125] S105: The link management module at the sending end sends the redundant data packet to the receiving end from at least two different communication links.
[0126] Example 2, combined with Figure 3 and Figure 6 As shown,
[0127] S201: The link management module at the receiving end periodically monitors each link between the receiving end and the sending end through a heartbeat data packet.
[0128] S202: When any submodule (IP network communication module, serial port communication module, shared storage communication module) in the link management module of the receiving end monitors that its corresponding communication link receives a redundant data packet, it receives the redundant data packet.
[0129] S203: The link management module of the receiving end performs adaptation processing on the redundant data packet. Specifically, when the redundant data packet is transmitted to the receiving end in a packetized form, the redundant data packet is reassembled and formatted; when the redundant data packet is transmitted to the receiving end in a non-packetized form, the redundant data packet is formatted.
[0130] S204: The data management module at the receiving end performs data packet verification using the verification value of the redundant data packet.
[0131] S205: The data management module at the receiving end performs deduplication processing on redundant data packets.
[0132] S206: The receiving end calls the API interface through the API module to transfer the redundant data packet to the upper layer application.
[0133] The present application also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the training rule determination method described in the present application is implemented. For example, the following can be executed: Figure 1 or Figure 4 The individual steps of the method are shown.
[0134] The present invention provides a computer program product, which includes instructions that are executed by a processor when the processor executes the instructions. Figure 1 or Figure 4 The individual steps of the method are shown.
[0135] It should be noted that although the operations of the method of the present invention are described in a particular order in the drawings, this does not require or imply that the operations must be performed in this particular order or that all illustrated operations must be performed to achieve desired results.
[0136] Figure 7 This is a block diagram of a transmitting end according to an embodiment of the present application. Figure 7 The device includes a link management module 701 and a data management module 702.
[0137] The data management module 701 is used to generate redundant data packets of the target session;
[0138] The link management module 702 is used to establish multiple communication links between the application layer and the application layer of the receiving end through the application layer, and send the redundant data packets through at least two communication links among the multiple communication links.
[0139] In one embodiment, the link management module 702 includes: an IP network communication link management submodule, a serial port communication link management submodule, and a shared storage communication management submodule;
[0140] The IP network communication link management submodule is used to establish an IP network communication link between the application layer and the application layer of the receiving end through the application layer, and send the redundant data packet through the IP network communication link;
[0141] The serial communication link management submodule is used to establish a serial communication link between the application layer and the application layer of the receiving end through the application layer, and send the redundant data packet through the serial communication link;
[0142] The shared storage communication management submodule is used to establish a shared storage communication link with the application layer of the receiving end through the application layer, and send the redundant data packet through the shared storage communication.
[0143] In one embodiment, the link management module 702 is used to:
[0144] Acquire a transmission capability parameter of each of the at least two communication links;
[0145] According to the transmission capacity parameter of each communication link of the at least two communication links, the redundant data packet is adapted to obtain the redundant data packet corresponding to the communication link.
[0146] In one embodiment, the link management module 702 is used to:
[0147] For each of the at least two communication links, determining a processing mode of the redundant data packet according to a single transmission capacity and a transmission format of each communication link, wherein the processing mode includes at least one of the following: a format of the redundant data packet, and a number of data packets of the redundant data packet;
[0148] According to the processing mode, the redundant data packet is adapted to obtain a redundant data packet corresponding to the communication link.
[0149] In one embodiment, the link management module 702 is used to:
[0150] When the number of communication links corresponding to the application layer is greater than 2, at least two different target communication links for transmitting the redundant data packet are screened out from the at least three different communication links according to the data parameters of the redundant data packet and the transmission capacity parameters of each communication link, and the transmission capacity parameters include: at least one of the transmission rate and the single transmission capacity.
[0151] In one embodiment, the at least two different communication links include at least two of the following: an Internet Protocol (IP) network communication link, a serial port communication link, and a shared storage communication link.
[0152] In one embodiment, when the processing mode includes the processing format of the redundant data packet, the link management module 702 is used to add an encapsulation field to the redundant data packet according to the communication protocol of the communication link corresponding to the redundant data packet.
[0153] Figure 8 This is a block diagram of a receiving end of an embodiment of the present application. Figure 8 The system includes an application layer, and the application layer includes a link management module 801.
[0154] The link management module 801 is used to establish multiple communication links between the application layer of the sending end and the application layer of the sending end through the application layer;
[0155] The link management module 801 is further configured to monitor the multiple communication links;
[0156] The link management module 801 is further configured to receive and read the redundant data packet when each of the at least two communication links receives a redundant data packet of the target session.
[0157] In one embodiment, the link management module 801 includes: an IP network communication link management submodule, a serial port communication link management submodule, and a shared storage communication management submodule;
[0158] The IP network communication link management submodule is used to establish an IP network communication link between the application layer and the application layer of the sending end through the application layer;
[0159] The serial communication link management submodule is used to establish a serial communication link between the application layer of the sending end and the application layer of the sending end through the application layer;
[0160] The shared storage communication management submodule is used to establish a shared storage communication link with the application layer of the sending end through the application layer.
[0161] In one embodiment, the link management module 801 is used to:
[0162] For each of the at least two communication links, determining an adaptation processing mode of the redundant data packet according to a transmission capacity parameter of the communication link where the redundant data packet is located;
[0163] According to the adaptation processing mode, the redundant data packet is restored to the original redundant data packet, and the data in the original redundant data packet is read.
[0164] In one embodiment, the link management module 801 is used to:
[0165] Determine a processing mode of the redundant data packet according to the single transmission capacity and transmission format of each communication link, wherein the processing mode includes at least one of the following: the format of the redundant data packet, the number of data packets of the redundant data packet;
[0166] According to the processing mode, the redundant data packet is adapted and restored to the original redundant data packet.
[0167] In one embodiment, the link management module 801 is used to:
[0168] According to a preset period, all communication links corresponding to the receiving end are monitored regularly using heartbeat data packets.
[0169] In one embodiment, the at least two different communication links include at least two of the following: an Internet Protocol (IP) network communication link, a serial port communication link, and a shared storage communication link.
[0170] It should be understood that the units recorded in the transmitting end and the receiving end correspond to the steps in the method described in the accompanying drawings. Therefore, the operations and features described above for the method are also applicable to the data transmission system and the units contained therein, and will not be repeated here. The data transmission system can be pre-implemented in a browser or other security application of a computer device, or can be loaded into a browser or its security application of a computer device by downloading or the like. The corresponding units in the data transmission system can cooperate with the units in the computer device to implement the solution of the embodiment of the present application.
[0171] For the several modules or units mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.
[0172] It should be noted that for details not disclosed in the data transmission system of the embodiments of the present application, please refer to the details disclosed in the above embodiments of the present application, which will not be repeated here.
[0173] An embodiment of the present application also provides a data transmission system, which includes a sending end and a receiving end, the sending end includes a sending end application layer, the receiving end includes a receiving end application layer, the sending end executes the aforementioned sending end-related method, and the receiving end executes the aforementioned receiving end-related method.
[0174] Reference below Fig. 9 , Fig. 9 FIG. 1 is a schematic diagram showing a structure of a computer device suitable for implementing an embodiment of the present application. Fig. 9 As shown, the computer system 1700 includes a central processing unit (CPU) 1701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1702 or the program loaded from the storage part 1708 to the random access memory (RAM) 1703. In the RAM 1703, various programs and data required for the operation instructions of the system are also stored. The CPU 1701, the ROM 1702, and the RAM 1703 are connected to each other through a bus 1704. An input / output (I / O) interface 1705 is also connected to the bus 1704.
[0175] The following components are connected to the I / O interface 1705: an input section 1706 including a keyboard, a mouse, etc.; an output section 1707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1708 including a hard disk, etc.; and a communication section 1709 including a network interface card such as a LAN card, a modem, etc. The communication section 1709 performs communication processing via a network such as the Internet. A drive 1710 is also connected to the I / O interface 1705 as needed. A removable medium 1711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1710 as needed, so that a computer program read therefrom is installed into the storage section 1708 as needed.
[0176] In particular, according to an embodiment of the present application, the above reference flow chart Figure 1 or Figure 4 The described process can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program includes a program code for executing the method shown in the flow chart. In such an embodiment, the computer program includes a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1709, and / or installed from the removable medium 1711. When the computer program is executed by the central processing unit (CPU) 1701, the above-mentioned functions defined in the system of the present application are executed.
[0177] It should be noted that the computer-readable medium shown in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium such as a computer-readable storage medium that can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, device or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0178] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operating instructions of the system, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the aforementioned module, program segment or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, the boxes represented by two connections can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operating instruction, or can be implemented with a combination of dedicated hardware and computer instructions.
[0179] The units or modules involved in the embodiments described in the present application may be implemented by software or hardware. The units or modules described may also be set in a processor. For example, it may be described as: a processor includes a first receiving module, a second receiving module, and a sending module. The names of these units or modules do not, in some cases, constitute limitations on the units or modules themselves.
[0180] As another aspect, the present application further provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the data transmission method described in the present application.
[0181] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.
Claims
1. A data transmission method, applied to a sending end, characterized in that: The method comprises: Generate redundant data packets for the target session; A plurality of communication links are established between the application layer and the application layer of the receiving end, and the redundant data packets are sent through at least two communication links among the plurality of communication links.
2. The method according to claim 1, characterized in that: Before sending the redundant data packet through at least two communication links among the plurality of communication links, the method includes: Acquire a transmission capability parameter of each of the at least two communication links; According to the transmission capacity parameter of each communication link of the at least two communication links, the redundant data packet is adapted to obtain the redundant data packet corresponding to the communication link.
3. The method according to claim 2, characterized in that The adapting processing of the redundant data packet according to the transmission capacity parameter of each communication link to obtain the redundant data packet corresponding to the communication link includes: For each of the at least two communication links, determining a processing mode of the redundant data packet according to a single transmission capacity and a transmission format of the communication link, the processing mode comprising at least one of the following: a format of the redundant data packet, a number of data packets of the redundant data packet; According to the processing mode, the redundant data packet is adapted to obtain a redundant data packet corresponding to the communication link.
4. The method according to claim 1, characterized in that: In a case where the number of communication links corresponding to the application layer is greater than 2, before sending the redundant data packet through at least two communication links among the multiple communication links, the method includes: At least two different communication links for transmitting the redundant data packet are selected from at least three different communication links according to the data parameters of the redundant data packet and the transmission capacity parameters of each communication link, wherein the transmission capacity parameters include at least one of a transmission rate and a single transmission capacity.
5. The method according to claim 1, characterized in that The at least two different communication links include at least two of the following: an Internet Protocol (IP) network communication link, a serial port communication link, and a shared storage communication link.
6. The method according to claim 3, characterized in that In the case where the processing mode includes a processing format of the redundant data packet, performing adaptation processing on the redundant data packet according to the processing mode includes: According to the communication protocol of the communication link corresponding to the redundant data packet, an encapsulation field is added to the redundant data packet.
7. A data transmission method, applied to a receiving end, characterized in that: The method comprises: Establishing multiple communication links with the application layer of the sending end through the application layer; monitoring the plurality of communication links; In the case that each of the at least two communication links receives a redundant data packet of the target session, the redundant data packet is received and read.
8. The method according to claim 7, characterized in that The reading of the redundant data packet comprises: For each of the at least two communication links, determining an adaptation processing mode of the redundant data packet according to a transmission capacity parameter of the communication link where the redundant data packet is located; According to the adaptation processing mode, the redundant data packet is restored to the original redundant data packet, and the data in the original redundant data packet is read.
9. The method according to claim 8, characterized in that The step of restoring the redundant data packet to an original redundant data packet according to the adaptation processing mode, and reading data in the original redundant data packet, comprises: Determine a processing mode of the redundant data packet according to the single transmission capacity and transmission format of each communication link, wherein the processing mode includes at least one of the following: the format of the redundant data packet, the number of data packets of the redundant data packet; According to the processing mode, the redundant data packet is adapted and restored to the original redundant data packet.
10. The method according to claim 7, characterized in that The monitoring of the multiple communication links comprises: According to a preset period, all communication links corresponding to the receiving end are monitored regularly using heartbeat data packets.
11. The method according to claim 7, characterized in that The at least two different communication links include at least two of the following: an Internet Protocol (IP) network communication link, a serial port communication link, and a shared storage communication link.
12. A transmitting end, characterized in that: The data transmission system comprises an application layer, and the application layer comprises a link management module and a data management module; The data management module is used to generate redundant data packets for the target session; The link management module is used to establish multiple communication links between the application layer and the application layer of the receiving end through the application layer, and send the redundant data packets through at least two communication links among the multiple communication links.
13. The transmitting end according to claim 12, characterized in that: The link management module includes: an IP network communication link management submodule, a serial port communication link management submodule, and a shared storage communication management submodule; The IP network communication link management submodule is used to establish an IP network communication link between the application layer and the application layer of the receiving end through the application layer, and send the redundant data packet through the IP network communication link; The serial communication link management submodule is used to establish a serial communication link between the application layer and the application layer of the receiving end through the application layer, and send the redundant data packet through the serial communication link; The shared storage communication management submodule is used to establish a shared storage communication link with the application layer of the receiving end through the application layer, and send the redundant data packet through the shared storage communication.
14. A receiving end, characterized in that: The data transmission system comprises an application layer, and the application layer comprises a link management module; The link management module is used to establish multiple communication links between the application layer of the sending end and the application layer of the sending end through the application layer; The link management module is further used to monitor the multiple communication links; The link management module is further configured to receive and read the redundant data packet when each of the at least two communication links receives the redundant data packet of the target session.
15. The receiving end according to claim 14, characterized in that: The link management module includes: an IP network communication link management submodule, a serial port communication link management submodule, and a shared storage communication management submodule; The IP network communication link management submodule is used to establish an IP network communication link between the application layer and the application layer of the sending end through the application layer; The serial communication link management submodule is used to establish a serial communication link between the application layer of the sending end and the application layer of the sending end through the application layer; The shared storage communication management submodule is used to establish a shared storage communication link with the application layer of the sending end through the application layer.
16. A data transmission system, characterized in that: The data transmission system includes a transmitting end and a receiving end, the transmitting end includes a transmitting end application layer, the receiving end includes a receiving end application layer, the transmitting end executes the method as described in any one of claims 1-6, and the receiving end executes the method as described in any one of claims 7-11.
17. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 6 or any one of claims 7 to 11 is implemented.
18. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 or any one of claims 7 to 11 is implemented.
19. A computer program product, comprising instructions, characterized in that: When the instructions are executed by a processor, the method according to any one of claims 1 to 6 or any one of claims 7 to 11 is implemented.
Citation Information
Patent Citations
Data transmission method, device and equipment and readable storage medium
CN111246033A
Data transmission method and device, storage medium and electronic equipment
CN112291366A
Cloud-side collaborative data transmission method and device, server and storage medium
CN113489643A
Data transmission method and device, storage medium and electronic equipment
CN113645208A
Network acceleration method and device
CN113708979A
