Monitoring data breakpoint continuous transmission method and system
By receiving multi-target transmission tasks in the breakpoint continuous transmission technology, performing subcontracting processing and breakpoint verification, collaborative transmission between multiple targets is achieved, solving the problem of insufficient speed and stability of interrupt point continuous transmission in the prior art, and improving the efficiency and reliability of data transmission.
Patent Information
- Application Number
- CN202411988609.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-31
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2044-12-31
AI Technical Summary
The existing breakpoint continuous transmission technology cannot effectively ensure the speed and stability of data transmission in multi-target transmission scenarios, and it is prone to slow down or transmission failure.
By receiving multi-target transmission tasks, the data transmission end and multiple data reception ends are determined, subcontracted and identification processing are performed, and multiple identification data subcontracts are generated. Based on these subcontracts, subcontract transmission directories are generated, direct transmission, same transfer and transmission monitoring are performed, and the transmission monitoring data is broken point verification, breakpoint reception end is selected and the collaborative reception end is matched, thereby realizing the collaborative transmission of breakpoint data subcontracts.
Direct transmission, same transfer and breakpoint coordinated transmission are realized between the data transmission end and multiple data receivers, which improves the speed and stability of data transmission and avoids the speed of the interruption of breakpoint transmission or failure.
Smart Images

Figure CN119835276A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of breakpoint-resume transmission, and in particular relates to a monitoring data breakpoint-resume transmission method and system. Background Art
[0002] Breakpoint resume is a technology that, when data transmission is interrupted, can continue the transmission from the point of interruption by recording the transmitted part and related information. After data transmission is interrupted, the transmission is continued from the interruption point instead of restarting the entire transmission process.
[0003] In the prior art, breakpoint resume can only be implemented between a data transmission end and a data receiving end. In actual applications, when breakpoint resume occurs, the speed and stability of the entire data transmission cannot be effectively guaranteed due to various factors such as network environment volatility, server carrying capacity limitations and user bandwidth. Even if breakpoint resume is possible, the speed will drop or even fail. Summary of the invention
[0004] The purpose of the embodiments of the present invention is to provide a monitoring data breakpoint resume transmission method and system, aiming to solve the technical problems existing in the prior art mentioned in the background technology.
[0005] The embodiment of the present invention is implemented as follows:
[0006] A method for monitoring data breakpoint resuming transmission, the method specifically comprising the following steps:
[0007] Receive multi-target transmission tasks, determine a data transmission end and multiple data receiving ends, extract target transmission data, perform packetization and identification processing, and generate multiple identification data packets;
[0008] Based on the multiple identification data packets, a packet transmission directory is generated and sent to multiple data receiving terminals;
[0009] According to the subpacket transmission directory, between a data transmission end and a plurality of data receiving ends, a plurality of identification data subpackets are directly transmitted, identically forwarded, and transmitted and monitored to obtain transmission monitoring data;
[0010] Based on the sub-packet transmission directory, the transmission monitoring data is breakpoint checked, a breakpoint receiving end is selected from the plurality of data receiving ends, and a cooperative receiving end is matched;
[0011] A breakpoint data subpacket is determined from the plurality of identification data subpackets, and the breakpoint data subpacket is cooperatively transmitted to the breakpoint receiving end through the cooperative receiving end.
[0012] As a further limitation of the technical solution of the embodiment of the present invention, the receiving of the multi-target transmission task, determining the data transmission end and multiple data receiving ends, extracting the target transmission data, performing subpacketization and identification processing, and generating multiple identification data subpackets specifically include the following steps:
[0013] Receive multi-target transmission tasks;
[0014] Identifying the multi-target transmission task, and determining a data transmission end and a plurality of data receiving ends;
[0015] Extracting target transmission data from the multi-target transmission task;
[0016] Perform data subpackaging calculations to determine the number of data subpackaging and the start and end position data;
[0017] According to the number of data subpackets and the starting position data, the target transmission data is divided into a plurality of basic data subpackets;
[0018] The plurality of basic data sub-packets are subjected to identification processing to generate a plurality of identification data sub-packets.
[0019] As a further limitation of the technical solution of the embodiment of the present invention, the calculation formula of the number of data subpackets is:
[0020]
[0021] Among them, n is the number of data packets, S p The data size of the target transmission data, S s It is the preset standard data packet size;
[0022] The calculation formula of the start and end position data is:
[0023] A i =(i-1)S s +1;
[0024]
[0025] Among them, A i is the starting position of the ith subpacket, B i is the end position of the ith subpacket, and all the start positions and end positions constitute the start and end position data.
[0026] As a further limitation of the technical solution of the embodiment of the present invention, the step of generating a sub-packet transmission directory based on multiple identification data sub-packets and sending the sub-packet transmission directory to multiple data receiving terminals specifically includes the following steps:
[0027] Extracting subpackage identifiers corresponding to a plurality of the identification data subpackages;
[0028] Recording the data transmission relationship between the plurality of identification data subpackets and the plurality of data receiving ends;
[0029] Creating a sub-packet transmission directory according to the data transmission relationship and the plurality of sub-packet identifiers;
[0030] The sub-packet transmission directory is sent to the plurality of data receiving ends.
[0031] As a further limitation of the technical solution of the embodiment of the present invention, the direct transmission, identical forwarding and transmission monitoring of multiple identification data subpackets are performed between the data transmission end and the multiple data receiving ends according to the subpacket transmission directory, and the acquisition of transmission monitoring data specifically includes the following steps:
[0032] Creating a sub-package transmission task according to the sub-package transmission directory;
[0033] According to the sub-packet transmission task, directly transmit and monitor the transmission task for multiple identification data sub-packets between the data transmission end and multiple data receiving ends to obtain task monitoring data;
[0034] According to the task monitoring data, multiple identical data sub-packets are selected from multiple identified data sub-packets;
[0035] Dividing the plurality of identical data subpackets into transmitted identical subpackets and a plurality of identical subpackets to be transmitted;
[0036] From the plurality of data receiving ends, matching the transmitted receiving ends corresponding to the transmitted identical subpackets, and matching the plurality of to-be-transmitted receiving ends corresponding to the plurality of to-be-transmitted identical subpackets;
[0037] Modifying the identification of the transmitted identical sub-packets through the transmitted receiving end, and forwarding them to a plurality of corresponding receiving ends to be transmitted;
[0038] Conduct real-time transmission process monitoring and obtain transmission monitoring data.
[0039] As a further limitation of the technical solution of the embodiment of the present invention, the step of performing breakpoint check on the transmission monitoring data based on the subpacket transmission directory, selecting a breakpoint receiving end from a plurality of data receiving ends, and matching a collaborative receiving end specifically comprises the following steps:
[0040] Based on the sub-packet transmission directory, performing real-time breakpoint verification on the transmission monitoring data to determine whether there is a data transmission breakpoint;
[0041] When there is a data transmission breakpoint, selecting a breakpoint receiving end from a plurality of data receiving ends;
[0042] Acquiring real-time status data of a plurality of data receiving terminals;
[0043] A collaborative analysis is performed based on the multiple real-time status data, and a collaborative receiving end is matched from the multiple data receiving ends.
[0044] As a further limitation of the technical solution of the embodiment of the present invention, the step of determining the breakpoint data subpacket from the plurality of identification data subpackets and collaboratively transmitting the breakpoint data subpacket to the breakpoint receiving end through the collaborative receiving end specifically comprises the following steps:
[0045] Determining a breakpoint data sub-packet from the plurality of identified data sub-packets;
[0046] Create collaborative transfer instructions;
[0047] Transmitting the breakpoint data subpacket and the cooperative transmission instruction to the cooperative receiving end;
[0048] The breakpoint data is sub-packeted and cooperatively transmitted to the breakpoint receiving end through the cooperative receiving end.
[0049] A monitoring data breakpoint resume transmission system, the system comprises a data sub-packet processing module, a sub-packet directory generating module, a sub-packet transmission monitoring module, a breakpoint verification processing module and a sub-packet collaborative transmission module, wherein:
[0050] The data packet processing module is used to receive multi-target transmission tasks, determine the data transmission end and multiple data receiving ends, extract the target transmission data, perform packet and identification processing, and generate multiple identification data packets;
[0051] A sub-packet directory generation module is used to generate a sub-packet transmission directory based on multiple identification data sub-packets and send it to multiple data receiving terminals;
[0052] A sub-packet transmission monitoring module is used to perform direct transmission, identical forwarding and transmission monitoring on a plurality of identified data sub-packets between a data transmission end and a plurality of data receiving ends according to the sub-packet transmission directory, and obtain transmission monitoring data;
[0053] A breakpoint check processing module, used to perform breakpoint check on the transmission monitoring data based on the sub-packet transmission directory, select a breakpoint receiving end from the multiple data receiving ends, and match the cooperative receiving end;
[0054] The subpacket cooperative transmission module is used to determine the breakpoint data subpacket from the multiple identification data subpackets, and cooperatively transmit the breakpoint data subpacket to the breakpoint receiving end through the cooperative receiving end.
[0055] As a further limitation of the technical solution of the embodiment of the present invention, the data packet processing module specifically includes:
[0056] A task receiving unit, used for receiving multi-target transmission tasks;
[0057] A task identification unit, used to identify the multi-target transmission task and determine a data transmission end and multiple data receiving ends;
[0058] A data extraction unit, used to extract target transmission data from the multi-target transmission task;
[0059] A subpacket calculation unit, used to perform data subpacket calculations and determine the number of data subpackets and the start and end position data;
[0060] A data segmentation unit, configured to segment the target transmission data into a plurality of basic data subpackets according to the number of the data subpackets and the starting position data;
[0061] The identification processing unit is used to perform identification processing on the multiple basic data sub-packets to generate multiple identification data sub-packets.
[0062] As a further limitation of the technical solution of the embodiment of the present invention, the sub-packet transmission monitoring module specifically includes:
[0063] A task creation unit, used for creating a sub-packet transmission task according to the sub-packet transmission directory;
[0064] A direct transmission monitoring unit is used to perform direct transmission and transmission task monitoring on a plurality of identification data subpackets between a data transmission end and a plurality of data receiving ends according to the subpacket transmission task, and obtain task monitoring data;
[0065] An identical selection unit, used for selecting a plurality of identical data sub-packets from a plurality of identification data sub-packets according to task monitoring data;
[0066] A same division unit, used for dividing the plurality of the same data subpackets into transmitted same subpackets and a plurality of to-be-transmitted same subpackets;
[0067] A receiving end matching unit, used for matching the transmitted receiving end corresponding to the transmitted same subpacket from the multiple data receiving ends, and matching the multiple to-be-transmitted receiving ends corresponding to the multiple to-be-transmitted same subpackets;
[0068] The same forwarding unit is used to modify the identification of the transmitted identical sub-packets through the transmitted receiving end, and forward them to multiple corresponding receiving ends to be transmitted;
[0069] The process monitoring unit is used to perform real-time transmission process monitoring and obtain transmission monitoring data.
[0070] Compared with the prior art, the present invention has the following beneficial effects:
[0071] The embodiment of the present invention receives a multi-target transmission task, determines a data transmission end and multiple data receiving ends, and performs packetization and identification processing; generates a packet transmission directory; performs direct transmission, identical forwarding, and transmission monitoring on multiple identified data subpackets; performs breakpoint verification on the transmission monitoring data, selects a breakpoint receiving end, and matches a collaborative receiving end; determines a breakpoint data subpacket from multiple identified data subpackets, and transmits the breakpoint data subpacket collaboratively to the breakpoint receiving end through the collaborative receiving end. Direct transmission, identical forwarding, and breakpoint collaborative transmission can be performed between the data transmission end and multiple data receiving ends, which can not only realize breakpoint resume transmission during multi-target transmission, but also improve the speed and stability of data transmission through collaboration between multiple targets, and effectively avoid speed drop or transmission failure in breakpoint resume transmission. BRIEF DESCRIPTION OF THE DRAWINGS
[0072] Figure 1 A flow chart of a method for breakpoint-resume transmission of monitoring data provided by an embodiment of the present invention is shown;
[0073] Figure 2 A flowchart showing the subpackaging and marking process in the method provided by the embodiment of the present invention is shown;
[0074] Figure 3 A flow chart showing generation of a sub-packet transmission directory in a method provided in an embodiment of the present invention is shown;
[0075] Figure 4 A flow chart showing direct transmission, same forwarding and transmission monitoring in the method provided by an embodiment of the present invention is shown;
[0076] Figure 5 A flow chart showing breakpoint checking processing in the method provided by an embodiment of the present invention is shown;
[0077] Figure 6 A flowchart of the method provided by an embodiment of the present invention for collaborative transmission of data packets at interruption points is shown;
[0078] Figure 7 The application architecture diagram of the monitoring data breakpoint-resume transmission system provided by the embodiment of the present invention is shown;
[0079] Figure 8 The structure block diagram of the data packet processing module in the system provided by the embodiment of the present invention is shown;
[0080] Fig. 9 The structure block diagram of the packet transmission monitoring module in the system provided by the embodiment of the present invention is shown. DETAILED DESCRIPTION
[0081] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0082] It is understandable that in the prior art, breakpoint resume can only be implemented between a data transmission end and a data receiving end. In actual applications, when breakpoint resume is performed, various factors such as network environment volatility, server carrying capacity limitations and user bandwidth cause the speed and stability of the entire data transmission to be unable to be effectively guaranteed. Even if breakpoint resume is possible, the speed of breakpoint resume may drop or even fail.
[0083] To solve the above problems, an embodiment of the present invention discloses a method and system for resuming breakpoint transmission of monitoring data, which receives multi-target transmission tasks, determines a data transmission end and multiple data receiving ends, extracts target transmission data, performs packetization and identification processing, and generates multiple identification data packets; based on the multiple identification data packets, generates a packet transmission directory and sends it to multiple data receiving ends; according to the packet transmission directory, directly transmits, identically transfers and monitors the multiple identification data packets between the data transmission end and the multiple data receiving ends to obtain transmission monitoring data; based on the packet transmission directory, performs breakpoint check on the transmission monitoring data, selects a breakpoint receiving end from multiple data receiving ends, and matches the collaborative receiving end; determines the breakpoint data packet from the multiple identification data packets, and collaboratively transmits the breakpoint data packet to the breakpoint receiving end through the collaborative receiving end. It is capable of performing direct transmission, same-transmission and breakpoint collaborative transmission between the data transmission end and multiple data receiving ends. It can not only realize breakpoint resumption during multi-target transmission, but also improve the speed and stability of data transmission through collaboration between multiple targets, and effectively avoid speed drop or transmission failure in breakpoint resumption.
[0084] Specifically, Figure 1 The flowchart of the monitoring data breakpoint resume transmission method provided by the embodiment of the present invention is shown.
[0085] In a preferred embodiment of the present invention, a method for monitoring data breakpoint resuming transmission is provided, and the method specifically comprises the following steps:
[0086] Step S101, receiving a multi-target transmission task, determining a data transmission end and multiple data receiving ends, extracting target transmission data, performing packetization and identification processing, and generating multiple identification data packets.
[0087] In an embodiment of the present invention, by receiving a multi-target transmission task, the transmission target of the multi-target transmission task is identified, a data transmission end and multiple data receiving ends are determined, and the target transmission data to be transmitted is extracted from the multi-target transmission task, and the number of data subpackets and the start and end position data are determined by performing data subpacketization calculation on the target transmission data, and then the target transmission data is processed according to the number of data subpackets and the start position data, and the target transmission data is divided into multiple basic data subpackets, and subpacket identifiers corresponding to multiple basic data subpackets are generated according to the division order of the multiple basic data subpackets, and then corresponding subpacket identifiers are added to the multiple basic data subpackets to generate multiple identified data subpackets. Specifically, the calculation formula for the number of data subpackets is:
[0088]
[0089] Among them, n is the number of data packets, S p The data size of the target transmission data, S s It is the preset standard data packet size;
[0090] The calculation formula for the start and end position data is:
[0091] A i =(i-1)S s +1;
[0092]
[0093] Among them, A i is the starting position of the ith subpacket, B i is the end position of the ith subpacket, and all the start positions and end positions constitute the start and end position data.
[0094] It is understandable that before the packetization and identification processing, the network status between the data transmission end and the multiple data receiving ends is detected, and the standard data packet size S is adjusted according to the network status between the data transmission end and the multiple data receiving ends. s , when the network delay is small, the standard data is divided into packets of size S s Increase; when the network delay is large, the standard data packet size S s Reduce, thereby effectively reducing the chance of packet loss.
[0095] It can be understood that in the calculation formula for the number of data packets, % represents the calculation of the remainder after division.
[0096] Specifically, Figure 2 A flow chart showing the subpackaging and marking process in the method provided by the embodiment of the present invention is shown.
[0097] Among them, in another preferred embodiment provided by the present invention, the receiving of multi-target transmission tasks, determining a data transmission end and multiple data receiving ends, extracting target transmission data, performing packetization and identification processing, and generating multiple identification data packets specifically include the following steps:
[0098] Step S1011: receiving a multi-target transmission task.
[0099] Step S1012: Identify the multi-target transmission task and determine a data transmission end and multiple data receiving ends.
[0100] Step S1013: extracting target transmission data from the multi-target transmission task.
[0101] Step S1014: perform data subpacket calculation to determine the number of data subpackets and the start and end position data.
[0102] Step S1015: Divide the target transmission data into multiple basic data subpackets according to the number of data subpackets and the starting position data.
[0103] Step S1016: perform identification processing on the multiple basic data sub-packets to generate multiple identification data sub-packets.
[0104] Furthermore, the monitoring data breakpoint resume transmission method further includes the following steps:
[0105] Step S102: based on the multiple identification data packets, generate a packet transmission directory and send it to multiple data receiving ends.
[0106] In an embodiment of the present invention, by extracting subpacket identifiers corresponding to multiple identification data subpackets and analyzing multi-target transmission tasks, the data transmission relationship between the multiple identification data subpackets and the multiple data receiving ends is recorded, and then based on the data transmission relationship and the multiple subpacket identifiers, a subpacket transmission directory is created, and the subpacket transmission directory is sent to the multiple data receiving ends.
[0107] Specifically, Figure 3 A flow chart of generating a sub-packet transmission directory in the method provided by an embodiment of the present invention is shown.
[0108] Among them, in another preferred embodiment provided by the present invention, the step of subpacketizing based on multiple identification data, generating a subpacket transmission directory, and sending the subpacket transmission directory to multiple data receiving terminals specifically includes the following steps:
[0109] Step S1021, extracting sub-package identifiers corresponding to the multiple identification data sub-packages.
[0110] Step S1022: Record the data transmission relationship between the multiple identification data subpackets and the multiple data receiving ends.
[0111] Step S1023: Create a sub-packet transmission directory according to the data transmission relationship and the multiple sub-packet identifiers.
[0112] Step S1024: Send the sub-packet transmission directory to the multiple data receiving ends.
[0113] Furthermore, the monitoring data breakpoint resume transmission method further includes the following steps:
[0114] Step S103: According to the subpacket transmission directory, between the data transmission end and the multiple data receiving ends, directly transmit, identically transfer and monitor the transmission of the multiple identification data subpackets to obtain transmission monitoring data.
[0115] In an embodiment of the present invention, a subpacket transmission task is created according to a subpacket transmission directory. According to the subpacket transmission task, multiple identified data subpackets are directly transmitted between a data transmission end and multiple data receiving ends, and transmission task monitoring is performed to obtain task monitoring data. Then, according to the task monitoring data, multiple identical data subpackets are selected from multiple identified data subpackets. According to the transmission status of the multiple identical data subpackets, the multiple identical data subpackets are divided into transmitted identical subpackets and multiple identical subpackets to be transmitted. Then, from multiple data receiving ends, the transmitted receiving ends corresponding to the transmitted identical subpackets are matched, and the multiple to-be-transmitted receiving ends corresponding to the multiple to-be-transmitted identical subpackets are matched. Then, when multiple to-be-transmitted identical subpackets need to be transmitted, the transmitted receiving ends modify the identification of the transmitted identical subpackets according to the subpacket identifications corresponding to the multiple to-be-transmitted identical subpackets, and transfer them to the multiple corresponding to-be-transmitted receiving ends, without the data transmission end transmitting the multiple to-be-transmitted identical subpackets, thereby reducing the amount of data directly transmitted, alleviating the queue congestion, and performing real-time transmission process monitoring to obtain transmission monitoring data.
[0116] It can be understood that the transmission task monitoring is a process of monitoring whether a plurality of identification data sub-packets have been transmitted, not transmitted and the contents of the sub-packets based on the sub-packet transmission task.
[0117] It can be understood that the data contents of multiple identical data subpackets are identical; the condition for selecting multiple identical data subpackets is that one of the identical data subpackets has completed transmission.
[0118] It can be understood that the transmission process monitoring is to sub-packetize the identification data being transmitted and monitor the transmission results to provide support for subsequent breakpoint judgment.
[0119] Specifically, Figure 4 The flowchart of direct transmission, same forwarding and transmission monitoring in the method provided by the embodiment of the present invention is shown.
[0120] Among them, in another preferred embodiment provided by the present invention, according to the subpacket transmission directory, between the data transmission end and the multiple data receiving ends, the multiple identification data subpackets are directly transmitted, identically forwarded and transmitted, and the transmission monitoring data is obtained, which specifically includes the following steps:
[0121] Step S1031: Create a sub-packet transmission task according to the sub-packet transmission directory.
[0122] Step S1032: According to the subpacket transmission task, directly transmit and monitor the transmission task for multiple identification data subpackets between the data transmission end and multiple data receiving ends to obtain task monitoring data.
[0123] Step S1033: Select multiple identical data sub-packets from multiple identified data sub-packets according to the task monitoring data.
[0124] Step S1034: divide the plurality of identical data subpackets into transmitted identical subpackets and a plurality of identical subpackets to be transmitted.
[0125] Step S1035: from the plurality of data receiving ends, match the transmitted receiving ends corresponding to the transmitted identical subpackets, and match the plurality of to-be-transmitted receiving ends corresponding to the plurality of to-be-transmitted identical subpackets.
[0126] Step S1036: modify the identification of the transmitted identical sub-packets through the transmitted receiving end, and forward them to multiple corresponding receiving ends to be transmitted.
[0127] Step S1037: Perform real-time transmission process monitoring to obtain transmission monitoring data.
[0128] Furthermore, the monitoring data breakpoint resume transmission method further includes the following steps:
[0129] Step S104: Based on the sub-packet transmission directory, the transmission monitoring data is subjected to breakpoint verification, a breakpoint receiving end is selected from the plurality of data receiving ends, and a cooperative receiving end is matched.
[0130] In an embodiment of the present invention, based on the packet transmission directory, real-time breakpoint verification is performed on the transmission monitoring data to determine whether there is a data transmission breakpoint. When it is determined that there is a data transmission breakpoint, a breakpoint receiving end is selected from multiple data receiving ends, and real-time status data of the multiple data receiving ends are obtained. Then, a collaborative status comparison is performed based on the multiple real-time status data, and a collaborative receiving end with the best collaborative status is selected from the multiple data receiving ends.
[0131] It can be understood that collaborative status comparison is a process of comparing network statuses of multiple data receiving ends.
[0132] Specifically, Figure 5 A flow chart of breakpoint checking processing in the method provided by an embodiment of the present invention is shown.
[0133] Among them, in another preferred embodiment provided by the present invention, the breakpoint check of the transmission monitoring data based on the subpacket transmission directory, selecting a breakpoint receiving end from a plurality of the data receiving ends, and matching the cooperative receiving end specifically include the following steps:
[0134] Step S1041: Based on the sub-packet transmission directory, perform real-time breakpoint verification on the transmission monitoring data to determine whether there is a data transmission breakpoint.
[0135] Step S1042: When there is a data transmission breakpoint, select a breakpoint receiving end from the multiple data receiving ends.
[0136] Step S1043: Acquire real-time status data of the multiple data receiving ends.
[0137] Step S1044: perform collaborative analysis based on the multiple real-time status data, and match a collaborative receiving end from the multiple data receiving ends.
[0138] Furthermore, the monitoring data breakpoint resume transmission method further includes the following steps:
[0139] Step S105 , determining a breakpoint data subpacket from the plurality of identification data subpackets, and cooperatively transmitting the breakpoint data subpacket to the breakpoint receiving end through the cooperative receiving end.
[0140] In an embodiment of the present invention, based on transmission monitoring data, a breakpoint data subpacket is determined from multiple identification data subpackets, a collaborative transmission instruction is created, and the breakpoint data subpacket and the collaborative transmission instruction are transmitted to the collaborative receiving end, so that the collaborative receiving end can respond to the collaborative transmission instruction and collaboratively transmit the breakpoint data subpacket to the breakpoint receiving end, thereby realizing data breakpoint resumption.
[0141] Specifically, Figure 6 A flow chart of the collaborative transmission of data packets at interruption points of the method provided by an embodiment of the present invention is shown.
[0142] Among them, in another preferred embodiment provided by the present invention, the step of determining a breakpoint data subpacket from the plurality of identification data subpackets and cooperatively transmitting the breakpoint data subpacket to the breakpoint receiving end through the cooperative receiving end specifically comprises the following steps:
[0143] Step S1051: Determine a breakpoint data sub-packet from the plurality of identification data sub-packets.
[0144] Step S1052: Create a collaborative transmission instruction.
[0145] Step S1053: Transmit the breakpoint data subpacket and the collaborative transmission instruction to the collaborative receiving end.
[0146] Step S1054: The breakpoint data is sub-packeted and collaboratively transmitted to the breakpoint receiving end through the collaborative receiving end.
[0147] Furthermore, Figure 7 The application architecture diagram of the monitoring data breakpoint resume transmission system provided by an embodiment of the present invention is shown.
[0148] Specifically, in another preferred embodiment of the present invention, a monitoring data breakpoint resume transmission system includes:
[0149] The data packet processing module 101 is used to receive multi-target transmission tasks, determine a data transmission end and multiple data receiving ends, extract target transmission data, perform packet and identification processing, and generate multiple identified data packets.
[0150] In the embodiment of the present invention, the data packet processing module 101 receives a multi-target transmission task, identifies the transmission target of the multi-target transmission task, determines the data transmission end and multiple data receiving ends, and extracts the target transmission data to be transmitted from the multi-target transmission task, and performs data packet calculation on the target transmission data to determine the number of data packets and the start and end position data, and then performs data packet processing on the target transmission data according to the number of data packets and the start position data, and divides the target transmission data into multiple basic data packets, and generates packet identifiers corresponding to multiple basic data packets according to the division order of the multiple basic data packets, and then adds corresponding packet identifiers to the multiple basic data packets to generate multiple identified data packets. Specifically, the calculation formula for the number of data packets is:
[0151]
[0152] Among them, n is the number of data packets, S p is the data size of the target transmission data, S s It is the preset standard data packet size;
[0153] The calculation formula for the start and end position data is:
[0154] A i =(i-1)S s +1;
[0155]
[0156] Among them, A i is the starting position of the ith subpacket, B iis the end position of the ith subpacket, and all the start positions and end positions constitute the start and end position data.
[0157] Furthermore, Figure 8 It shows a structural block diagram of the data packet processing module 101 in the system provided by the embodiment of the present invention.
[0158] Specifically, in another preferred embodiment of the present invention, the data packet processing module 101 specifically includes:
[0159] The task receiving unit 1011 is used to receive a multi-target transmission task.
[0160] The task identification unit 1012 is used to identify the multi-target transmission task and determine a data transmission end and multiple data receiving ends.
[0161] The data extraction unit 1013 is used to extract target transmission data from the multi-target transmission task.
[0162] The subpacket calculation unit 1014 is used to perform data subpacket calculation and determine the number of data subpackets and the start and end position data.
[0163] The data segmentation unit 1015 is used to segment the target transmission data into a plurality of basic data subpackets according to the number of data subpackets and the starting position data.
[0164] The identification processing unit 1016 is used to perform identification processing on the multiple basic data sub-packets to generate multiple identification data sub-packets.
[0165] Furthermore, the monitoring data breakpoint resume transmission system also includes:
[0166] The sub-packet directory generating module 102 is used to generate a sub-packet transmission directory based on multiple identification data sub-packets and send it to multiple data receiving ends.
[0167] In an embodiment of the present invention, the subpacket directory generation module 102 extracts the subpacket identifiers corresponding to the multiple identification data subpackets, analyzes the multi-target transmission tasks, records the data transmission relationship between the multiple identification data subpackets and the multiple data receiving ends, and then creates a subpacket transmission directory based on the data transmission relationship and the multiple subpacket identifiers, and sends the subpacket transmission directory to the multiple data receiving ends.
[0168] The sub-packet transmission monitoring module 103 is used to perform direct transmission, identical forwarding and transmission monitoring on multiple identification data sub-packets between the data transmission end and multiple data receiving ends according to the sub-packet transmission directory to obtain transmission monitoring data.
[0169] In the embodiment of the present invention, the packet transmission monitoring module 103 creates a packet transmission task according to the packet transmission directory, and according to the packet transmission task, directly transmits multiple identification data packets between the data transmission end and multiple data receiving ends, and performs transmission task monitoring to obtain task monitoring data, and then selects multiple identical data packets from the multiple identification data packets according to the task monitoring data, and divides the multiple identical data packets into transmitted identical packets and multiple identical packets to be transmitted according to the transmission status of the multiple identical data packets, and then matches the transmitted receiving ends corresponding to the transmitted identical packets and the multiple to-be-transmitted receiving ends corresponding to the multiple to-be-transmitted identical packets from the multiple data receiving ends, and then, when multiple to-be-transmitted identical packets need to be transmitted, the transmitted receiving ends modify the identification of the transmitted identical packets according to the packet identifications corresponding to the multiple to-be-transmitted identical packets, and transfer them to the multiple corresponding to-be-transmitted receiving ends, without the data transmission end transmitting the multiple to-be-transmitted identical packets, thereby reducing the amount of data directly transmitted, alleviating the queuing congestion, and performing real-time transmission process monitoring to obtain transmission monitoring data.
[0170] Furthermore, Fig. 9 It shows a structural block diagram of the packet transmission monitoring module 103 in the system provided by the embodiment of the present invention.
[0171] Specifically, in another preferred embodiment provided by the present invention, the packet transmission monitoring module 103 specifically includes:
[0172] The task creation unit 1031 is used to create a sub-packet transmission task according to the sub-packet transmission directory.
[0173] The direct transmission monitoring unit 1032 is used to perform direct transmission and transmission task monitoring on multiple identification data subpackets between the data transmission end and multiple data receiving ends according to the subpacket transmission task, and obtain task monitoring data.
[0174] The same selection unit 1033 is used to select a plurality of identical data sub-packets from a plurality of identification data sub-packets according to the task monitoring data.
[0175] The same division unit 1034 is used to divide the multiple same data subpackets into transmitted same subpackets and multiple same subpackets to be transmitted.
[0176] The receiving end matching unit 1035 is used to match the transmitted receiving end corresponding to the transmitted same subpacket from the multiple data receiving ends, and match the multiple to-be-transmitted receiving ends corresponding to the multiple to-be-transmitted same subpackets.
[0177] The same forwarding unit 1036 is used to modify the identification of the transmitted identical sub-packets through the transmitted receiving end, and forward them to multiple corresponding receiving ends to be transmitted.
[0178] The process monitoring unit 1037 is used to perform real-time transmission process monitoring and obtain transmission monitoring data.
[0179] Furthermore, the monitoring data breakpoint resume transmission system also includes:
[0180] The breakpoint check processing module 104 is used to perform breakpoint check on the transmission monitoring data based on the subpacket transmission directory, select a breakpoint receiving end from the multiple data receiving ends, and match the cooperative receiving end.
[0181] In an embodiment of the present invention, the breakpoint check processing module 104 performs real-time breakpoint check on the transmission monitoring data based on the packet transmission directory to determine whether there is a data transmission breakpoint. When it is determined that there is a data transmission breakpoint, a breakpoint receiving end is selected from multiple data receiving ends, and real-time status data of multiple data receiving ends are obtained. Then, a collaborative status comparison is performed based on the multiple real-time status data, and a collaborative receiving end with the best collaborative status is selected from multiple data receiving ends.
[0182] The sub-packet cooperative transmission module 105 is used to determine the breakpoint data sub-packet from the multiple identification data sub-packets, and cooperatively transmit the breakpoint data sub-packet to the breakpoint receiving end through the cooperative receiving end.
[0183] In an embodiment of the present invention, the packet collaborative transmission module 105 determines the breakpoint data packet from multiple identified data packets based on the transmission monitoring data, creates a collaborative transmission instruction, and transmits the breakpoint data packet and the collaborative transmission instruction to the collaborative receiving end, so that the collaborative receiving end can respond to the collaborative transmission instruction and collaboratively transmit the breakpoint data packet to the breakpoint receiving end, thereby realizing data breakpoint resumption.
[0184] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.
[0185] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0186] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.
Claims
1. A method for monitoring data breakpoint resuming transmission, characterized in that: The method specifically comprises the following steps: Receive multi-target transmission tasks, determine a data transmission end and multiple data receiving ends, extract target transmission data, perform packetization and identification processing, and generate multiple identification data packets; Based on the multiple identification data packets, a packet transmission directory is generated and sent to multiple data receiving terminals; According to the subpacket transmission directory, between a data transmission end and a plurality of data receiving ends, a plurality of identification data subpackets are directly transmitted, identically forwarded, and transmitted and monitored to obtain transmission monitoring data; Based on the sub-packet transmission directory, the transmission monitoring data is breakpoint checked, a breakpoint receiving end is selected from the plurality of data receiving ends, and a cooperative receiving end is matched; A breakpoint data subpacket is determined from the plurality of identification data subpackets, and the breakpoint data subpacket is cooperatively transmitted to the breakpoint receiving end through the cooperative receiving end.
2. The monitoring data breakpoint resume transmission method according to claim 1, characterized in that: The receiving of multi-target transmission tasks, determining a data transmission end and multiple data receiving ends, extracting target transmission data, performing sub-packetization and identification processing, and generating multiple identification data sub-packets specifically include the following steps: Receive multi-target transmission tasks; Identifying the multi-target transmission task, and determining a data transmission end and a plurality of data receiving ends; Extracting target transmission data from the multi-target transmission task; Perform data subpackaging calculations to determine the number of data subpackaging and the start and end position data; According to the number of data subpackets and the starting position data, the target transmission data is divided into a plurality of basic data subpackets; The plurality of basic data sub-packets are subjected to identification processing to generate a plurality of identification data sub-packets.
3. The monitoring data breakpoint resume transmission method according to claim 2, characterized in that: The calculation formula for the number of data subpackets is: Among them, n is the number of data packets, S p is the data size of the target transmission data, S s The default standard data packet size is: The calculation formula of the start and end position data is: A i =(i-1)S s +1; Among them, A i is the starting position of the ith subpacket, B i is the end position of the ith subpacket, and all the start positions and end positions constitute the start and end position data.
4. The monitoring data breakpoint resume transmission method according to claim 1, characterized in that: The step of generating a sub-packet transmission directory based on multiple identification data sub-packets and sending the sub-packet transmission directory to multiple data receiving terminals specifically includes the following steps: Extracting subpackage identifiers corresponding to a plurality of the identification data subpackages; Recording the data transmission relationship between the plurality of identification data subpackets and the plurality of data receiving ends; Creating a sub-packet transmission directory according to the data transmission relationship and the plurality of sub-packet identifiers; The sub-packet transmission directory is sent to the plurality of data receiving ends.
5. The monitoring data breakpoint resume transmission method according to claim 1, characterized in that: According to the sub-packet transmission directory, between the data transmission end and the multiple data receiving ends, directly transmitting, identically forwarding and transmitting monitoring are performed on the multiple identification data sub-packets, and obtaining the transmission monitoring data specifically comprises the following steps: Creating a sub-package transmission task according to the sub-package transmission directory; According to the sub-packet transmission task, directly transmit and monitor the transmission task for multiple identification data sub-packets between the data transmission end and multiple data receiving ends to obtain task monitoring data; According to the task monitoring data, multiple identical data sub-packets are selected from multiple identified data sub-packets; Dividing the plurality of identical data subpackets into transmitted identical subpackets and a plurality of identical subpackets to be transmitted; From the plurality of data receiving ends, matching the transmitted receiving ends corresponding to the transmitted identical subpackets, and matching the plurality of to-be-transmitted receiving ends corresponding to the plurality of to-be-transmitted identical subpackets; Modifying the identification of the transmitted identical sub-packets through the transmitted receiving end, and forwarding them to a plurality of corresponding receiving ends to be transmitted; Conduct real-time transmission process monitoring and obtain transmission monitoring data.
6. The monitoring data breakpoint resume transmission method according to claim 1, characterized in that: The step of performing breakpoint check on the transmission monitoring data based on the subpacket transmission directory, selecting a breakpoint receiving end from a plurality of data receiving ends, and matching a cooperative receiving end specifically comprises the following steps: Based on the sub-packet transmission directory, performing real-time breakpoint verification on the transmission monitoring data to determine whether there is a data transmission breakpoint; When there is a data transmission breakpoint, selecting a breakpoint receiving end from a plurality of data receiving ends; Acquiring real-time status data of a plurality of data receiving terminals; A collaborative analysis is performed based on the multiple real-time status data, and a collaborative receiving end is matched from the multiple data receiving ends.
7. The monitoring data breakpoint resume transmission method according to claim 1, characterized in that: The step of determining a breakpoint data subpacket from the plurality of identification data subpackets and cooperatively transmitting the breakpoint data subpacket to the breakpoint receiving end through the cooperative receiving end specifically comprises the following steps: Determining a breakpoint data sub-packet from the plurality of identified data sub-packets; Create collaborative transfer instructions; Transmitting the breakpoint data subpacket and the cooperative transmission instruction to the cooperative receiving end; The breakpoint data is sub-packeted and cooperatively transmitted to the breakpoint receiving end through the cooperative receiving end.
8. A monitoring data breakpoint resume transmission system, characterized in that: The system includes a data sub-packet processing module, a sub-packet directory generating module, a sub-packet transmission monitoring module, a breakpoint checking processing module and a sub-packet coordinated transmission module, wherein: The data packet processing module is used to receive multi-target transmission tasks, determine the data transmission end and multiple data receiving ends, extract the target transmission data, perform packet and identification processing, and generate multiple identification data packets; A sub-packet directory generation module is used to generate a sub-packet transmission directory based on multiple identification data sub-packets and send it to multiple data receiving terminals; A sub-packet transmission monitoring module is used to perform direct transmission, identical forwarding and transmission monitoring on a plurality of identified data sub-packets between a data transmission end and a plurality of data receiving ends according to the sub-packet transmission directory, and obtain transmission monitoring data; A breakpoint check processing module, used to perform breakpoint check on the transmission monitoring data based on the sub-packet transmission directory, select a breakpoint receiving end from the multiple data receiving ends, and match the cooperative receiving end; The subpacket cooperative transmission module is used to determine the breakpoint data subpacket from the multiple identification data subpackets, and cooperatively transmit the breakpoint data subpacket to the breakpoint receiving end through the cooperative receiving end.
9. The monitoring data breakpoint resume transmission system according to claim 8, characterized in that: The data subpacketization processing module specifically includes: A task receiving unit, used for receiving multi-target transmission tasks; A task identification unit, used to identify the multi-target transmission task and determine a data transmission end and multiple data receiving ends; A data extraction unit, used to extract target transmission data from the multi-target transmission task; A subpacket calculation unit, used to perform data subpacket calculations and determine the number of data subpackets and the start and end position data; A data segmentation unit, configured to segment the target transmission data into a plurality of basic data subpackets according to the number of the data subpackets and the starting position data; The identification processing unit is used to perform identification processing on the multiple basic data sub-packets to generate multiple identification data sub-packets.
10. The monitoring data breakpoint resume transmission system according to claim 8, characterized in that: The sub-packet transmission monitoring module specifically includes: A task creation unit, used for creating a sub-packet transmission task according to the sub-packet transmission directory; A direct transmission monitoring unit is used to perform direct transmission and transmission task monitoring on a plurality of identification data subpackets between a data transmission end and a plurality of data receiving ends according to the subpacket transmission task, and obtain task monitoring data; An identical selection unit, used for selecting a plurality of identical data sub-packets from a plurality of identification data sub-packets according to task monitoring data; A same division unit, used for dividing the plurality of the same data subpackets into transmitted same subpackets and a plurality of to-be-transmitted same subpackets; A receiving end matching unit, used for matching the transmitted receiving end corresponding to the transmitted same subpacket from the multiple data receiving ends, and matching the multiple to-be-transmitted receiving ends corresponding to the multiple to-be-transmitted same subpackets; The same forwarding unit is used to modify the identification of the transmitted identical sub-packets through the transmitted receiving end, and forward them to multiple corresponding receiving ends to be transmitted; The process monitoring unit is used to perform real-time transmission process monitoring and obtain transmission monitoring data.
Citation Information
Patent Citations
Method and device for transmission of message file
CN102088394A
Local storage time-sharing transmission method
CN112235627A
Mirror image file uploading method, related equipment and computer storage medium
CN113411363A
File transmission method and system, electronic equipment and storage medium
CN115484250A
Service message processing method and device, computer equipment and storage medium
CN118677837A
Cited By
A port data synchronization fault-tolerant recovery method and system based on breakpoint continuation
CN122817181A