Message queue telemetry transport method and system based on data plane development kit

CN116828044BActive Publication Date: 2026-08-18HUIZHIAN INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211548423.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-05
Publication Date
2026-08-18
Estimated Expiration
2042-12-05

AI Technical Summary

Technical Problem

上述通信方式需要以用户端的操作系统作为中介,用户端需要接收大量数据时,相应的操作系统也需要进行大量的数据中转操作,增加操作系统的工作负荷

Benefits of technology

[0036] Compared to existing technologies, this message queue remote sensing transmission method and system based on a data plane development kit generates a user-space protocol stack for the data plane development kit based on all user terminals with data receiving permissions on the Internet. It captures relevant data packets from the gateway corresponding to the server, and sends these packets directly to the user-space protocol stack according to their attribute information, forming a data packet queue. Based on the user terminal's data extraction request, it extracts the corresponding data packets from the data packet queue and sends them directly to the user terminal that generated the data extraction request for processing, following the appropriate network path. By constructing a user-space protocol stack for the user terminal's data plane development kit, it replaces the operating system as the intermediary for data transmission. In this way, data packets from the server are received and arranged into a data packet queue by the user-space protocol stack. Then, based on the user terminal's data extraction request, the appropriate data packets are extracted and sent, ensuring that the user terminal receives the required data packets in a timely and accurate manner. During data transmission, it does not impose a workload on the operating system. Furthermore, by using the user-space protocol stack as a data transmission relay medium, it eliminates the need for multiple data copies, preventing data tampering or loss, thereby improving the security and reliability of data transmission.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116828044B_ABST
    Figure CN116828044B_ABST
Patent Text Reader

Abstract

The application provides a message queue remote transmission method and system based on a data plane development kit, which constructs a data plane development kit user state protocol stack about a user end face to replace an operating system as a medium for data transmission, so that data packets from a server are received and arranged by the user state protocol stack to form a data packet queue, suitable data packets are extracted from the data packet queue according to a data extraction request of the user end and are sent, the user end accurately receives the required data packets in time, the operating system is not caused to have a work load in the data transmission process, the user state protocol stack is used as a data transmission transfer medium, data does not need to be copied multiple times, data tampering or data loss is avoided, and therefore the safety and reliability of data transmission are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the technical field of Internet data transmission, and in particular to a message queue remote sensing transmission method and system based on a data plane development kit. Background Technology

[0002] Currently, communication methods based on the Message Queuing Telemetry (MQTT) protocol all involve forwarding received data through the user's operating system to the corresponding user space for processing. This method relies on the user's operating system as an intermediary; when the user needs to receive large amounts of data, the operating system also needs to perform numerous data relay operations, increasing its workload. Furthermore, this method requires multiple data copying operations, inevitably leading to data tampering or loss during the copying process, reducing the security and reliability of data transmission. Therefore, existing MQTT-based communication methods suffer from high data transmission workload, susceptibility to data tampering, and high packet loss rates, failing to guarantee normal, fast, and secure data transmission. Summary of the Invention

[0003] To address the shortcomings of existing technologies, this invention provides a message queue remote sensing transmission method and system based on a data plane development kit. It generates a user-space protocol stack for the data plane development kit based on all user terminals with data receiving permissions on the Internet. Relevant data packets are captured from the gateway corresponding to the server, and based on the packet attribute information, the packets are directly sent to the user-space protocol stack to form a data packet queue. Based on the user terminal's data extraction request, the corresponding data packets are extracted from the data packet queue and sent directly to the user terminal that generated the data extraction request for processing according to the corresponding network path. By constructing a user-space protocol stack based on the user terminal's data plane development kit, it replaces the operating system as the intermediary for data transmission. In this way, data packets from the server are received and arranged into a data packet queue by the user-space protocol stack. Then, based on the user terminal's data extraction request, the appropriate data packets are extracted and sent, ensuring that the user terminal receives the required data packets in a timely and accurate manner. During data transmission, it does not impose a workload on the operating system. Furthermore, by using the user-space protocol stack as a data transmission relay medium, it eliminates the need for multiple data copies, avoiding data tampering or loss, thereby improving the security and reliability of data transmission.

[0004] This invention provides a message queue remote sensing transmission method based on a data plane development kit, comprising the following steps:

[0005] Step S1: Determine the data receiving permission of the user terminal based on the communication status information of the user terminal connected to the Internet; generate the corresponding data plane development kit user-mode protocol stack based on the user terminal with data receiving permission.

[0006] Step S2: Obtain the data transmission status information of the gateway corresponding to the server; capture the data packets transmitted by the gateway based on the data transmission status information; parse the data packets to obtain the attribute information corresponding to the data packets.

[0007] Step S3: Based on the attribute information, the data packet is directly sent to the user-space protocol stack to form a data packet queue; based on the data extraction request from the user terminal, the corresponding data packet is extracted from the data packet queue.

[0008] Step S4: According to the corresponding network path, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing.

[0009] Further, in step S1, the data receiving permission of the user terminal is determined based on the communication status information of the user terminal connected to the Internet; based on the user terminal with data receiving permission, a corresponding data plane development kit user-space protocol stack is generated, including:

[0010] The system obtains the real-time communication load status information of all user terminals connected to the Internet, and extracts the uplink data communication rate and downlink data communication rate of the user terminals from the real-time communication load status information. If the uplink data communication rate is greater than a first preset rate threshold or the downlink data communication rate is greater than a second preset rate threshold, it is determined that the corresponding user terminal does not have data receiving permission; otherwise, it is determined that the corresponding user terminal has data receiving permission.

[0011] For each user terminal with data receiving permissions, the data plane development kit protocol is loaded, generating a data plane development kit user-mode protocol middleware corresponding to each user terminal with data receiving permissions; then, according to the priority order of data receiving permissions of all user terminals with data receiving permissions from high to low, all data plane development kit user-mode protocol middleware are arranged to form a data plane development kit user-mode protocol stack.

[0012] Further, in step S2, the data transmission status information of the gateway corresponding to the server is obtained; based on the data transmission status information, data packets transmitted by the gateway are captured; the data packets are parsed to obtain the attribute information corresponding to the data packets, including:

[0013] Obtain the real-time data transmission volume value of the gateway corresponding to the server in the Internet. If the real-time data transmission volume value is greater than or equal to a preset data volume threshold, capture the data packets currently being transmitted by the gateway.

[0014] The data packet is parsed to obtain the identity information of the user terminal to which the data packet needs to be transmitted, and this information is used as the attribute information.

[0015] Further, in step S3, based on the attribute information, the data packet is directly sent to the user-space protocol stack to form a data packet queue; based on the data extraction request from the user terminal, the corresponding data packet is extracted from the data packet queue, including:

[0016] Based on the identity information, a matching user-mode protocol middleware is selected from the user-mode protocol stack, and the data packet is sent to the selected user-mode protocol middleware, thereby forming a data packet queue at the middleware of the user-mode protocol stack for all data packets captured from the gateway at different times.

[0017] Based on the identity information contained in the data extraction request from a user terminal with data receiving permissions, extract the data packet corresponding to the user-state protocol intermediate terminal that matches the identity information from the data packet queue.

[0018] Furthermore, in step S4, the extracted data packets are directly sent to the user terminal that generated the data extraction request for processing according to the corresponding network path, including:

[0019] According to the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing, and the processing result is returned to the corresponding user-space protocol intermediate terminal according to the original network path.

[0020] This invention also provides a message queue remote sensing transmission system based on a data plane development kit, comprising:

[0021] The user-mode protocol stack generation module is used to determine the data receiving permissions of the user terminal based on the communication status information of the user terminal connected to the Internet; and to generate the corresponding data plane development kit user-mode protocol stack based on the user terminal with data receiving permissions.

[0022] The data packet identification module is used to obtain the data transmission status information of the gateway corresponding to the server, capture the data packets transmitted by the gateway based on the data transmission status information, and parse the data packets to obtain the attribute information corresponding to the data packets.

[0023] The data packet extraction module is used to send the data packets directly to the user-space protocol stack according to the attribute information, thereby forming a data packet queue; and to extract the corresponding data packets from the data packet queue according to the data extraction request from the user terminal.

[0024] The data packet sending module is used to send the extracted data packets directly to the user terminal that generated the data extraction request for processing, according to the corresponding network path.

[0025] Furthermore, the user-space protocol stack generation module determines the data receiving permissions of the user terminal based on the communication status information of the user terminal connected to the Internet; and generates a corresponding data plane development kit user-space protocol stack based on the user terminal with data receiving permissions, including:

[0026] The system obtains the real-time communication load status information of all user terminals connected to the Internet, and extracts the uplink data communication rate and downlink data communication rate of the user terminals from the real-time communication load status information. If the uplink data communication rate is greater than a first preset rate threshold or the downlink data communication rate is greater than a second preset rate threshold, it is determined that the corresponding user terminal does not have data receiving permission; otherwise, it is determined that the corresponding user terminal has data receiving permission.

[0027] For each user terminal with data receiving permissions, the data plane development kit protocol is loaded, generating a data plane development kit user-mode protocol middleware corresponding to each user terminal with data receiving permissions; then, according to the priority order of data receiving permissions of all user terminals with data receiving permissions from high to low, all data plane development kit user-mode protocol middleware are arranged to form a data plane development kit user-mode protocol stack.

[0028] Furthermore, the data packet identification module obtains the data transmission status information of the gateway corresponding to the server, and captures the data packets transmitted by the gateway based on the data transmission status information; it then parses the data packets to obtain the attribute information corresponding to the data packets, including:

[0029] Obtain the real-time data transmission volume value of the gateway corresponding to the server in the Internet. If the real-time data transmission volume value is greater than or equal to a preset data volume threshold, capture the data packets currently being transmitted by the gateway.

[0030] The data packet is parsed to obtain the identity information of the user terminal to which the data packet needs to be transmitted, and this information is used as the attribute information.

[0031] Furthermore, the data packet extraction module directly sends the data packet to the user-space protocol stack based on the attribute information, thereby forming a data packet queue; according to the data extraction request from the user terminal, it extracts the corresponding data packet from the data packet queue, including:

[0032] Based on the identity information, a matching user-mode protocol middleware is selected from the user-mode protocol stack, and the data packet is sent to the selected user-mode protocol middleware, thereby forming a data packet queue at the middleware of the user-mode protocol stack for all data packets captured from the gateway at different times.

[0033] Based on the identity information contained in the data extraction request from a user terminal with data receiving permissions, extract the data packet corresponding to the user-state protocol intermediate terminal that matches the identity information from the data packet queue.

[0034] Furthermore, the data packet sending module sends the extracted data packets directly to the user terminal that generated the data extraction request for processing, according to the corresponding network path, including:

[0035] According to the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing, and the processing result is returned to the corresponding user-space protocol intermediate terminal according to the original network path.

[0036] Compared to existing technologies, this message queue remote sensing transmission method and system based on a data plane development kit generates a user-space protocol stack for the data plane development kit based on all user terminals with data receiving permissions on the Internet. It captures relevant data packets from the gateway corresponding to the server, and sends these packets directly to the user-space protocol stack according to their attribute information, forming a data packet queue. Based on the user terminal's data extraction request, it extracts the corresponding data packets from the data packet queue and sends them directly to the user terminal that generated the data extraction request for processing, following the appropriate network path. By constructing a user-space protocol stack for the user terminal's data plane development kit, it replaces the operating system as the intermediary for data transmission. In this way, data packets from the server are received and arranged into a data packet queue by the user-space protocol stack. Then, based on the user terminal's data extraction request, the appropriate data packets are extracted and sent, ensuring that the user terminal receives the required data packets in a timely and accurate manner. During data transmission, it does not impose a workload on the operating system. Furthermore, by using the user-space protocol stack as a data transmission relay medium, it eliminates the need for multiple data copies, preventing data tampering or loss, thereby improving the security and reliability of data transmission.

[0037] Other features and advantages of the invention will be set forth in the following description, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0038] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0039] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0040] Figure 1 This is a flowchart illustrating the message queue remote sensing transmission method based on the data plane development kit provided by the present invention.

[0041] Figure 2 This is a schematic diagram of the structure of the message queue remote sensing transmission system based on the data plane development kit provided by the present invention. Detailed Implementation

[0042] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0043] See Figure 1 This is a flowchart illustrating a message queue remote sensing transmission method based on a data plane development kit provided in an embodiment of the present invention. The message queue remote sensing transmission method based on the data plane development kit includes the following steps:

[0044] Step S1: Determine the data receiving permission of the user terminal based on the communication status information of the user terminal connected to the Internet; generate the corresponding data plane development kit user-mode protocol stack based on the user terminal with data receiving permission.

[0045] Step S2: Obtain the data transmission status information of the gateway corresponding to the server; capture the data packets transmitted by the gateway based on the data transmission status information; parse the data packets to obtain the attribute information corresponding to the data packets.

[0046] Step S3: Based on the attribute information, the data packet is directly sent to the user-space protocol stack to form a data packet queue; based on the data extraction request from the user terminal, the corresponding data packet is extracted from the data packet queue.

[0047] Step S4: According to the corresponding network path, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing.

[0048] The beneficial effects of the above technical solution are as follows: This message queue remote sensing transmission method based on the data plane development kit generates a user-space protocol stack of the data plane development kit according to all user terminals with data receiving permissions on the Internet; it captures the corresponding data packets from the gateway corresponding to the server, and sends the data packets directly to the user-space protocol stack according to the attribute information of the data packets, forming a data packet queue; according to the data extraction request of the user terminal, it extracts the corresponding data packets from the data packet queue, and sends the extracted data packets directly to the user terminal that generated the data extraction request for processing according to the corresponding network path. By constructing a user-space protocol stack of the data plane development kit for the user terminal, it replaces the operating system as the medium for data transmission. In this way, data packets from the server are received and arranged by the user-space protocol stack to form a data packet queue, and then the appropriate data packets are extracted and sent according to the data extraction request of the user terminal, ensuring that the user terminal receives the required data packets in a timely and accurate manner. During the data transmission process, it does not cause a workload on the operating system. Furthermore, by using the user-space protocol stack as a data transmission relay medium, it is not necessary to copy the data multiple times, avoiding data tampering or data loss, thereby improving the security and reliability of data transmission.

[0049] Preferably, in step S1, the data receiving permission of the user terminal is determined based on the communication status information of the user terminal connected to the Internet; based on the user terminal with data receiving permission, a corresponding data plane development kit user-space protocol stack is generated, including:

[0050] Obtain the real-time communication load status information of all user terminals connected to the Internet, and extract the uplink data communication rate and downlink data communication rate of the user terminals from the real-time communication load status information; if the uplink data communication rate is greater than a first preset rate threshold or the downlink data communication rate is greater than a second preset rate threshold, then determine that the corresponding user terminal does not have data receiving permission; otherwise, determine that the corresponding user terminal has data receiving permission.

[0051] For each user terminal with data receiving permissions, the data plane development kit protocol is loaded, generating a data plane development kit user-mode protocol middleware corresponding to each user terminal with data receiving permissions; then, according to the priority order of data receiving permissions of all user terminals with data receiving permissions from high to low, all data plane development kit user-mode protocol middleware are arranged to form a data plane development kit user-mode protocol stack.

[0052] The beneficial effects of the above technical solution are as follows: The Internet connects servers and user terminals. The server, acting as a data source, provides data to user terminals such as personal computers, enabling corresponding computational tasks. Each user terminal, upon connecting to the Internet, performs uplink and downlink data communication transmissions. By monitoring the uplink and downlink data communication rates and real-time communication load status information of the user terminal, it is possible to determine whether the user terminal is currently in a data communication overload state. Specifically, when the uplink data communication rate exceeds a first preset rate threshold or the downlink data communication rate exceeds a second preset rate threshold, it indicates that the user terminal is currently in an uplink data transmission limit state or a downlink data transmission limit state, i.e., the user terminal is currently in a data communication overload state. At this time, the user terminal is prohibited from obtaining data receiving permissions associated with the server to avoid data congestion or crashes. When the user terminal is not currently in a data communication overload state, it is granted data receiving permissions associated with the server, ensuring normal data transmission between the user terminal and the server. Each user terminal with data receiving permissions loads the Data Plane Development Kit (DDP) protocol, generating a corresponding DDP user-mode protocol middleware. This middleware is a virtual server corresponding to a user terminal, compatible with the DDP, enabling accurate and secure management of received data packets. Furthermore, each user terminal with data receiving permissions is arranged in descending order of their internet data receiving permissions to form a DDP user-mode protocol stack. This ensures that each middleware receives data packets from the server in an orderly manner; the higher the user terminal's internet data receiving permissions, the earlier it receives data packets from the server.

[0053] Preferably, in step S2, the data transmission status information of the gateway corresponding to the server is obtained; based on the data transmission status information, the data packets transmitted by the gateway are captured; the data packets are parsed to obtain the attribute information corresponding to the data packets, including:

[0054] Get the real-time data transmission volume of the gateway connected to the server on the Internet. If the real-time data transmission volume is greater than or equal to the preset data volume threshold, capture the data packets currently being transmitted by the gateway.

[0055] The data packet is parsed to obtain the identity information of the user terminal to which the data packet needs to be transmitted, and this information is used as the attribute information.

[0056] The beneficial effects of the above technical solution are as follows: Real-time monitoring of the data transmission volume of the gateway to which the server is connected in the Internet enables timely and accurate capture of currently transmitted data packets from the gateway, avoiding missed data packet capture. Furthermore, each time the server sends a data packet, it adds the identity information of the user client to which it is intended. This data packet parsing process facilitates the accurate delivery of subsequently captured data packets to the corresponding user-space protocol middleware in the user-space protocol stack.

[0057] Preferably, in step S3, based on the attribute information, the data packet is directly sent to the user-space protocol stack to form a data packet queue; based on the data extraction request from the user terminal, the corresponding data packet is extracted from the data packet queue, including:

[0058] Based on the identity information, a matching user-mode protocol middleware is selected from the user-mode protocol stack, and the data packet is sent to the selected user-mode protocol middleware, thereby forming a data packet queue of all data packets captured from the gateway at different times in the user-mode protocol stack middleware.

[0059] Based on the identity information contained in the data extraction request from a user terminal with data receiving permissions, extract the data packet corresponding to the user-state protocol intermediate terminal that matches the identity information from the data packet queue.

[0060] The beneficial effects of the above technical solution are as follows: By using the parsed identity information as a starting point, a matching user-space protocol middleware is selected from the user-space protocol stack, and the extracted data packets are then sent to the selected user-space protocol middleware. This ensures that data packets captured from the gateway at different times are sent to the corresponding user-space protocol middleware, forming corresponding data packet queues, thus guaranteeing the correct and secure reception of data packets. Furthermore, based on the identity information contained in the data extraction request from a user terminal with data receiving permissions, data packets corresponding to the user-space protocol middleware matching the identity information are extracted from the data packet queue. This ensures that each data packet is accurately sent from the user-space protocol middleware to the corresponding user terminal, avoiding data packet mismatches.

[0061] Preferably, in step S4, the extracted data packets are directly sent to the user terminal that generated the data extraction request for processing according to the corresponding network path, including:

[0062] According to the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing, and the result of the processing is returned to the corresponding user-space protocol intermediate terminal according to the original network path.

[0063] The beneficial effects of the above technical solution are as follows: By using the above method, the data packet is sent to the corresponding user terminal based on the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request. This can improve the data transmission efficiency and avoid data packet transmission errors in the Internet. In addition, the result obtained by the user terminal after processing the received data packet is returned to the corresponding user-space protocol intermediate terminal according to the original shortest network path, thereby realizing the targeted storage of the processing result, which facilitates the server to accurately extract the processing result.

[0064] See Figure 2 This is a schematic diagram of the structure of a message queue remote sensing transmission system based on a data plane development kit provided in an embodiment of the present invention. The message queue remote sensing transmission system based on the data plane development kit includes:

[0065] The user-mode protocol stack generation module is used to determine the data receiving permissions of a user terminal based on the communication status information of the user terminal connected to the Internet; and to generate the corresponding data plane development kit user-mode protocol stack based on the user terminal with data receiving permissions.

[0066] The data packet identification module is used to obtain the data transmission status information of the gateway corresponding to the server, capture the data packets transmitted by the gateway based on the data transmission status information, and parse the data packets to obtain the attribute information corresponding to the data packets.

[0067] The packet extraction module is used to send the packet directly to the user-space protocol stack based on the attribute information, thereby forming a packet queue; and to extract the corresponding packet from the packet queue according to the data extraction request from the user.

[0068] The data packet sending module is used to send the extracted data packets directly to the user terminal that generated the data extraction request for processing, according to the corresponding network path.

[0069] The beneficial effects of the above technical solution are as follows: This message queue remote sensing transmission system based on the data plane development kit generates a user-mode protocol stack of the data plane development kit according to all user terminals with data receiving permissions on the Internet; it captures corresponding data packets from the gateway corresponding to the server, and sends the data packets directly to the user-mode protocol stack according to the attribute information of the data packets, forming a data packet queue; according to the data extraction request of the user terminal, it extracts the corresponding data packets from the data packet queue, and sends the extracted data packets directly to the user terminal that generated the data extraction request for processing according to the corresponding network path. By constructing a user-mode protocol stack of the data plane development kit for the user terminal, it replaces the operating system as the medium for data transmission. In this way, data packets from the server are received and arranged by the user-mode protocol stack to form a data packet queue, and then the appropriate data packets are extracted from the queue and sent according to the data extraction request of the user terminal, ensuring that the user terminal receives the required data packets in a timely and accurate manner. During the data transmission process, it does not put a workload on the operating system. Furthermore, by using the user-mode protocol stack as a data transmission relay medium, it is not necessary to copy the data multiple times, avoiding data tampering or data loss, thereby improving the security and reliability of data transmission.

[0070] Preferably, the user-space protocol stack generation module determines the data receiving permission of the user terminal based on the communication status information of the user terminal connected to the Internet; and generates a corresponding data plane development kit user-space protocol stack based on the user terminal with data receiving permission, including:

[0071] Obtain the real-time communication load status information of all user terminals connected to the Internet, and extract the uplink data communication rate and downlink data communication rate of the user terminals from the real-time communication load status information; if the uplink data communication rate is greater than a first preset rate threshold or the downlink data communication rate is greater than a second preset rate threshold, then determine that the corresponding user terminal does not have data receiving permission; otherwise, determine that the corresponding user terminal has data receiving permission.

[0072] For each user terminal with data receiving permissions, the data plane development kit protocol is loaded, generating a data plane development kit user-mode protocol middleware corresponding to each user terminal with data receiving permissions; then, according to the priority order of data receiving permissions of all user terminals with data receiving permissions from high to low, all data plane development kit user-mode protocol middleware are arranged to form a data plane development kit user-mode protocol stack.

[0073] The beneficial effects of the above technical solution are as follows: The Internet connects servers and user terminals. The server, acting as a data source, provides data to user terminals such as personal computers, enabling corresponding computational tasks. Each user terminal, upon connecting to the Internet, performs uplink and downlink data communication transmissions. By monitoring the uplink and downlink data communication rates and real-time communication load status information of the user terminal, it is possible to determine whether the user terminal is currently in a data communication overload state. Specifically, when the uplink data communication rate exceeds a first preset rate threshold or the downlink data communication rate exceeds a second preset rate threshold, it indicates that the user terminal is currently in an uplink data transmission limit state or a downlink data transmission limit state, i.e., the user terminal is currently in a data communication overload state. At this time, the user terminal is prohibited from obtaining data receiving permissions associated with the server to avoid data congestion or crashes. When the user terminal is not currently in a data communication overload state, it is granted data receiving permissions associated with the server, ensuring normal data transmission between the user terminal and the server. Each user terminal with data receiving permissions loads the Data Plane Development Kit (DDP) protocol, generating a corresponding DDP user-mode protocol middleware. This middleware is a virtual server corresponding to a user terminal, compatible with the DDP, enabling accurate and secure management of received data packets. Furthermore, each user terminal with data receiving permissions is arranged in descending order of their internet data receiving permissions to form a DDP user-mode protocol stack. This ensures that each middleware receives data packets from the server in an orderly manner; the higher the user terminal's internet data receiving permissions, the earlier it receives data packets from the server.

[0074] Preferably, the data packet identification module obtains the data transmission status information of the gateway corresponding to the server, captures the data packets transmitted by the gateway based on the data transmission status information, and parses the data packets to obtain the attribute information corresponding to the data packets, including:

[0075] Get the real-time data transmission volume of the gateway connected to the server on the Internet. If the real-time data transmission volume is greater than or equal to the preset data volume threshold, capture the data packets currently being transmitted by the gateway.

[0076] The data packet is parsed to obtain the identity information of the user terminal to which the data packet needs to be transmitted, and this information is used as the attribute information.

[0077] The beneficial effects of the above technical solution are as follows: Real-time monitoring of the data transmission volume of the gateway to which the server is connected in the Internet enables timely and accurate capture of currently transmitted data packets from the gateway, avoiding missed data packet capture. Furthermore, each time the server sends a data packet, it adds the identity information of the user client to which it is intended. This data packet parsing process facilitates the accurate delivery of subsequently captured data packets to the corresponding user-space protocol middleware in the user-space protocol stack.

[0078] Preferably, the data packet extraction module sends the data packet directly to the user-space protocol stack based on the attribute information, thereby forming a data packet queue; according to the data extraction request from the user terminal, it extracts the corresponding data packet from the data packet queue, including:

[0079] Based on the identity information, a matching user-mode protocol middleware is selected from the user-mode protocol stack, and the data packet is sent to the selected user-mode protocol middleware, thereby forming a data packet queue of all data packets captured from the gateway at different times in the user-mode protocol stack middleware.

[0080] Based on the identity information contained in the data extraction request from a user terminal with data receiving permissions, extract the data packet corresponding to the user-state protocol intermediate terminal that matches the identity information from the data packet queue.

[0081] The beneficial effects of the above technical solution are as follows: By using the parsed identity information as a starting point, a matching user-space protocol middleware is selected from the user-space protocol stack, and the extracted data packets are then sent to the selected user-space protocol middleware. This ensures that data packets captured from the gateway at different times are sent to the corresponding user-space protocol middleware, forming corresponding data packet queues, thus guaranteeing the correct and secure reception of data packets. Furthermore, based on the identity information contained in the data extraction request from a user terminal with data receiving permissions, data packets corresponding to the user-space protocol middleware matching the identity information are extracted from the data packet queue. This ensures that each data packet is accurately sent from the user-space protocol middleware to the corresponding user terminal, avoiding data packet mismatches.

[0082] Preferably, the data packet sending module sends the extracted data packet directly to the user terminal that generated the data extraction request for processing, according to the corresponding network path, including:

[0083] According to the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing, and the result of the processing is returned to the corresponding user-space protocol intermediate terminal according to the original network path.

[0084] The beneficial effects of the above technical solution are as follows: By using the above method, the data packet is sent to the corresponding user terminal based on the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request. This can improve the data transmission efficiency and avoid data packet transmission errors in the Internet. In addition, the result obtained by the user terminal after processing the received data packet is returned to the corresponding user-space protocol intermediate terminal according to the original shortest network path, thereby realizing the targeted storage of the processing result, which facilitates the server to accurately extract the processing result.

[0085] As can be seen from the above embodiments, the message queue remote sensing transmission method and system based on the data plane development kit generates a user-mode protocol stack of the data plane development kit according to all user terminals with data receiving permissions on the Internet; it captures corresponding data packets from the gateway corresponding to the server, and sends the data packets directly to the user-mode protocol stack according to the attribute information of the data packets to form a data packet queue; according to the data extraction request of the user terminal, it extracts the corresponding data packets from the data packet queue, and sends the extracted data packets directly to the user terminal that generated the data extraction request for processing according to the corresponding network path. By constructing a user-mode protocol stack of the data plane development kit for the user terminal, it replaces the operating system as the medium for data transmission. In this way, data packets from the server are received and arranged by the user-mode protocol stack to form a data packet queue, and then appropriate data packets are extracted from it and sent according to the data extraction request of the user terminal, ensuring that the user terminal receives the required data packets in a timely and accurate manner. During the data transmission process, it does not cause a workload on the operating system. Furthermore, by using the user-mode protocol stack as a data transmission relay medium, it is not necessary to copy the data multiple times, avoiding data tampering or data loss, thereby improving the security and reliability of data transmission.

[0086] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A message queue remote sensing transmission method based on a data plane development kit, characterized in that, Includes the following steps: Step S1: Based on the communication status information of the user terminals connected to the Internet, determine the data receiving permission of the user terminals; based on the user terminals with data receiving permission, generate a corresponding data plane development kit user-mode protocol stack, including: obtaining the real-time communication load status information of all user terminals connected to the Internet, extracting the uplink data communication rate and downlink data communication rate of the user terminals from the real-time communication load status information; if the uplink data communication rate is greater than a first preset rate threshold or the downlink data communication rate is greater than a second preset rate threshold, then determine that the corresponding user terminal does not have data receiving permission; otherwise, determine that the corresponding user terminal has data receiving permission; load the data plane development kit protocol for each user terminal with data receiving permission, generating a data plane development kit user-mode protocol intermediate terminal corresponding to each user terminal with data receiving permission; then arrange all data plane development kit user-mode protocol intermediate terminals to form a data plane development kit user-mode protocol stack according to the priority order of data receiving permission of all user terminals with data receiving permission from high to low. Step S2: Obtain the data transmission status information of the gateway corresponding to the server; capture the data packets transmitted by the gateway based on the data transmission status information; parse the data packets to obtain the attribute information corresponding to the data packets, including: obtaining the real-time data transmission volume value of the gateway connected to the server in the Internet; if the real-time data transmission volume value is greater than or equal to a preset data volume threshold, capture the data packets currently being transmitted by the gateway; parse the data packets to obtain the identity information of the user terminal to which the data packets need to be transmitted, and use this as the attribute information. Step S3: Based on the attribute information, the data packet is directly sent to the user-space protocol stack to form a data packet queue; based on the data extraction request from the user terminal, the corresponding data packet is extracted from the data packet queue, including: based on the identity information, selecting a matching user-space protocol intermediate terminal from the user-space protocol stack, and sending the data packet to the selected user-space protocol intermediate terminal, thereby forming a data packet queue at the intermediate terminal of the user-space protocol stack containing all data packets captured from the gateway at different times; based on the identity information included in the data extraction request from the user terminal with data receiving permissions, the data packet corresponding to the user-space protocol intermediate terminal matching the identity information is extracted from the data packet queue. Step S4: According to the corresponding network path, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing.

2. The message queue remote sensing transmission method based on the data plane development kit as described in claim 1, characterized in that: In step S4, the extracted data packets are directly sent to the user terminal that generated the data extraction request for processing according to the corresponding network path, including: According to the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing, and the processing result is returned to the corresponding user-space protocol intermediate terminal according to the original network path.

3. A message queue remote sensing transmission system based on a data plane development kit, characterized in that: include: The user-mode protocol stack generation module is used to determine the data receiving permissions of the user terminal based on the communication status information of the user terminal connected to the Internet. Based on the user terminals with data receiving permissions, a corresponding data plane development kit user-mode protocol stack is generated, including: obtaining the real-time communication load status information of all user terminals connected to the Internet; extracting the uplink data communication rate and downlink data communication rate of the user terminals from the real-time communication load status information; if the uplink data communication rate is greater than a first preset rate threshold or the downlink data communication rate is greater than a second preset rate threshold, then it is determined that the corresponding user terminal does not have data receiving permissions; otherwise, it is determined that the corresponding user terminal has data receiving permissions; loading the data plane development kit protocol for each user terminal with data receiving permissions, generating a data plane development kit user-mode protocol intermediate terminal corresponding to each user terminal with data receiving permissions; and then arranging all data plane development kit user-mode protocol intermediate terminals to form a data plane development kit user-mode protocol stack according to the priority order of data receiving permissions of all user terminals with data receiving permissions from high to low. The data packet identification module is used to obtain the data transmission status information of the gateway corresponding to the server, capture the data packets transmitted by the gateway based on the data transmission status information, and parse the data packets to obtain the attribute information corresponding to the data packets, including: taking the real-time data transmission volume value of the gateway connected to the server in the Internet; if the real-time data transmission volume value is greater than or equal to a preset data volume threshold, then capturing the data packets currently being transmitted by the gateway; and parsing the data packets to obtain the identity information of the user terminal to which the data packets need to be transmitted, using this as the attribute information. The data packet extraction module is used to send the data packets directly to the user-mode protocol stack according to the attribute information, thereby forming a data packet queue; and to extract the corresponding data packets from the data packet queue according to the data extraction request from the user terminal, including: selecting a matching user-mode protocol intermediate end from the user-mode protocol stack according to the identity information, and sending the data packets to the selected user-mode protocol intermediate end, thereby forming a data packet queue at the intermediate end of the user-mode protocol stack containing all data packets captured from the gateway at different times; Based on the identity information contained in the data extraction request from the user terminal with data receiving permissions, extract the data packet corresponding to the user-state protocol intermediate terminal that matches the identity information from the data packet queue; The data packet sending module is used to send the extracted data packets directly to the user terminal that generated the data extraction request for processing, according to the corresponding network path.

4. The message queue remote sensing transmission system based on the data plane development kit as described in claim 3, characterized in that: The data packet sending module sends the extracted data packets directly to the user terminal that generated the data extraction request for processing, according to the corresponding network path, including: According to the shortest network path in the Internet between the user-space protocol stack and the user terminal that generated the data extraction request, the extracted data packet is directly sent to the user terminal that generated the data extraction request for processing, and the processing result is returned to the corresponding user-space protocol intermediate terminal according to the original network path.

Citation Information

Patent Citations

  • Data transmission method, device and system and storage medium

    CN114615239A

  • Intelligent adaptive transport layer to enhance performance using multiple channels

    US20170366445A1