Internet of Things data exchange system based on rdma technology

Abstract

The invention discloses an internet of things data exchange system based on rdma technology, and relates to the technical field of data transmission, the internet of things data exchange system comprises an equipment terminal, a legality verification end, an operation monitoring end and a data exchange module, the equipment terminal is responsible for generating and processing operation data, and meanwhile, a temporary memory is divided to be used for constructing a temporary transmission channel between equipment; the legality verification end is used for receiving and verifying verification data from an equipment terminal and ensuring the legality of software, the operation monitoring end is used for monitoring the operation state of the equipment terminal, and the data exchange module is used for monitoring various data generation amounts of equipment, dynamically adjusting the transmission proportion of the verification data to the operation data and sending the data to the equipment terminal. The equipment terminal comprises an rdma connection module, a memory unit, a data receiving and transmitting module, an operation data monitoring unit, a data volume statistics module and a verification data generation module, and the rdma connection module is electrically connected with the memory unit.

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to an Internet of Things data exchange system based on RDMA technology. Background Art

[0002] RDMA technology is a data transmission method that directly reads and writes the memory of a remote computer on the network without copying and processing data through the operating system kernel. It can be directly transferred from the memory of one computer to the memory of another computer on the network without the intervention of the CPU, and is widely used in IoT systems with high real-time requirements. IoT application software equipped with the Denuvo digital copyright management system will communicate with the server regularly during operation to exchange and verify data to ensure its legitimacy.

[0003] Because the RDMA transmission method bypasses the CPU to directly access the memory, malicious users may take advantage of this to implant cracking programs using unauthorized memory access during data communication. Therefore, when the IoT software equipped with the Denuvo digital copyright management system uses RDMA technology for data transmission, the legitimacy verification time needs to be strictly limited. When one or more devices generate a lot of operating data in a short period of time, because the operating data enjoys a higher transmission priority, the operating data squeezes the data transmission queue of the verification data, and occasionally the legitimacy verification time exceeds the limit. For safety reasons, the software will be forced to exit. The solution of the existing technology is to increase the verification time or use a larger memory capacity, but the former will increase the risk of data being cracked during the verification time, and the latter will generate greater redundancy costs. Therefore, it is necessary to design an IoT data exchange system based on RDMA technology with a dynamic transmission mechanism. Summary of the invention

[0004] The purpose of the present invention is to provide an Internet of Things data exchange system based on RDMA technology to solve the problems raised in the above background technology.

[0005] In order to solve the above technical problems, the present invention provides the following technical solutions: an Internet of Things data exchange system based on RDMA technology, including a device terminal, a legitimacy verification terminal, an operation monitoring terminal, and a data exchange module. The device terminal is responsible for generating and processing operation data, and at the same time, a temporary memory is divided to build a temporary transmission channel between devices. The legitimacy verification terminal is used to receive and verify verification data from the device terminal to ensure the legitimacy of the software. The operation monitoring terminal is used to monitor the operating status of the device terminal. The data exchange module is used to monitor the various data generated by the device and dynamically adjust the transmission ratio of verification data and operation data.

[0006] According to the above technical solution, the device terminal includes an rdma connection module, a memory unit, a data transceiver module, an operation data monitoring unit, a data volume statistics module, and a verification data generation module. The rdma connection module is electrically connected to the memory unit, the memory unit is electrically connected to the data transceiver module, the operation data monitoring unit is electrically connected to the data volume statistics module, the rdma connection module is used to establish and manage a network connection based on RDMA, so that the memory of the remote computer can be directly read and written for data copying and processing, the memory unit is used to store operation data and verification data, the data transceiver module is responsible for sending and receiving data, ensuring that the operation data and verification data can be transmitted between the device terminal and the operation monitoring terminal and the legitimacy verification terminal, the operation data monitoring unit is used to monitor and analyze the operation data generated by the device in real time, the data volume statistics module is used to count the data volume of the operation data and verification data of the device terminal, and the verification data generation module is used to generate verification data in real time and send it to the legitimacy verification terminal for legitimacy verification;

[0007] The data exchange module includes a verification time setting module, a memory division module, a transmission mode determination module, a transmission volume calculation module, an address resolution module, and a transmission time calculation module. The data volume statistics module is electrically connected to the verification time setting module and the transmission volume calculation module. The memory division module is electrically connected to the address resolution module. The verification time setting module is used to set a time limit for legitimacy verification to confirm whether the verification data can be transmitted within the specified time. The memory division module is used to divide the addresses of the memory unit based on different functions. The transmission mode determination module is used to select the transmission mode for different addresses of the memory unit. The transmission volume calculation module is used to calculate the data volume of different transmission modes. The address resolution module is used to map the logical address of the memory unit to the physical memory address to ensure that the data can be correctly transmitted at the actual memory location. The transmission time calculation module is used to calculate the time occupied by various transmission modes.

[0008] According to the above technical solution, the working method of the system is:

[0009] S1. Collect the detection data of the sensor devices that monitor the operation status of the equipment in the equipment terminal, convert these data formats into unified operation data, and calculate the amount of operation data generated in real time, and count the amount of verification data generated. The real-time operation data and verification data will be sent to the address of the memory unit for temporary storage;

[0010] S2, divide the address of the memory unit into two parts, the first part is used for regular data transmission, and the second part is used for temporary data transmission;

[0011] S3. Count the amount of verification data generated by each device terminal each time when verifying legitimacy {H 1 , H 2 ...H n}, where n is the number of device terminals, according to the set legitimacy verification time T 0 Calculate the appropriate verification data transmission speed v required 0 , and testing the data transmission speed of the first part and the second part of each memory unit to obtain the minimum ratio of the data transmission volume of the first part and the second part when transmitting the verification data;

[0012] S4. The operation data generated by the operation data monitoring unit is processed in real time. i After the average running data volume is obtained through statistics, the addresses of the first part and the second part are divided according to the verification data volume of each device terminal;

[0013] S5, according to the addresses of the divided first part and the second part, the operation data and the verification data are transmitted in a set manner, and when the real-time operation data volume M is detected i >ΔM i When a part of the verification data is transmitted from the second part of the address of the memory unit of other device terminals allocated by the operation data monitoring unit of this device terminal, the first part of the address of the vacated memory unit of the current device terminal is used to transmit the operation data, and the proportion of the memory unit allocated to other device terminals must be less than the minimum proportion of the data transmission in S3.

[0014] According to the above technical solution, in S2, the first part is used to receive data from the operation data monitoring unit and the verification data generating module, first convert the received data into a format accessible to the memory, and send its own operation data and verification data to the operation monitoring end and the legality detection end respectively; the second part receives the operation data and verification data sent by the operation data monitoring unit and the verification data generating module of other device terminals through the data transceiver module, and sends them to the operation monitoring end and the legality detection end.

[0015] According to the above technical solution, in S3, according to the set validity verification time T 0 Calculate the appropriate verification data transfer speed required Where i represents the serial number of the current device terminal, and the data transmission speed of the first part of the memory unit is tested. i The time required for the verification data to reach the legitimacy detection end is t i , the highest verified data transmission speed is obtained Then, the data transmission speed of other memory units is tested by using the second part to receive the data from the current memory unit. iThe time required for the verification data to reach the legitimacy detection end is t k , the minimum verified data transmission speed is obtained It is concluded that the amount of data H directly transmitted in the first part of the memory of the current device terminal when transmitting verification data x and the amount of data temporarily transmitted in the second part H y Minimum ratio When the verification data is normally transmitted, temporary data is transmitted in a manner of directly transmitting the first part in a larger proportion without affecting the transmission of running data.

[0016] According to the above technical solution, in S4, the operation data generated by the operation data monitoring unit is processed into real-time operation data volume M i The observation time T is obtained from the statistics g The average amount of operating data generated in real time by each device terminal Then, according to the specifications of the memory unit, select the data capacity M that all addresses of the memory unit can accommodate 0 , and obtain the appropriate division ratio between the first part and the second part of the memory unit The ratio value is the ratio of the amount of data corresponding to the address of the first part to the amount of data corresponding to the address of the second part, and the addresses of the first part and the second part in each memory unit are divided according to the ratio value.

[0017] According to the above technical solution, in S5, when the real-time running data volume M is continuously detected, i <ΔM i When the address is divided into the first part and the second part, the ratio is optimized, specifically:

[0018] Where K ij is the proportion of the i-th terminal device at the j-th optimization, K ij-1 The ratio of the penultimate optimization of this terminal device, ΔM ij-1 is the average amount of real-time running data detected during all optimizations before the jth optimization, M ij is the amount of real-time running data detected during the jth optimization, α is the weight coefficient of the change trend of the real-time running data, and β is the weight coefficient of the real-time running data itself. As j increases, It will increase accordingly. When the real-time running data volume M is continuously detected i >ΔM i The same optimization is performed when

[0019] According to the above technical solution, in S4, when selecting the specification of the memory unit, ΔM must be ensured. i +Hi <M 0 , to ensure that the memory unit has sufficient space. If it does not meet the requirements, replace the memory unit with a larger capacity specification.

[0020] Compared with the prior art, the beneficial effect achieved by the present invention is as follows: the present invention allocates a part of temporary memory in the memory of the device of the Internet of Things terminal to build a temporary transmission channel between devices. When the operating data of other devices increases in a short period of time, the verification data together with the extra operating data are sent to the monitoring end through the temporary memory of other devices. The allocation ratio of verification data and operating data is determined according to the legitimacy verification time and the amount of operating data generated by itself. While ensuring that the verification data is transmitted within the legitimacy verification time, the operating data is transmitted as quickly as possible. Through the dynamic transmission mechanism, the memory can be efficiently utilized without increasing the legitimacy verification time. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0022] Figure 1 It is a schematic diagram of the overall module structure of the present invention. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] See also Figure 1 The present invention provides a technical solution: an Internet of Things data exchange system based on RDMA technology, including a device terminal, a legitimacy verification terminal, an operation monitoring terminal, and a data exchange module. The device terminal is responsible for generating and processing operation data, and at the same time, a temporary memory is divided to build a temporary transmission channel between devices. The legitimacy verification terminal is used to receive and verify the verification data from the device terminal to ensure the legitimacy of the software. The operation monitoring terminal is used to monitor the operation status of the device terminal. The data exchange module is used to monitor the amount of various data generated by the device and dynamically adjust the transmission ratio of verification data and operation data.

[0025] The device terminal includes an rdma connection module, a memory unit, a data transceiver module, an operation data monitoring unit, a data volume statistics module, and a verification data generation module. The rdma connection module is electrically connected to the memory unit, the memory unit is electrically connected to the data transceiver module, the operation data monitoring unit is electrically connected to the data volume statistics module, the rdma connection module is used to establish and manage a network connection based on RDMA, so that the memory of the remote computer can be directly read and written for data replication and processing, the memory unit is used to store operation data and verification data, the data transceiver module is responsible for sending and receiving data, ensuring that the operation data and verification data can be transmitted between the device terminal and the operation monitoring terminal and the legitimacy verification terminal, the operation data monitoring unit is used to monitor and analyze the operation data generated by the device in real time, the data volume statistics module is used to count the data volume of the operation data and verification data of the device terminal, and the verification data generation module is used to generate verification data in real time and send it to the legitimacy verification terminal for legitimacy verification;

[0026] The data exchange module includes a verification time setting module, a memory division module, a transmission mode determination module, a transmission volume calculation module, an address resolution module, and a transmission time calculation module. The data volume statistics module is electrically connected to the verification time setting module and the transmission volume calculation module. The memory division module is electrically connected to the address resolution module. The verification time setting module is used to set a time limit for legitimacy verification to confirm whether the verification data can be transmitted within the specified time. The memory division module is used to divide the addresses of the memory unit based on different functions. The transmission mode determination module is used to select the transmission mode for different addresses of the memory unit. The transmission volume calculation module is used to calculate the data volume of different transmission modes. The address resolution module is used to map the logical address of the memory unit to the physical memory address to ensure that the data can be correctly transmitted at the actual memory location. The transmission time calculation module is used to calculate the time occupied by various transmission modes;

[0027] The system works as follows:

[0028] S1. Collect the detection data of the sensor devices that monitor the operation status of the equipment in the equipment terminal, convert these data formats into unified operation data, and calculate the amount of operation data generated in real time, and count the amount of verification data generated. The real-time operation data and verification data will be sent to the address of the memory unit for temporary storage;

[0029] S2, divide the address of the memory unit into two parts, the first part is used for regular data transmission, and the second part is used for temporary data transmission;

[0030] S3. Count the amount of verification data generated by each device terminal each time when verifying legitimacy {H 1 , H 2 ...H n}, where n is the number of device terminals, according to the set legitimacy verification time T 0 Calculate the appropriate verification data transmission speed v required 0 , and testing the data transmission speed of the first part and the second part of each memory unit to obtain the minimum ratio of the data transmission volume of the first part and the second part when transmitting the verification data;

[0031] S4. The operation data generated by the operation data monitoring unit is processed in real time. i After the average running data volume is obtained through statistics, the addresses of the first part and the second part are divided according to the verification data volume of each device terminal;

[0032] S5, according to the addresses of the divided first part and the second part, the operation data and the verification data are transmitted in a set manner, and when the real-time operation data volume M is detected i >ΔM i When a part of the verification data is transmitted from the operation data monitoring unit of the device terminal to the second part of the address of the memory unit of other device terminals, the first part of the address of the memory unit vacated by the current device terminal is used for the transmission of the operation data, and the proportion of the memory unit allocated to other device terminals must be less than the minimum proportion of the data transmission amount in S3;

[0033] In S2, the first part is used to receive data from the operation data monitoring unit and the verification data generating module, first convert the received data into a format that can be accessed by the memory, and send its own operation data and verification data to the operation monitoring end and the legitimacy detection end respectively. The second part receives the operation data and verification data sent by the operation data monitoring unit and the verification data generating module of other device terminals through the data transceiver module, and sends them to the operation monitoring end and the legitimacy detection end;

[0034] In S3, according to the set validity verification time T 0 Calculate the appropriate verification data transfer speed required Where i represents the serial number of the current device terminal, and the data transmission speed of the first part of the memory unit is tested. i The time required for the verification data to reach the legitimacy detection end is t i , the highest verified data transmission speed is obtained Then, the data transmission speed of other memory units is tested by using the second part to receive the data from the current memory unit. i The time required for the verification data to reach the legitimacy detection end is t k , the minimum verified data transmission speed is obtained It is concluded that the amount of data H directly transmitted in the first part of the memory of the current device terminal when transmitting verification data x and the amount of data temporarily transmitted in the second part H y Minimum ratio When normally transmitting verification data, temporary data is transmitted by directly transmitting the first part in a larger proportion without affecting the running data transmission;

[0035] In S4, the operation data generated by the operation data monitoring unit is processed into real-time operation data volume M i The observation time T is obtained from the statistics g The average amount of operating data generated in real time by each device terminal Then, according to the specifications of the memory unit, select the data capacity M that all addresses of the memory unit can accommodate 0 , and obtain the appropriate division ratio between the first part and the second part of the memory unit The ratio value is the ratio of the amount of data corresponding to the address of the first part to the amount of data corresponding to the address of the second part, and the addresses of the first part and the second part in each memory unit are divided according to the ratio value;

[0036] In S5, when the real-time running data volume M is continuously detected i <ΔM i When the address is divided into the first part and the second part, the ratio is optimized, specifically:

[0037] Where K ij is the proportion of the i-th terminal device at the j-th optimization, K ij-1 The ratio of the penultimate optimization of this terminal device, ΔM ij-1 is the average amount of real-time running data detected during all optimizations before the jth optimization, M ij is the amount of real-time running data detected during the jth optimization, α is the weight coefficient of the change trend of the real-time running data, and β is the weight coefficient of the real-time running data itself. As j increases, It will increase accordingly. When the real-time running data volume M is continuously detected i >ΔM i The same optimization is performed when In the early stage of optimization, due to the high uncertainty factors of equipment operation data, it is difficult to determine the changing trend of the operation data volume. Therefore, the absolute size of the operation data itself is used as a reference to adjust the ratio of the addresses of the first part and the second part to achieve the purpose of rapid adjustment. As the number of optimizations increases, the certainty of the equipment operation data will also increase, and adjustments will be made more often based on the change ratio of the previous average operation data volume to avoid excessive adjustments due to sudden value changes.

[0038] In S4, the memory unit specifications must be selected to ensure ΔM i +H i <M 0 , to ensure that the memory unit has sufficient space. If it does not meet the requirements, replace the memory unit with a larger capacity specification.

[0039] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0040] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions described in the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. Internet of Things data exchange system based on RDMA technology, characterized by: It includes a device terminal, a legitimacy verification terminal, an operation monitoring terminal, and a data exchange module. The device terminal is responsible for generating and processing operation data, and at the same time allocating temporary memory to build a temporary transmission channel between devices. The legitimacy verification terminal is used to receive and verify the verification data from the device terminal to ensure the legitimacy of the software. The operation monitoring terminal is used to monitor the operation status of the device terminal. The data exchange module is used to monitor the various data generated by the device and dynamically adjust the transmission ratio of verification data and operation data.

2. The Internet of Things data exchange system based on RDMA technology according to claim 1 is characterized in that: The device terminal includes an rdma connection module, a memory unit, a data transceiver module, an operation data monitoring unit, a data volume statistics module, and a verification data generation module. The rdma connection module is electrically connected to the memory unit, the memory unit is electrically connected to the data transceiver module, the operation data monitoring unit is electrically connected to the data volume statistics module, the rdma connection module is used to establish and manage a network connection based on RDMA, so that the memory of the remote computer can be directly read and written for data replication and processing, the memory unit is used to store operation data and verification data, the data transceiver module is responsible for sending and receiving data, and ensures that the operation data and verification data can be transmitted between the device terminal and the operation monitoring terminal and the legitimacy verification terminal, the operation data monitoring unit is used to monitor and analyze the operation data generated by the device in real time, the data volume statistics module is used to count the data volume of the operation data and verification data of the device terminal, and the verification data generation module is used to generate verification data in real time and send it to the legitimacy verification terminal for legitimacy verification; The data exchange module includes a verification time setting module, a memory division module, a transmission mode determination module, a transmission volume calculation module, an address resolution module, and a transmission time calculation module. The data volume statistics module is electrically connected to the verification time setting module and the transmission volume calculation module. The memory division module is electrically connected to the address resolution module. The verification time setting module is used to set a time limit for legitimacy verification to confirm whether the verification data can be transmitted within the specified time. The memory division module is used to divide the addresses of the memory unit based on different functions. The transmission mode determination module is used to select the transmission mode for different addresses of the memory unit. The transmission volume calculation module is used to calculate the data volume of different transmission modes. The address resolution module is used to map the logical address of the memory unit to the physical memory address to ensure that the data can be correctly transmitted at the actual memory location. The transmission time calculation module is used to calculate the time occupied by various transmission modes.

3. The Internet of Things data exchange system based on RDMA technology according to claim 2 is characterized in that: The system works as follows: S1. Collect the detection data of the sensor devices that monitor the operation status of the equipment in the equipment terminal, convert these data formats into unified operation data, and calculate the amount of operation data generated in real time, and count the amount of verification data generated. The real-time operation data and verification data will be sent to the address of the memory unit for temporary storage; S2, divide the address of the memory unit into two parts, the first part is used for regular data transmission, and the second part is used for temporary data transmission; S3, counting the amount of verification data {H1, H2...H n }, where n is the number of device terminals, the required appropriate verification data transmission speed v0 is calculated according to the set legitimacy verification time T0, and the data transmission speeds of the first part and the second part of each memory unit are tested to obtain the minimum ratio of the data transmission volume of the first part and the second part when transmitting the verification data; S4. The operation data generated by the operation data monitoring unit is processed in real time. i After the average running data volume is obtained through statistics, the addresses of the first part and the second part are divided according to the verification data volume of each device terminal; S5, according to the addresses of the divided first part and the second part, the operation data and the verification data are transmitted in a set manner, and when the real-time operation data volume M is detected i >ΔM i When a part of the verification data is transmitted from the second part of the address of the memory unit of other device terminals allocated by the operation data monitoring unit of this device terminal, the first part of the address of the vacated memory unit of the current device terminal is used to transmit the operation data, and the proportion of the memory unit allocated to other device terminals must be less than the minimum proportion of the data transmission in S3.

4. The Internet of Things data exchange system based on RDMA technology according to claim 3 is characterized in that: In S2, the first part is used to receive data from the operation data monitoring unit and the verification data generating module, first convert the received data into a format accessible to the memory, and send its own operation data and verification data to the operation monitoring end and the legality detection end respectively. The second part receives the operation data and verification data sent by the operation data monitoring unit and the verification data generating module of other device terminals through the data transceiver module, and sends them to the operation monitoring end and the legality detection end.

5. The Internet of Things data exchange system based on RDMA technology according to claim 4 is characterized in that: In S3, the required appropriate verification data transmission speed is calculated according to the set legitimacy verification time T0. Where i represents the serial number of the current device terminal, and the data transmission speed of the first part of the memory unit is tested. i The time required for the verification data to reach the legitimacy detection end is t i , the highest verified data transmission speed is obtained Then, the data transmission speed of other memory units is tested by using the second part to receive the data from the current memory unit. i The time required for the verification data to reach the legitimacy detection end is t k , the minimum verified data transmission speed is obtained It is concluded that the amount of data H directly transmitted in the first part of the memory of the current device terminal when transmitting verification data x and the amount of data temporarily transmitted in the second part H y The minimum ratio When the verification data is normally transmitted, temporary data is transmitted in a manner of directly transmitting the first part in a larger proportion without affecting the transmission of running data.

6. The Internet of Things data exchange system based on RDMA technology according to claim 5 is characterized in that: In S4, the operation data generated by the operation data monitoring unit is processed into real-time operation data volume M i Statistics of observation time T g The average amount of operating data generated in real time by each device terminal Then, according to the specifications of the memory unit, select the data capacity M0 that can be accommodated by all addresses of the memory unit, and obtain the appropriate division ratio between the first part and the second part of the memory unit. The ratio value is the ratio of the amount of data corresponding to the address of the first part to the amount of data corresponding to the address of the second part, and the addresses of the first part and the second part in each memory unit are divided according to the ratio value.

7. The Internet of Things data exchange system based on RDMA technology according to claim 6 is characterized in that: In S5, when the real-time running data volume M is continuously detected i <ΔM i When the address is divided into the first part and the second part, the ratio is optimized, specifically: Where K ij is the proportion of the i-th terminal device at the j-th optimization, K ij-1 The ratio of the penultimate optimization of this terminal device, ΔM ij-1 is the average amount of real-time running data detected during all optimizations before the jth optimization, M ij is the amount of real-time running data detected during the jth optimization, α is the weight coefficient of the change trend of the real-time running data, and β is the weight coefficient of the real-time running data itself. As j increases, It will increase accordingly. When the real-time running data volume M is continuously detected i >ΔM i The same optimization is performed when 8. The Internet of Things data exchange system based on RDMA technology according to claim 7 is characterized in that: In S4, when selecting the memory unit specification, ΔM must be ensured. i +H i <M0 to ensure that the memory unit has sufficient space. If it does not meet the requirements, replace the memory unit with a larger capacity specification.

Images