Data transmission method and apparatus, device, and storage medium

Abstract

The application discloses a data transmission method, device and equipment and a storage medium. The data transmission method comprises the following steps: splitting an original processing rule policy file into a plurality of data blocks; obtaining a data block list comprising each data block according to the plurality of data blocks; sending the data block list to a cloud server through a data transmission link; receiving the first processing rule policy file sent by the cloud server; and obtaining a synchronized processing rule policy file according to the original processing rule policy file and the first processing rule policy file. According to the embodiment of the application, the cost of data transmission in the data processing process is reduced, and the cloud-edge collaborative management efficiency is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of IT applications, and in particular to a data transmission method and device, equipment and a storage medium. BACKGROUND

[0002] Edge computing refers to a new computing mode of sinking part of cloud computing resources to the edge side. As a complementary form of cloud computing at the edge side, edge computing has developed rapidly. Cloud-edge collaboration refers to the cooperation between cloud computing and edge computing in terms of resources and data, so as to coordinate resources and improve the application value of the entire system, and better meet the needs of various application scenarios.

[0003] The existing global architecture scheduling object is large in quantity, and the architecture or deployment mode of the edge device is different. At the same time, the existing cloud-edge collaborative operation and management has low transmission and synchronization efficiency for processing rule policies, and cannot effectively collect the resource status of the edge, affecting the efficiency of cloud-edge collaborative operation and management. SUMMARY

[0004] The data transmission method, device, equipment and storage medium provided by the embodiments of the present application can effectively improve the data transmission efficiency in cloud-edge collaborative operation and management, realize effective collection of the resource status of the edge, and improve the efficiency in cloud-edge collaborative operation and management.

[0005] In a first aspect, the embodiments of the present application provide a data transmission method, which is applied to an edge computing node in a cloud-edge collaborative system, a data transmission link is established between the edge computing node and a cloud server in the cloud-edge collaborative system, and the method comprises the following steps:

[0006] Splitting an original processing rule policy file into a plurality of data blocks;

[0007] Obtaining a data block list comprising the data blocks according to the plurality of data blocks;

[0008] Sending the data block list to the cloud server through the data transmission link, so that the cloud server compares the processing rule policy file in the cloud server with the data blocks in the data block list, and when it is determined that there is a first processing rule policy file not included in the data block list in the cloud server, the first processing rule policy file is transmitted to the edge computing node through the data transmission link;

[0009] Receiving the first processing rule policy file sent by the cloud server;

[0010] Obtaining a synchronized processing rule policy file according to the original processing rule policy file and the first processing rule policy file.

[0011] In a second aspect, an embodiment of the present application provides a data transmission method applied to a cloud server in a cloud-edge collaborative system, a data transmission link being established between the cloud server and an edge computing node in the cloud-edge collaborative system, the method comprising:

[0012] receiving, through the data transmission link, a data block list sent by the edge computing node, the data block being a data block obtained by splitting an original processing rule policy file of the edge computing node;

[0013] comparing a processing rule policy file in the cloud server with data blocks in the data block list;

[0014] when it is determined that there is a first processing rule policy file not included in the data block list in the cloud server, transmitting the first processing rule policy file to the edge computing node through the data transmission link.

[0015] In a third aspect, an embodiment of the present application provides a data transmission device applied to an edge computing node in a cloud-edge collaborative system, a data transmission link being established between the edge computing node and a cloud server in the cloud-edge collaborative system, the device comprising:

[0016] a splitting module configured to split an original processing rule policy file into a plurality of data blocks;

[0017] a generating module configured to obtain a data block list including each data block according to the plurality of data blocks;

[0018] a first sending module configured to send the data block list to the cloud server through the data transmission link, so that the cloud server compares a processing rule policy file in the cloud server with data blocks in the data block list, and when it is determined that there is a first processing rule policy file not included in the data block list in the cloud server, transmits the first processing rule policy file to the edge computing node through the data transmission link;

[0019] a first receiving module configured to receive the first processing rule policy file content sent by the cloud server, and synchronize a local processing rule policy file;

[0020] The feedback module is configured to send feedback information about whether the processing rule policy file is successfully synchronized to the cloud server, so that the cloud server records a state of the first processing rule policy file as a state of being transmitted to the edge computing node when the feedback information indicates that the first processing rule policy file is successfully received by the edge computing node, and restores a synchronization state of the processing rule policy file between the cloud server and the edge computing node to a state before the first processing rule policy file is transmitted when the feedback information indicates that the first processing rule policy file is not successfully received by the edge computing node.

[0021] In a fourth aspect, an embodiment of the present application provides a data transmission device, which is applied to a cloud server in a cloud-edge collaborative system, a data transmission link is established between the cloud server and an edge computing node in the cloud-edge collaborative system, and the device comprises:

[0022] The second receiving module is configured to receive a data block list sent by the edge computing node through the data transmission link, the data block being a data block obtained by splitting a processing rule policy file of the edge computing node;

[0023] The comparison module is configured to poll and compare each data block in the data block list with all processing rule policy files of the local end;

[0024] The second sending module is configured to directly transmit the data block list and the first processing rule policy file to the edge computing node through the data transmission link;

[0025] The third receiving module is configured to receive feedback information returned by the edge computing node about whether the first processing rule policy file is successfully received, record a state of the first processing rule policy file as a state of being transmitted to the edge computing node when the feedback information indicates that the first processing rule policy file is successfully received by the edge computing node, and restore a synchronization state of the processing rule policy file between the cloud server and the edge computing node to a state before the first processing rule policy file is transmitted when the feedback information indicates that the first processing rule policy file is not successfully received by the edge computing node.

[0026] In a fifth aspect, an embodiment of the present application provides an electronic device, which comprises a processor and a memory storing computer program instructions.

[0027] The processor implements the data transmission method according to any one of the first aspect and the second aspect when executing the computer program instructions.

[0028] In a sixth aspect, an embodiment of the present application provides a computer readable storage medium, and the computer readable storage medium stores computer program instructions. The computer program instructions are executed by a processor to implement the data transmission method according to any one of the first aspect and the second aspect.

[0029] In a seventh aspect, an embodiment of the present application provides a computer program product, and instructions in the computer program product are executed by a processor of an electronic device to cause the electronic device to perform the data transmission method according to any one of the first aspect and the second aspect.

[0030] In an embodiment of the present application, a data transmission method is applied to an edge computing node in a cloud-edge collaborative system. The edge computing node and a cloud server in the cloud-edge collaborative system establish a data transmission link. In data transmission, the edge computing node splits an original processing rule policy file into a plurality of data blocks. Then, the edge computing node sends a data block list including the data blocks to the cloud server through the data transmission link. The cloud server transmits a first processing rule policy file not included in the data block list to the edge computing node through the data transmission link. Finally, the edge computing node obtains a synchronized processing rule policy file according to the original processing rule policy file and the first processing rule policy file. In this way, in the embodiment of the present application, the edge computing node and the cloud server perform data transmission through a special data transmission link, and the cloud server synchronizes only the processing rule policy file that is missing in the edge computing node to the edge computing node. Therefore, the efficiency of data transmission and synchronization of the rule policy of edge data processing in cloud-edge collaborative operation and management is improved, and the collection of the resource state of the edge is effectively realized, and the efficiency of cloud-edge collaborative operation and management is improved. BRIEF DESCRIPTION OF DRAWINGS

[0031] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments of the present application. For those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0032] Figure 1 is a flow diagram of a transmission process in the data transmission method provided by the embodiments of the present application;

[0033] Figure 2 is a flow diagram of a data transmission method according to an embodiment of the first aspect of the present application;

[0034] Figure 3 is a flow diagram of another data transmission method according to an embodiment of the second aspect of the present application;

[0035] Figure 4is a structural schematic diagram of a data transmission device provided by an embodiment of the first aspect of the present application.

[0036] Figure 5 is a structural schematic diagram of another data transmission device provided by an embodiment of the second aspect of the present application.

[0037] Figure 6 is a structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0038] The features and exemplary embodiments of the various aspects of the present application will be described in detail below, in order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in combination with the drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, but not to limit the present application. The present application can be implemented without some of these specific details for those skilled in the art. The following description of the embodiments is only to provide a better understanding of the present application by showing examples of the present application.

[0039] It should be noted that, in this paper, relationship terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between the entities or operations. Moreover, the terms "include", "contain" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the elements defined by the statement "include" do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0040] In order to solve the problems in the prior art, the embodiments of the present application provide a data transmission method, device, equipment and computer storage medium.

[0041] Figure 1 is a flowchart of a transmission process in a data transmission method provided by an embodiment of the present application.

[0042] As Figure 1 shown, the embodiments of the present application can include a cloud server 1 and an edge computing node 1. Wherein, the edge device directly interacts with the cloud server to complete the transmission process shown in Figure 1 , the transmission process includes the following steps:

[0043] S101, splitting the original processing rule policy file into multiple data blocks;

[0044] S102, obtaining a data block list including each data block according to the plurality of data blocks;

[0045] S103, sending the data block list to a cloud server through the data transmission link, so that the cloud server compares a processing rule policy file in the cloud server with data blocks in the data block list, and when it is determined that the cloud server has a first processing rule policy file not included in the data block list, transmitting the first processing rule policy file to the edge computing node through the data transmission link;

[0046] S104, receiving the data block list sent by the edge computing node through the data transmission link, the data block being a data block obtained by splitting an original processing rule policy file of the edge computing node;

[0047] S105, comparing the processing rule policy file in the cloud server with the data blocks in the data block list;

[0048] S106, when it is determined that the cloud server has a first processing rule policy file not included in the data block list, transmitting the first processing rule policy file to the edge computing node through the data transmission link;

[0049] S107, receiving the first processing rule policy file sent by the cloud server;

[0050] S108, obtaining a synchronized processing rule policy file according to the original processing rule policy file and the first processing rule policy file.

[0051] By using the remote synchronization (Rsync) algorithm, the edge computing node uploads its own policy file in blocks to the cloud server, thereby realizing the file-level incremental transmission and the data block-level incremental transmission of the processing rule policy file. The cloud server compares the received policy file, and only sends the first processing rule policy file not included in the data block list to the edge computing node, thereby reducing the transmission cost in the synchronization process of the processing rule policy file. The efficiency of the rule policy data transmission and synchronization of the edge data processing in the cloud-edge collaborative operation and management is improved, and the effective collection of the resource state of the edge is realized, thereby improving the efficiency of the cloud-edge collaborative operation and management.

[0052] S106 is related to, the first processing rule policy file refers to a processing rule policy file possessed by the cloud server but not included in the data block list uploaded by the edge computing node.

[0053] In some embodiments, in order to realize the synchronization of the processing rule policy file, after S108, the method can further comprise: sending feedback information of whether the first processing rule policy file is successfully received to the cloud server.

[0054] In this way, when the cloud server determines that the feedback information is that the edge computing node successfully receives the first processing rule policy file, the cloud server records the state of the first processing rule policy file as a state of being transmitted to the edge computing node; in the case that the cloud server determines that the feedback information is that the edge computing node does not successfully receive the first processing rule policy file, the synchronization state of the processing rule policy file between the cloud server and the edge computing node is restored to a state before the transmission of the first processing rule policy file.

[0055] Through the above operation, the synchronization of the processing rule policy file between the cloud server and the edge computing node can be ensured.

[0056] In some embodiments, in order to realize the transmission of data, after S108, the method can further comprise:

[0057] processing the collected state parameters of the edge device according to the synchronized processing rule policy file to obtain processed device data;

[0058] splitting the processed device data to obtain multiple sub-device data;

[0059] parallel processing the multiple sub-device data to obtain a data processing result;

[0060] transmitting the data processing result to the cloud server according to the data transmission thread in the synchronized processing rule policy file, so that the cloud server returns an acknowledgement message to the edge computing node after receiving the data processing result, and disconnects the transmission link with the edge computing node;

[0061] receiving the acknowledgement information returned by the cloud server.

[0062] In this way, the collected state parameters of the edge device are processed according to the latest processing rule policy file, which reduces the pressure of subsequent data processing of the cloud server. And the data processing result is actively pushed through the data transmission thread, which reduces the communication resource overhead in the entire transmission process.

[0063] Here, before processing the collected state parameters of the edge device according to the synchronized processing rule policy file to obtain processed device data, the edge device needs to complete the registration of the device plug-in, and the registration step comprises:

[0064] The device plug-in needs to report the following information to the edge computing node as a client: 1) the managed device and service name; 2) the port of the device service plug-in collected data; and 3) the interactive API version.

[0065] After the service associated with the device service plug-in is started, the edge computing node establishes a data collection long connection to the device plug-in.

[0066] In this way, by establishing a data collection long connection, the edge computing node can timely obtain the allocation of the device and the health status of the device.

[0067] Here, before the state parameters of the edge device collected according to the synchronized processing rule policy file are processed to obtain processed device data, the edge device needs to complete the registration of the device plug-in, and the collection method can include: different deep and shallow detection collection according to different business scenarios, such as protocol detection, traffic mirror detection, plug-in code probe, interface or direct connection, etc.

[0068] Here, after the multiple sub-device data are processed in parallel to obtain a data processing result, the method further includes:

[0069] The data processing result is temporarily stored in a local database.

[0070] In this way, temporary storage of the data processing result is realized, facilitating subsequent transmission of the data processing result.

[0071] Here, after the multiple sub-state parameters are processed in parallel to obtain a data processing result, the method further includes:

[0072] According to the communication mode in the processing rule policy file, the data processing result is sent to a notification program of the local end, so as to send the data processing result to a cloud server through the notification program. The notification program can include multiple notification forms such as short message, email, interface, telephone, etc.

[0073] In this way, the active transmission of the data processing result by the edge computing node is realized through the communication mode in the processing rule policy file.

[0074] In some embodiments, in order to better synchronize the processing rule policy file, after S108, the method can further include:

[0075] Receiving feedback information returned by the edge computing node whether the first processing rule policy file is successfully received;

[0076] In a case where the feedback information is that the edge computing node successfully receives the first processing rule policy file, record the state of the first processing rule policy file as a state of having been transmitted to the edge computing node.

[0077] In a case where the feedback information is that the edge computing node does not successfully receive the first processing rule policy file, restore the synchronization state of the processing rule policy file between the cloud server and the edge computing node to a state before the first processing rule policy file is transmitted.

[0078] In this way, by recording the first processing rule policy file synchronization state of the edge computing node at the cloud server, the cloud server and the edge computing node are unified in processing rule policy file management in cloud-edge collaboration.

[0079] In some embodiments, in order to process the data transmitted by the edge computing node, after S108, the method further includes:

[0080] receiving state parameters collected by the edge computing node for consecutive k times, k wherein the state parameters are collected by the edge computing node according to a collection strategy issued by the cloud server, and n is an integer greater than or equal to 2;

[0081] determining a state parameter change amount of the edge device according to the state parameters of the edge device collected for consecutive k times;

[0082] judging whether the state parameter change amount is within a preset state parameter change amount range;

[0083] in a case where the judgment result is yes, maintaining the original collection frequency to continue collecting the state parameters of the edge device.

[0084] Here, the method for judging whether the state parameter change amount is within the preset state parameter change amount range includes:

[0085] the state parameter change amount is calculated by the following formula 1:

[0086] Formula 1

[0087] wherein, the state change amount; k the moving average collection point number; the device state parameter collected for the n th time. Then, judge whether the state parameter change amount is within a preset state parameter change amount range, wherein n the state parameter change amount; ​a minimum state parameter change amount of the device, a maximum state parameter change amount of the device.

[0088] In this way, the state parameter change amount of the edge device is calculated.

[0089] Here, after judging whether the state parameter change amount is within the preset state parameter change amount interval range, the method further includes:

[0090] In the case where the state parameter change amount is less than the lower limit value of the preset state parameter change amount interval, the acquisition frequency of the state parameter of the edge device is reduced;

[0091] In the case where the state parameter change amount is greater than the lower limit value of the preset state parameter change amount interval, the acquisition frequency of the state parameter of the edge device is increased.

[0092] In this way, the acquisition frequency of the edge device is changed in time, so as to reduce the network pressure in the entire cloud edge system.

[0093] Wherein, the method further includes: k acquiring the state parameters of the edge device computing nodes collected continuously

[0094] The linear interpolation method is used to calculate the interpolation times between the state parameters collected adjacent twice by the following formula 2:

[0095] Formula 2

[0096] Wherein, a minimum acquisition time interval; a first acquisition time. n

[0097] In this way, the time difference between the adjacent two acquisition time points is determined according to the adjacent two acquisition time points.

[0098] According to the state parameters obtained adjacent twice and the interpolation times, the state parameter interpolation corresponding to the interpolation times is determined, and then the interpolation of the state parameter is calculated by formula 3:

[0099] Formula 3

[0100] Wherein, an interpolation coefficient, the distance between the device state parameter collected from the first n time to the device state parameter collected from the first n-1 time, and the distance between the device state parameter collected from the first n time to the device state parameter collected from the first n+1 ​The ratio of the distance between the collected device state parameters.

[0101] Thus, the interpolation times are determined according to the time difference and the minimum collection time interval.

[0102] And the corresponding state parameter interpolation, the interpolation sequence is obtained;

[0103] According to the state parameters in the original data sequence composed of the collected state parameters and the interpolation sequence, the collection error of the state parameters is calculated through the following formula 4:

[0104] Formula 4

[0105] Among them, And Respectively, the interpolation sequence of the adaptive collection algorithm and the value sequence of the original data, the interpolation sequence refers to arranging each state parameter interpolation according to the time sequence of the interpolation times.

[0106] The value sequence of the adaptive collection algorithm, The value sequence of the original data.

[0107] In this way, the frequency of the collection task is automatically triggered according to the result error ratio of the adaptive algorithm.

[0108] Figure 2 The flowchart of the data transmission method provided by one embodiment of the application is shown, which is applied to the edge computing node in the cloud edge collaborative system. It should be noted that the data transmission method can also be applied to the data transmission device of the edge computing node in the cloud edge collaborative system. The edge computing node and the cloud server in the cloud edge collaborative system establish a data transmission link. The method comprises the following steps:

[0109] S201, split the original processing rule policy file into multiple data blocks;

[0110] S202, according to the multiple data blocks, obtain a data block list comprising each data block;

[0111] S203, through the data transmission link, send the data block list to the cloud server, so that the cloud server compares the processing rule policy file in the cloud server with the data block in the data block list, and when it is determined that the first processing rule policy file not included in the data block list exists in the cloud server, the first processing rule policy file is transmitted to the edge computing node through the data transmission link;

[0112] S204, receive the first processing rule policy file sent by the cloud server;

[0113] S205, obtaining a synchronized processing rule policy file according to the original processing rule policy file and the first processing rule policy file.

[0114] Figure 3 A flowchart of a data transmission method provided by an embodiment of the application is shown, which is applied to a cloud server in a cloud-edge collaborative system. It should be noted that the data transmission method can also be applied to a data transmission device of the cloud server in the cloud-edge collaborative system. An edge computing node and the cloud server in the cloud-edge collaborative system have established a data transmission link. The method comprises the following steps:

[0115] S301, receiving a data block list sent by an edge computing node through the data transmission link, wherein the data block is a data block obtained by splitting an original processing rule policy file of the edge computing node;

[0116] S302, comparing a processing rule policy file in the cloud server with data blocks in the data block list;

[0117] S303, when it is determined that there is a first processing rule policy file in the cloud server that is not included in the data block list, transmitting the first processing rule policy file to the edge computing node through the data transmission link.

[0118] Thus, by using the above-mentioned Rsync algorithm, the cloud server realizes file-level incremental transmission and data block-level incremental transmission of the processing rule policy file with the edge computing node, reduces the data transmission cost, improves the data transmission efficiency, and lays a foundation for subsequent data collection and cloud-edge collaborative management.

[0119] Based on the data transmission method provided in the above embodiment, the application provides a specific implementation mode of a data transmission device. Please refer to the following embodiments.

[0120] A virtual data transmission device is shown as follows Figure 4 The device is applied to an edge computing node in a cloud-edge collaborative system. The device comprises:

[0121] The splitting module 401 is configured to split an original processing rule policy file into a plurality of data blocks.

[0122] The generating module 402 is configured to obtain a data block list comprising each data block according to the plurality of data blocks.

[0123] The first sending module 403 is configured to send the data block list to the cloud server through the data transmission link, so that the cloud server compares the processing rule policy file in the cloud server with the data blocks in the data block list, and when it is determined that the first processing rule policy file not included in the data block list exists in the cloud server, the first processing rule policy file is transmitted to the edge computing node through the data transmission link;

[0124] The first receiving module 404 is configured to receive the first processing rule policy file content sent by the cloud server, and synchronize the local processing rule policy file.

[0125] The feedback module 405 is configured to send feedback information about whether the processing rule policy file is successfully synchronized to the cloud server, so that the cloud server records the first processing rule policy file state as having been transmitted to the edge computing node when it is determined that the feedback information is that the edge computing node successfully receives the first processing rule policy file; and in the case that the cloud server determines that the feedback information is that the edge computing node does not successfully receive the first processing rule policy file, the synchronization state of the processing rule policy file in the cloud server and the edge computing node is restored to the state before the first processing rule policy file is transmitted.

[0126] Thus, the splitting module of the above device can split the local processing rule policy file into data blocks, generate a data block list through the generating module, and send the data block list to the cloud server through the first sending module, thereby realizing the file-level and data block-level synchronization of the processing rule policy file. The first receiving module is used to receive the first processing rule policy file sent by the cloud server, and the feedback module is used to feedback whether the information is successfully received. In this way, the uniformity of the processing rule policy file in the cloud-edge collaborative management of the entire system is maintained.

[0127] Based on the data transmission method provided in the above embodiment, the application provides another specific implementation mode of a data transmission device. Please refer to the following embodiments.

[0128] Figure 5 A data transmission device is shown. The device is applied to a cloud server in a cloud-edge collaborative system. The device comprises:

[0129] The second receiving module 501 is configured to receive the data block list sent by the edge computing node through the data transmission link. The data block is a data block obtained by splitting the processing rule policy file of the edge computing node.

[0130] The comparison module 502 is configured to poll and compare each data block in the data block list with all processing rule policy files in the local end.

[0131] The second sending module 503 is configured to directly transmit the first processing rule policy file content of the data block list to the edge computing node through the data transmission link;

[0132] The third receiving module 504 is configured to receive feedback information returned by the edge computing node about whether the first processing rule policy file is successfully received. In a case where the feedback information is that the edge computing node successfully receives the first processing rule policy file, the state of the first processing rule policy file is recorded as a state of being transmitted to the edge computing node. In a case where the feedback information is that the edge computing node does not successfully receive the first processing rule policy file, the synchronization state of the processing rule policy file between the cloud server and the edge computing node is restored to a state before the first processing rule policy file is transmitted.

[0133] Thus, the receiving module can receive the data block list transmitted from the edge computing node, compare the data block list with the local processing rule file through the comparing module, and directly send the first processing rule policy file by using the second sending module, so as to realize the unification of the processing rule files on the cloud side and the edge side with low communication resources. Finally, the third receiving module realizes the synchronization state of the processing rule policy file of the entire system.

[0134] In order to send a message about whether the first processing rule policy file is synchronized to the cloud server, as another optional embodiment of the present application, the above device can further include:

[0135] The third sending module is configured to, after the third receiving module 504 receives the first processing rule policy file sent by the cloud server, send feedback information about whether the first processing rule policy file is successfully received to the cloud server, so that the cloud server records the state of the first processing rule policy file as a state of being transmitted to the edge computing node when it is determined that the edge computing node successfully receives the first processing rule policy file. In a case where the cloud server determines that the edge computing node does not successfully receive the first processing rule policy file, the synchronization state of the processing rule policy file between the cloud server and the edge computing node is restored to a state before the first processing rule policy file is transmitted.

[0136] Thus, by using the third sending module, whether the received first processing rule policy file is synchronized is sent to the cloud server, so that the cloud server updates the synchronization state of the first processing rule policy file of the edge computing node, and finally realizes the timely synchronization of the state of the processing rule policy file of the entire system.

[0137] In order to achieve the purpose of processing the collected edge device state parameters, as another optional embodiment of the present application, the above-mentioned device can further comprise:

[0138] The first data processing module is configured to, after the feedback module 405 sends the feedback information about whether the processing rule policy file is successfully synchronized to the cloud server, process the collected state parameters of the edge device according to the synchronized processing rule policy file to obtain processed device data, split the processed device data to obtain multiple sub-device data, perform parallel processing on the multiple sub-device data to obtain a data processing result, transmit the data processing result to the cloud server according to the data transmission thread in the synchronized processing rule policy file, so that the cloud server returns an acknowledgement message to the edge computing node after receiving the data processing result and disconnects the transmission link with the edge computing node, and receive the acknowledgement information returned by the cloud server.

[0139] In this way, the first data processing module pre-processes the collected edge device state parameters, reduces the volume of the state parameters collected by the edge device, and reduces the processing pressure of the cloud server.

[0140] In order to achieve the purpose of actively transmitting data, as another optional embodiment of the present application, the feedback module 405 can further comprise:

[0141] According to the communication mode in the processing rule policy file, the data processing result is sent to a notification program at the local end, so that the data processing result is sent to the edge device through the notification program.

[0142] In this way, the feedback module 405 transmits data by selecting the communication mode in the predetermined processing rule policy file, ensures the consistency of the data transmission mode of the entire system, and the predetermined transmission mode also ensures the same data type.

[0143] In order to achieve the purpose of synchronizing whether the edge node successfully receives the processing rule policy file, as another optional embodiment of the present application, the third receiving module 504 can further comprise:

[0144] The third receiving module 504 is configured to receive feedback information about whether the first processing rule policy file is successfully received by the edge computing node, record the state of the first processing rule policy file as a state of being transmitted to the edge computing node in the case that the feedback information indicates that the first processing rule policy file is successfully received by the edge computing node, and restore the synchronization state of the processing rule policy file between the cloud server and the edge computing node to a state before the transmission of the first processing rule policy file in the case that the feedback information indicates that the first processing rule policy file is not successfully received by the edge computing node.

[0145] Thus, the third receiving module 504 receives feedback information on whether the first processing rule policy file returned by the edge computing node has been successfully received, and records the transmission status of the first processing rule policy file in a timely manner, thereby achieving the unification of the processing rule policy files of the cloud server and the edge computing node in this system.

[0146] In order to process data from edge computing nodes, as another optional embodiment of this application, the above-mentioned apparatus may further include:

[0147] The second data processing module is used to receive continuous data sent from the edge computing node after the third receiving module 504 receives feedback information regarding whether the first processing rule strategy file returned by the edge computing node has been successfully received. k The status parameters collected this time. k The state parameter is an integer greater than or equal to 2, and it is obtained by the edge computing node through a collection strategy issued by the cloud server; based on continuous... k The status parameters of the edge device are collected once, and the change in the status parameters of the edge device is determined. It is then determined whether the change in the status parameters is within the preset range of the change in status parameters. If the determination result is yes, the status parameters of the edge device are collected again at the original collection frequency.

[0148] Thus, the second data processing module, based on the parameters k The method determines the change in the state parameters of the edge device, and then determines whether the change in the state parameters is within the preset range of state parameter change, in order to determine whether the sampling frequency needs to be modified.

[0149] In order to change the acquisition frequency of the state parameters of the edge device, as another optional embodiment of this application, the above-mentioned device may further include:

[0150] The frequency change module is used to, after determining whether the change in the state parameter is within a preset range of state parameter change, reduce the acquisition frequency of the state parameter of the acquisition edge device when the change in the state parameter is less than the lower limit of the preset range of state parameter change; and increase the acquisition frequency of the state parameter of the acquisition edge device when the change in the state parameter is greater than the lower limit of the preset range of state parameter change.

[0151] In this way, the frequency of collecting state parameters of edge devices can be changed.

[0152] In order to calculate the acquisition error, as another optional embodiment of this application, the above-mentioned apparatus may further include:

[0153] The third data processing module is used in the acquisition of continuousk After the state parameters of the edge device computing nodes are collected, the straight line interpolation method is used to calculate the interpolation times between each two adjacent collected state parameters and the corresponding state parameter interpolation to obtain an interpolation sequence; and the collection error of the state parameters is determined according to the original data sequence composed of the collected state parameters and the interpolation sequence.

[0154] In this way, the interpolation sequence obtained by the straight line interpolation method is used by the third data processing module to determine the collection error of the state parameters.

[0155] In order to realize the calculation of the interpolation sequence, as another optional embodiment of the present application, the above-mentioned device can further include:

[0156] The fourth data processing module is configured to, after the straight line interpolation method is used to calculate the interpolation times between each two adjacent collected state parameters and the corresponding state parameter interpolation to obtain an interpolation sequence, determine the time difference between the adjacent two collection time points according to the adjacent two collection time points; determine the interpolation times according to the time difference and the minimum collection time interval; determine the state parameter interpolation corresponding to the interpolation times according to the state parameters obtained by the adjacent two collections and the interpolation times; arrange each state parameter interpolation in the time sequence of the interpolation times to obtain the interpolation sequence.

[0157] In this way, the state parameter interpolation corresponding to the interpolation times is determined by the time difference between the adjacent two collection time points and the interpolation times, and finally arranged in the time sequence of the interpolation times to obtain the interpolation sequence.

[0158] Figure 6 A hardware structure schematic diagram of data transmission provided by an embodiment of the present application is shown.

[0159] The data transmission device can include a processor 601 and a memory 602 having computer program instructions stored therein.

[0160] Specifically, the processor 601 can include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or can be configured as one or more integrated circuits that implement one or more embodiments of the present application.

[0161] The memory 602 can include mass storage for data or instructions. As an example and not by way of limitation, the memory 602 can include a Hard Disk Drive (HDD), a floppy disk drive, a flash memory, a Compact Disc (CD) or other optical disk, a Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory 602 can include removable or non-removable (or fixed) media, where appropriate. Where appropriate, the memory 602 can be internal or external to the integrated gateway disaster recovery appliance. In particular embodiments, the memory 602 is non-volatile, solid-state memory.

[0162] In particular embodiments, read-only memory (ROM), random access memory (RAM), magnetic disk storage mediums, optical storage mediums, flash memory devices, electrical, optical, or other physical / tangible memory storage devices can be included. Accordingly, generally, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software that, when executed (by one or more processors), is operable to perform operations described with reference to the methods according to an aspect of the present disclosure.

[0163] The processor 601 implements any of the data transmission methods in the above embodiments by reading and executing computer program instructions stored in the memory 602.

[0164] In one example, the data transmission device can further include a communication interface 603 and a bus 610. Wherein, as shown, the processor 601, the memory 602, the communication interface 603 are connected through the bus 610 and complete the communication between each other. Figure 6

[0165] The communication interface 603 is mainly used to realize the communication between each module, device, unit and / or equipment in the embodiments of the present application.

[0166] ​Bus 610 includes a hardware, software, or both that couples components of data transmission device to each other. As an example and not by way of limitation, bus can include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an InfiniBand (IB) interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or another suitable bus or a combination of two or more of these. Where appropriate, bus 610 can include one or more buses. Although this application describes and shows a particular bus, this application contemplates any suitable bus or interconnect.

[0167] The data transmission device can perform the data transmission method in the embodiments of the application based on the currently intercepted spam messages and the user reported messages, thereby realizing the data transmission method and device described in combination Figures 2-3 and Figures 4-5 The data transmission method and device described in combination

[0168] In addition, in combination with the data transmission method in the above embodiments, the embodiments of the application can provide a computer storage medium for implementation. The computer storage medium has computer program instructions stored thereon; the computer program instructions are executed by a processor to implement any one of the data transmission methods in the above embodiments.

[0169] It needs to be clear that the application is not limited to the specific configurations and processes described above and shown in the drawings. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between steps, after understanding the spirit of the application.

[0170] The functions indicated in the structural block diagrams described above can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, and the like. When implemented in software, the elements of the present application are program or code segments that are used to perform the required tasks. The program or code segments can be stored in a machine-readable medium, or transmitted through a data signal carried in a carrier wave over a transmission medium or communication link. The "machine-readable medium" can include any medium that can store or transfer information. Examples of the machine-readable medium include an electronic circuit, a semiconductor memory device, a ROM, a flash memory, an erasable ROM (EROM), a floppy diskette, a CD-ROM, an optical disk, a hard disk, a fiber optic medium, a radio frequency (RF) link, and the like. The code segments can be downloaded via computer networks such as the Internet, an intranet, and the like.

[0171] It is also noted that the exemplary embodiments mentioned in the present application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the steps mentioned in the embodiments, that is, the steps can be performed in the order mentioned in the embodiments, or in an order different from the embodiments, or several steps can be performed simultaneously.

[0172] The computer program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other processing device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other processing device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer program instructions can also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other processing device to operate in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function / act specified in the flowchart and / or block diagram block or blocks.

[0173] The above merely describes a specific implementation of the present application. Those skilled in the art can clearly understand the specific working processes of the system, modules and units described above for the convenience and brevity of description, and can refer to the corresponding processes in the foregoing method embodiments, which will not be described herein again. It should be understood that the protection scope of the present application is not limited to this, and any person skilled in the art can easily think of various equivalent modifications or replacements within the technical range disclosed by the present application, and these modifications or replacements should be covered within the protection scope of the present application.

Claims

1. A data transmission method, characterized by, The application discloses an edge computing node applied to a cloud-edge collaborative system, and a data transmission link is established between the edge computing node and a cloud server in the cloud-edge collaborative system. Split the original processing rule policy file into multiple data blocks; According to the multiple data blocks, obtain a data block list including each data block; Through the data transmission link, send the data block list to the cloud server, so that the cloud server compares the processing rule policy file in the cloud server with the data blocks in the data block list, and when it is determined that there is a first processing rule policy file not included in the data block list in the cloud server, transmits the first processing rule policy file to the edge computing node through the data transmission link; Receive the first processing rule policy file sent by the cloud server; Send feedback information of whether the first processing rule policy file is successfully received to the cloud server, so that the cloud server records the state of the first processing rule policy file as having been transmitted to the edge computing node when it is determined that the feedback information is that the edge computing node successfully receives the first processing rule policy file; in the case that the cloud server determines that the feedback information is that the edge computing node does not successfully receive the first processing rule policy file, the synchronization state of the processing rule policy file in the cloud server and the edge computing node is restored to the state before the transmission of the first processing rule policy file; In the case that the feedback information represents successful reception of the first processing rule policy file, send the state parameters collected for k consecutive times to the cloud server, k is an integer greater than or equal to 2, the state parameters are collected by the edge computing node according to the collection strategy issued by the cloud server, and the cloud server is used to determine the state parameter variation of the edge device according to the state parameters of the edge device collected for k consecutive times, judge whether the state parameter variation is within a preset state parameter variation interval, and in the case that the judgment result is yes, keep the original collection frequency to continue collecting the state parameters of the edge device; the cloud server is also used to calculate the interpolation times and the corresponding state parameter interpolation between each adjacent two collected state parameters by using the linear interpolation method, to obtain an interpolation sequence, the interpolation sequence is a value sequence of the adaptive collection algorithm arranged in the time sequence of the interpolation times according to each state parameter interpolation; according to the original data sequence composed of the collected state parameters and the interpolation sequence, determine the collection error of the state parameter, and the collection error is used to trigger the adjustment of the collection frequency; According to the original processing rule policy file and the first processing rule policy file, obtain a synchronized processing rule policy file.

2. The method of claim 1, wherein, The method further comprises: processing the collected state parameters of the edge device according to the synchronized processing rule policy file to obtain processed device data; split the processed device data to obtain multiple sub-device data; Parallel processing of the multiple pieces of sub-device data to obtain a data processing result; According to the data transmission thread in the synchronized processing rule policy file, the data processing result is transmitted to the cloud server, so that the cloud server returns an acknowledgement message to the edge computing node after receiving the data processing result, and disconnects the transmission link with the edge computing node; Receive the response information returned by the cloud server.

3. The method of claim 2, wherein, After the multiple pieces of sub-device data are processed in parallel to obtain a data processing result, the method further comprises: According to the communication mode in the processing rule policy file, the data processing result is sent to the notification program of the local end, so as to send the data processing result to the edge device through the notification program.

4. A data transmission method, characterized by, The cloud server applied to the cloud-edge collaborative system, the cloud server and the edge computing node in the cloud-edge collaborative system have established a data transmission link, and the method comprises: Through the data transmission link, receive the data block list sent by the edge computing node, the data block is the data block obtained by splitting the original processing rule policy file of the edge computing node; Compare the processing rule policy file in the cloud server with the data block in the data block list; When it is determined that the first processing rule policy file not included in the data block list exists in the cloud server, the first processing rule policy file is transmitted to the edge computing node through the data transmission link; Receive the feedback information returned by the edge computing node whether the first processing rule policy file is successfully received; In the case that the feedback information is that the edge computing node successfully receives the first processing rule policy file, record the state of the first processing rule policy file as the state of having been transmitted to the edge computing node; Receive the state parameters collected continuously k times from the edge computing node, k is an integer greater than or equal to 2, and the state parameters are collected by the edge computing node according to the collection strategy issued by the cloud server; According to the state parameters of the edge device collected continuously k times, determine the state parameter variation of the edge device; Determine whether the state parameter variation is within a preset state parameter variation interval range; In the case that the determination result is yes, keep the original collection frequency to continue collecting the state parameters of the edge device; In the case that the feedback information is that the edge computing node does not successfully receive the first processing rule policy file, the synchronization state of the processing rule policy file in the cloud server and the edge computing node is restored to the state before the transmission of the first processing rule policy file; After receiving the state parameters collected continuously k times sent by the edge computing node, the method further comprises: using linear interpolation method to calculate the interpolation times between each adjacent two collected state parameters and the corresponding state parameter interpolation, to obtain an interpolation sequence, the interpolation sequence refers to arranging each state parameter interpolation in the time sequence of interpolation times as the value sequence of the adaptive collection algorithm; determining the collection error of the state parameter according to the original data sequence composed of the collected state parameters and the interpolation sequence, the collection error is used to trigger adjustment of the collection frequency.

5. The method of claim 4, wherein, After judging whether the state parameter variation is within the preset state parameter variation interval range, the method further comprises: In the case that the state parameter variation is less than the lower limit value of the preset state parameter variation interval, reducing the collection frequency of the state parameter of the edge device; In the case that the state parameter variation is greater than the lower limit value of the preset state parameter variation interval, increasing the collection frequency of the state parameter of the edge device.

6. The method of claim 4, wherein, The linear interpolation method is used to calculate the interpolation times between each adjacent two collected state parameters and the corresponding state parameter interpolation, to obtain an interpolation sequence, comprising: For any pair of adjacent two collected state parameters, the following operations are performed respectively: According to the adjacent two collection time points, the time difference between the adjacent two collection time points is determined; According to the time difference and the minimum collection time interval, the interpolation times are determined; According to the adjacent two collected state parameters and the interpolation times, the state parameter interpolation corresponding to the interpolation times is determined; Arranging each state parameter interpolation in the time sequence of interpolation times to obtain an interpolation sequence.

7. A data transmission apparatus, characterized by comprising: An edge computing node applied to a cloud-edge collaborative system, the edge computing node and a cloud server in the cloud-edge collaborative system have a data transmission link established therebetween, and the device comprises: A splitting module is configured to split an original processing rule policy file into a plurality of data blocks; A generating module is configured to obtain a data block list comprising the data blocks according to the plurality of data blocks; A first sending module is configured to send the data block list to the cloud server through the data transmission link, so that the cloud server compares a processing rule policy file in the cloud server with the data blocks in the data block list, and when it is determined that there is a first processing rule policy file not included in the data block list in the cloud server, the first processing rule policy file is transmitted to the edge computing node through the data transmission link; A first receiving module is configured to receive the first processing rule policy file content sent by the cloud server, and synchronize a local processing rule policy file; A feedback module is configured to send feedback information about whether the processing rule policy file is successfully synchronized to the cloud server, so that the cloud server records the first processing rule policy file as having been transmitted to the edge computing node when it is determined that the feedback information is that the first processing rule policy file is successfully received by the edge computing node; A third sending module is configured to: The cloud server is sent feedback information whether the first processing rule policy file is successfully received, so that the cloud server records the state of the first processing rule policy file as a state of being transmitted to the edge computing node when determining that the feedback information is that the edge computing node successfully receives the first processing rule policy file; in the case that the cloud server determines that the feedback information is that the edge computing node does not successfully receive the first processing rule policy file, the synchronization state of the processing rule policy file between the cloud server and the edge computing node is restored to a state before the first processing rule policy file is transmitted; In the case that the feedback information indicates that the first processing rule policy file is successfully received, state parameters collected for k consecutive times are sent to the cloud server, k being an integer greater than or equal to 2, the state parameters being collected by the edge computing node according to a collection strategy issued by the cloud server, the cloud server being configured to determine a state parameter variation of the edge device, judge whether the state parameter variation is within a preset state parameter variation interval range, and keep the original collection frequency to continue collecting the state parameter of the edge device in the case that the judgment result is yes; the cloud server is also configured to calculate an interpolation number and a corresponding state parameter interpolation between each adjacent two collected state parameters by using a linear interpolation method, to obtain an interpolation sequence, the interpolation sequence being a value sequence of the adaptive collection algorithm arranged in the time sequence of the interpolation numbers; the cloud server is also configured to determine a collection error of the state parameter according to an original data sequence composed of the collected state parameters and the interpolation sequence, and the collection error is used to trigger adjustment of the collection frequency.

8. A data transmission apparatus, characterized by comprising: The cloud server applied to a cloud-edge collaborative system, the cloud server and an edge computing node in the cloud-edge collaborative system establish a data transmission link, and the device comprises: A second receiving module is configured to receive a data block list sent by the edge computing node through the data transmission link, the data block being a data block obtained by splitting a processing rule policy file of the edge computing node; A comparison module is configured to poll and compare each data block in the data block list with all processing rule policy files of the local end; A second sending module is configured to directly transmit the first processing rule policy file content of the data block list to the edge computing node through the data transmission link; A third receiving module is configured to receive feedback information returned by the edge computing node whether the first processing rule policy file is successfully received; in the case that the feedback information is that the edge computing node successfully receives the first processing rule policy file, the state of the first processing rule policy file is recorded as a state of being transmitted to the edge computing node; The third receiving module is further configured to receive feedback information returned by the edge computing node about whether the first processing rule policy file is successfully received; in a case where the feedback information indicates that the edge computing node successfully receives the first processing rule policy file, record a state of the first processing rule policy file as a state of having been transmitted to the edge computing node; and in a case where the feedback information indicates that the edge computing node does not successfully receive the first processing rule policy file, restore a synchronization state of the processing rule policy file between the cloud server and the edge computing node to a state before transmission of the first processing rule policy file. The second data processing module is configured to, after the third receiving module receives the feedback information returned by the edge computing node about whether the first processing rule policy file is successfully received, receive state parameters collected continuously k times from the edge computing node, k being an integer greater than or equal to 2, the state parameters being collected by the edge computing node according to a collection strategy issued by the cloud server; determine a state parameter variation of the edge device according to the state parameters collected continuously k times; determine whether the state parameter variation is within a preset state parameter variation range; and in a case where the determination result is yes, maintain an original collection frequency to continue collecting the state parameters of the edge device. The third data processing module is configured to, after the receiving of the state parameters collected continuously k times from the edge computing node, calculate an interpolation number and a corresponding state parameter interpolation between each two adjacent collected state parameters by using a linear interpolation method, to obtain an interpolation sequence, the interpolation sequence being a value sequence of the adaptive collection algorithm obtained by arranging the state parameter interpolations in a time sequence of the interpolation numbers; and determine a collection error of the state parameters according to an original data sequence composed of the collected state parameters and the interpolation sequence, the collection error being used to trigger adjustment of the collection frequency.

9. An electronic device, comprising: The device comprises a processor and a memory storing computer program instructions. The processor executes the computer program instructions to implement the data transmission method of any one of claims 1-6.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer program instructions, and the computer program instructions are executed by the processor to implement the data transmission method of any one of claims 1-6.

11. A computer program product, characterised in that, The instructions in the computer program product are executed by the processor of the electronic device to enable the electronic device to perform the data transmission method of any one of claims 1-6.

Images