A data access method for a communication gateway of an electric power auxiliary equipment

Abstract

The present invention relates to a data access method of an electric power auxiliary equipment communication gateway, comprising: when the auxiliary equipment communication gateway receives real-time data, it determines whether the current data volume or data backlog time reaches a predetermined threshold; if the determination result is yes, the current data is compressed and transferred to a background storage server; when the auxiliary equipment communication gateway receives a retrieval instruction, the current data is compressed and transferred to a background storage server, and then a query retrieval command is sent; after receiving the query retrieval command, the background storage server compresses the retrieved data, performs segmentation processing, and then forwards the data to the auxiliary equipment communication gateway; the auxiliary equipment communication gateway decompresses the data and performs integrity verification, and finally feeds back to the search party. The present invention effectively solves the problem of insufficient storage capacity of the auxiliary equipment communication gateway itself; the data retrieval task is assigned to the background storage server, and the real-time data communication performance of the auxiliary equipment communication gateway is improved.

Description

Technical Field

[0001] The invention relates to the technical field of transformer substation auxiliary equipment automation, in particular to a data access method for a power auxiliary equipment communication gateway. Background Art

[0002] Electric power technology is changing with each passing day, and operations are becoming increasingly intelligent. As the intermediate link of data transmission in substations, auxiliary equipment communication gateways carry a large amount of data collection and forwarding work. In order to improve its data processing speed, auxiliary equipment communication gateways generally use embedded devices, which have relatively fast data processing speeds but small storage capacity. These characteristics determine that there will be certain limitations on its access to historical data. When it is necessary to access these historical data and perform troubleshooting and predictive analysis, the disadvantage of its weak storage capacity becomes prominent.

[0003] In order to solve the problem of data access and retrieval in the auxiliary device communication gateway, a large-capacity storage medium can be added to the auxiliary device communication gateway. This can solve the storage limitation of the auxiliary device communication gateway, but it will also reduce the collection and forwarding capabilities of the gateway itself, resulting in a decrease in its collection and forwarding capabilities. Summary of the invention

[0004] The object of the present invention is to provide a data access method of an electric auxiliary equipment communication gateway machine which can improve the real-time data communication performance of the auxiliary equipment communication gateway machine while solving the storage problem of the auxiliary equipment communication gateway machine.

[0005] To achieve the above object, the present invention adopts the following technical solution: a data access method for a power auxiliary equipment communication gateway, the method comprising the following steps in sequence:

[0006] (1) When the auxiliary equipment communication gateway receives real-time data, it determines whether the current data volume or data backlog time has reached a predetermined threshold;

[0007] (2) If the judgment result of step (1) is yes, compress the current data and transfer it to the background storage server; otherwise, return to step (1) to continue the judgment;

[0008] (3) When the auxiliary equipment communication gateway receives the access instruction, it compresses the current data and transfers it to the background storage server, and then sends a query access command to the background storage server to obtain the corresponding data;

[0009] (4) After receiving the query command, the backend storage server compresses the retrieved data, segments the compressed data, and then forwards the segmented data to the auxiliary device communication gateway;

[0010] (5) After receiving the retrieved data, the auxiliary equipment communication gateway will decompress the data and perform integrity check, and finally feedback to the search party.

[0011] TCP communication is adopted between the auxiliary device communication gateway and the background storage server.

[0012] After receiving the real-time data from the auxiliary device communication gateway, the background storage server first decompresses the data and then stores the data in the background storage server.

[0013] When the auxiliary device communication gateway receives a file transfer request from the background storage server, it confirms the current request and sends a confirmation signal to the background storage server; when the background storage server transmits data to the auxiliary device communication gateway, it uses multi-threading, and the number of threads is the number of cores of the background storage server.

[0014] The step (4) specifically means that after the background storage server retrieves the data, when the data volume is greater than 1MB, the data is divided into equal parts of 1MB. When transmitting, the auxiliary device communication gateway is first notified of the current transmission task ID, total number of packets, current packet sequence number, current packet length and current packet CRC32 check value.

[0015] The step (5) specifically refers to: when the auxiliary device communication gateway receives the data fed back by the background storage server, it integrates the packet sequence according to the current transmission task ID, and if a packet or multiple packets have a transmission verification error, it notifies the background storage server to retransmit; when the auxiliary device communication gateway receives all the data fed back by the background storage server and the verification is successful, it notifies the background storage server that the data transmission is completed.

[0016] In step (5), when the auxiliary device communication gateway receives data from the background storage server and the verification fails and the number of retransmissions is greater than 3, the current transmission is interrupted and the search party is notified of the search failure; when the auxiliary device communication gateway receives data from the background storage server and the verification succeeds, the data is segmented and decompressed and merged, and then transmitted to the search party.

[0017] It can be seen from the above technical scheme that the beneficial effects of the present invention are: first, the present invention effectively solves the problem of insufficient storage capacity of the auxiliary device communication gateway itself; second, the present invention assigns data retrieval tasks to the background storage server, thereby improving the real-time data communication performance of the auxiliary device communication gateway; third, the present invention adopts a fragmented transmission method to feedback and retrieve data, thereby effectively reducing the problem of long IO occupancy caused by excessive transmission data volume; fourth, the present invention has a data retransmission mechanism and a data verification strategy to avoid retrieval errors caused by data loss and damage. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is the overall communication flow chart of the auxiliary device communication gateway and the backend storage server;

[0019] Figure 2 Retrieve and read flow chart for auxiliary equipment communication gateway;

[0020] Figure 3 Flowchart of shard transmission for backend storage server;

[0021] Figure 4 To assist the device communication gateway in negotiating the communication process with the backend storage server. DETAILED DESCRIPTION

[0022] like Figure 1 As shown, a data access method for a power auxiliary device communication gateway machine includes the following steps in sequence:

[0023] (1) When the auxiliary equipment communication gateway receives real-time data, it determines whether the current data volume or data backlog time has reached a predetermined threshold;

[0024] (2) If the judgment result of step (1) is yes, compress the current data and transfer it to the background storage server; otherwise, return to step (1) to continue the judgment;

[0025] (3) When the auxiliary equipment communication gateway receives the access instruction, it compresses the current data and transfers it to the background storage server, and then sends a query access command to the background storage server to obtain the corresponding data;

[0026] (4) After receiving the query command, the backend storage server compresses the retrieved data, segments the compressed data, and then forwards the segmented data to the auxiliary device communication gateway;

[0027] (5) After receiving the retrieved data, the auxiliary equipment communication gateway will decompress the data and perform integrity check, and finally feedback to the search party.

[0028] TCP communication is adopted between the auxiliary device communication gateway and the background storage server.

[0029] After receiving the real-time data from the auxiliary device communication gateway, the background storage server first decompresses the data and then stores the data in the background storage server.

[0030] When the auxiliary device communication gateway receives a file transfer request from the background storage server, it confirms the current request and sends a confirmation signal to the background storage server; when the background storage server transmits data to the auxiliary device communication gateway, it uses multi-threading, and the number of threads is the number of cores of the background storage server.

[0031] The step (4) specifically means that after the background storage server retrieves the data, when the data volume is greater than 1MB, the data is divided into equal parts of 1MB. When transmitting, the auxiliary device communication gateway is first notified of the current transmission task ID, total number of packets, current packet sequence number, current packet length and current packet CRC32 check value.

[0032] The step (5) specifically refers to: when the auxiliary device communication gateway receives the data fed back by the background storage server, it integrates the packet sequence according to the current transmission task ID, and if a packet or multiple packets have a transmission verification error, it notifies the background storage server to retransmit; when the auxiliary device communication gateway receives all the data fed back by the background storage server and the verification is successful, it notifies the background storage server that the data transmission is completed.

[0033] In step (5), when the auxiliary device communication gateway receives data from the background storage server and the verification fails and the number of retransmissions is greater than 3, the current transmission is interrupted and the search party is notified of the search failure; when the auxiliary device communication gateway receives data from the background storage server and the verification succeeds, the data is segmented and decompressed and merged, and then transmitted to the search party.

[0034] When the auxiliary device communication gateway receives the access instruction, it first saves and compresses the local data and informs the backend storage server of the data content and identification to be received. When the backend storage server confirms, the auxiliary device communication gateway transfers the data to the backend storage server, and then the auxiliary device communication gateway informs the backend storage server of the content to be retrieved, which includes the identification id, whether to compress, start time, end time and device id.

[0035] When the backend storage server receives the retrieval signal, it parses and verifies the protocol content and then performs data retrieval. According to the retrieval protocol of the auxiliary device communication gateway, it determines whether to compress the retrieval content and compresses the retrieved data in slices according to the data volume.

[0036] When the background storage server completes the retrieval and compression tasks, it should immediately stop the data that has not been transmitted to the auxiliary device communication gateway machine, and notify the auxiliary device communication gateway machine to prepare to receive data. At this time, the identification id in the data structure should be incremented by 1, and the number of shards should be the actual number of shards of the current retrieved data.

[0037] After receiving the message from the background storage server, the auxiliary device communication gateway immediately stops the current data feedback task, prepares to receive data feedback from the background storage server and feeds back the received data to the reviewing party in a timely manner.

[0038] like Figure 1As shown, after receiving real-time data, the auxiliary device communication gateway determines whether the current data volume or data backlog time reaches a predetermined threshold, performs compression and storage tasks based on the judgment result, and compresses the current data and transfers it to the background storage server when the current data volume or data backlog time reaches the predetermined threshold.

[0039] like Figure 2 As shown, when the auxiliary device communication gateway receives a retrieval instruction, if the retrieval time is later than the established threshold, the current real-time data needs to be locked and compressed and transferred to the background storage server, and then a command is sent to the background storage server for retrieval.

[0040] like Figure 3 As shown, after receiving the access instruction, the background storage server first parses and processes the instruction, then completes the file retrieval task according to the instruction, and selects the compression method to transmit to the auxiliary device communication gateway machine according to the amount of retrieved data.

[0041] like Figure 4 As shown, the auxiliary device communication gateway sends the retrieval id to the background storage server, and the background storage server feeds back the auxiliary device communication gateway the shard number n and the feedback id based on the retrieval results. After the auxiliary device communication gateway receives the response message from the background storage server, it prepares to receive the message and sends a message confirmation response to the background storage server. After receiving the message response, the background storage server starts to send the retrieval results to the auxiliary device communication gateway.

[0042] In summary, the present invention effectively solves the problem of insufficient storage capacity of the auxiliary device communication gateway itself; the present invention assigns data retrieval tasks to the background storage server, thereby improving the real-time data communication performance of the auxiliary device communication gateway; the present invention adopts a fragmented transmission method to feedback and retrieve data, thereby effectively reducing the problem of long IO occupancy caused by excessive transmission data volume; the present invention has a data retransmission mechanism and a data verification strategy to avoid retrieval errors caused by data loss and damage.

Claims

1. A data access method for a power auxiliary equipment communication gateway, characterized in that: The method comprises the following steps in order: (1) When the auxiliary equipment communication gateway receives real-time data, it determines whether the current data volume or data backlog time has reached a predetermined threshold; (2) If the judgment result of step (1) is yes, compress the current data and transfer it to the background storage server; otherwise, return to step (1) to continue the judgment; (3) When the auxiliary equipment communication gateway receives the access instruction, it compresses the current data and transfers it to the background storage server, and then sends a query access command to the background storage server to obtain the corresponding data; (4) After receiving the query command, the backend storage server compresses the retrieved data, segments the compressed data, and then forwards the segmented data to the auxiliary device communication gateway; (5) After receiving the retrieved data, the auxiliary equipment communication gateway will decompress the data and perform integrity check, and finally feedback to the search party; When the auxiliary equipment communication gateway receives the access instruction, it first saves and compresses the local data and informs the background storage server of the data content and identification to be received; When the backend storage server confirms, the auxiliary device communication gateway transfers the data to the backend storage server, and then the auxiliary device communication gateway notifies the backend storage server of the content to be retrieved, which includes the identification ID, whether to compress, start time, end time and device ID; When the backend storage server receives the retrieval signal, it parses and verifies the protocol content and then performs data retrieval; according to the retrieval protocol of the auxiliary device communication gateway, it determines whether to compress the retrieval content, and compresses the retrieved data in pieces according to the data volume; When the background storage server completes the retrieval and compression tasks, it shall immediately stop the data that has not been transmitted to the auxiliary device communication gateway machine, and notify the auxiliary device communication gateway machine to prepare to receive data; at this time, the identification id in the data structure shall be incremented by 1, and the number of shards shall be the actual number of shards of the currently retrieved data; After receiving the message from the background storage server, the auxiliary equipment communication gateway immediately stops the current data feedback task, prepares to receive data feedback from the background storage server and feeds back the received data to the reviewing party in a timely manner; The auxiliary device communication gateway and the backend storage server use TCP communication; After receiving the real-time data from the auxiliary device communication gateway, the backend storage server first decompresses the data and then stores the data in the backend storage server; When the auxiliary device communication gateway receives the file transfer request from the backend storage server, it confirms the current request and sends a confirmation signal to the backend storage server; When the backend storage server transmits data to the auxiliary device communication gateway, multi-threading is used for transmission, and the number of threads is the number of cores of the backend storage server; The step (4) specifically refers to: after the backend storage server retrieves the data, when the data volume is greater than 1MB, the data is divided into equal parts of 1MB, and when transmitting, the auxiliary device communication gateway is first notified of the current transmission task ID, the total number of packets, the current packet sequence number, the current packet length and the current packet CRC32 check value; The step (5) specifically refers to: when the auxiliary device communication gateway receives the data fed back by the background storage server, it automatically integrates the packet sequence according to the current transmission task ID, and if a packet or multiple packets have a transmission check error, it notifies the background storage server to retransmit; When the auxiliary device communication gateway receives all the data fed back by the background storage server and verifies it successfully, it notifies the background storage server that the data transmission is completed; In step (5), when the auxiliary device communication gateway receives data from the background storage server and the verification fails and the number of retransmissions is greater than 3, the current transmission is interrupted and the search party is notified of the search failure; when the auxiliary device communication gateway receives data from the background storage server and the verification succeeds, the data is segmented and decompressed and merged, and then transmitted to the search party.

Images