Wind power plant data recovery system and wind power plant

Abstract

The utility model relates to a wind power plant data recovery system and a wind power plant, relates to the technical field of data transmission, and can realize efficient recovery of off-line data of the wind power plant. The system comprises a client, an uploading server and a data transmission server, the data transmission server comprises a data bus server, a database server and a plurality of data storage servers, the client is in communication connection with the uploading server, the uploading server is in communication connection with the data bus server, and the data storage servers are in communication connection with the database server. The data bus server is respectively in communication connection with the plurality of data storage servers, and the plurality of data storage servers are respectively in communication connection with the database server; the uploading server decompresses the offline data packet of the wind turbine generator in the wind power plant obtained by the client into a plurality of data files, and uploads the plurality of data files to a target server in the data bus server in parallel; and each data storage server competes to read the data file in the target server and transmits the read data file to the database server.

Description

Technical Field

[0001] This disclosure relates to the field of data transmission technology, and more specifically, to a wind farm data recovery system and a wind farm. Background Technology

[0002] Currently, due to network isolation requirements, most wind farms cannot collect vibration monitoring data from wind turbines online and send it to the cloud data center. Instead, the data is copied to the external network in batches as offline data packets and then uploaded to the cloud data center in batches via the Internet through a client.

[0003] In related technologies, the main method for recovering wind turbine vibration monitoring data is based on a serial processing method of uploading, decompressing, and storing data on a single server. This method suffers from problems such as low transmission and decompression storage efficiency, limited system throughput, and unreliable data transmission. Utility Model Content

[0004] To address the shortcomings of related technologies, this disclosure provides a wind farm data recovery system and a wind farm.

[0005] To achieve the above objectives, in a first aspect, this disclosure provides a wind farm data recovery system, the system including a client, an upload server, and a data transmission server, the data transmission server including a data bus server, a database server, and multiple data storage servers, the client communicating with the upload server, the upload server communicating with the data bus server, the data bus server communicating with each of the multiple data storage servers, and the multiple data storage servers communicating with each of the database server.

[0006] The client is used to obtain offline data packets of wind turbines in the wind farm within a preset time period and transmit the offline data packets to the upload server.

[0007] The upload server is used to decompress the offline data packet into multiple data files, and upload the multiple data files in parallel to a target server in the data bus server;

[0008] Each of the data storage servers is configured to compete with the other data storage servers among the plurality of data storage servers to read the data file in the target server, and after reading the data file, to transmit the data file to the database server;

[0009] The database server is used to store the data files.

[0010] Optionally, the system further includes a reverse proxy server, which is communicatively connected to both the client and the upload server.

[0011] The client is used to transmit the offline data packet to the reverse proxy server;

[0012] The reverse proxy server is used to transmit the offline data packets to the upload server.

[0013] Optionally, the reverse proxy server is an Nginx server.

[0014] Optionally, the system further includes a data caching server, which is communicatively connected to the data storage server;

[0015] The data storage server is used to transmit the data file to the data cache server after reading the data file;

[0016] The data caching server is used to transfer the data file to the database server.

[0017] Optionally, there may be multiple clients.

[0018] Optionally, the database server includes a distributed relational database server and a distributed key-value database server, and each of the data storage servers is communicatively connected to the distributed relational database server and the distributed key-value database server, respectively.

[0019] Optionally, the data bus server may include multiple EMQX servers or NanoMQ servers.

[0020] Optionally, the client is located at the wind farm site, and the upload server and the data transmission server are located in the remote equipment room of the wind farm.

[0021] Secondly, this disclosure provides a wind farm including the wind farm data recovery system described in the first aspect.

[0022] Through the above technical solution, the client communicates with the upload server, and the upload server communicates with the data bus server. Thus, the upload server can upload multiple data files obtained from decompressing offline data packets in parallel to a target server within the data bus server, achieving rapid uploading of multiple data files. The data bus server also communicates with multiple data storage servers. Therefore, each data storage server can compete with the other data storage servers to read data files from the target server within the data bus server, forming a competitive shared subscription mechanism. This shortens the data transmission time and improves the processing efficiency of the wind farm data recovery system. Multiple data storage servers communicate with a database server, allowing multiple data storage servers to simultaneously store multiple data files into the database server, thereby improving data storage efficiency.

[0023] Other features and advantages of this disclosure will be described in detail in the following detailed description section. Attached Figure Description

[0024] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the following detailed description to explain the present disclosure, but do not constitute a limitation thereof. In the drawings:

[0025] Figure 1 This is a schematic diagram of a wind power airport data recovery system according to an exemplary embodiment of the present disclosure.

[0026] Figure 2 This is another schematic diagram of a wind farm data recovery system according to an exemplary embodiment of the present disclosure.

[0027] Explanation of reference numerals in the attached figures

[0028] 1. Client, 2. Upload server, 3. Data transmission server, 31. Data bus server, 32. Database server, 33. Data storage server, 321. Distributed relational database server, 322. Distributed key-value database server, 4. Reverse proxy server, 5. Data caching server. Detailed Implementation

[0029] The specific embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for illustration and explanation only and are not intended to limit this disclosure.

[0030] As mentioned in the background section, in the related technology, the invention patent with application number (CN115766706A) discloses a network data transmission method. By establishing a data transmission service to establish a communication connection with the other end, pre-allocating file receiving buffer space according to the file segment information of the file to be transmitted, cyclically reading the file transmission data packets sent by the other end, parsing the data packet sequence number and file segment sequence number from the file transmission data packets, and writing the file data in the file transmission data packets into the corresponding position of the file receiving buffer space according to the data packet sequence number, high-speed transmission of network data can be achieved.

[0031] The invention patent with application number (CN102056235A) discloses a data transmission method that utilizes the point-to-point characteristics of transmission in wireless networks to flatten the existing protocol stack, thereby minimizing the amount of data transmitted over the air interface and significantly improving the efficiency of air interface transmission.

[0032] The invention patent application with application number (CN118890379A) ​​discloses a data transmission method. By pre-sending data information, the data receiving device can accurately parse the data frames based on the frame size in the data information, thereby solving the problems of packet fragmentation and / or packet reassembly. Furthermore, by using a connectionless communication method, data information can be transmitted directly without establishing a connection, thus improving transmission efficiency.

[0033] The invention patent with application number (CN104936128A) discloses an offline data transfer method. Before performing offline data transfer, a Bluetooth connection is established between the Bluetooth device and the user terminal. By establishing a connection between the Bluetooth device and the user terminal via Bluetooth, and then obtaining the data transfer request, offline payment can be completed quickly. The user terminal does not need to integrate an NFC chip, which reduces development costs and increases the adoption rate. Furthermore, establishing a connection before initiating a payment request can save time and improve processing efficiency.

[0034] The invention patent with application number (CN104090891A) discloses a data processing method. It collects at least one data in real time according to the data source information in the access configuration information, and stores each data in a distributed manner according to the business attribute information identified by the converted general protocol. Then, each data is preprocessed and sorted, and the sorted data is stored by a distributed file system. This enables real-time collection and processing of large amounts of data. Furthermore, the protocol conversion can enable access to different types of data, thus improving the efficiency of data processing.

[0035] Based on the above technical solutions, it can be seen that, in order to meet the need for timely batch uploading and recycling of a large number of offline data packets on the wind farm side, the relevant technologies generally adopt a serial processing method of uploading, decompressing and storing data on a single server. The client uploads data to the server through a network transmission connection. After receiving the data, the server directly performs decompression and storage processing. A single server can only receive a limited number of data submitted by multiple upload clients at the same time within its processing capacity and perform decompression and storage processing after receiving the data.

[0036] The inventors discovered that the related technologies lack any distributed high-concurrency processing mechanisms such as caching, queuing, and reverse proxy during data transmission, and therefore suffer from the following main problems:

[0037] 1. Low transmission, decompression and storage efficiency: Since each uploaded data stream is serial, it does not fully utilize infrastructure resources such as network bandwidth, memory, CPU, and disk, resulting in low processing efficiency.

[0038] 2. Low system throughput: Since the upload server is only a single process instance, compared with multiple parallel processing process instances, the overall system throughput is very limited.

[0039] 3. Unreliable system: Since the upload server is only a single-process instance, it is unreliable in the event of server failure or downtime.

[0040] In view of this, the present disclosure provides a wind farm data recycling system and a wind farm, which can upload offline data packets in a parallel transmission manner and transmit and store offline data packets based on a contention-based shared subscription mechanism, thereby improving data transmission efficiency.

[0041] Figure 1 This is a wind farm data recovery system illustrated according to an exemplary embodiment of the present disclosure, such as... Figure 1 As shown, the system includes a client 1, an upload server 2, and a data transmission server 3. The data transmission server 3 includes a data bus server 31, a database server 32, and multiple data storage servers 33. The client 1 is communicatively connected to the upload server 2, the upload server 2 is communicatively connected to the data bus server 31, the data bus server 31 is communicatively connected to each of the multiple data storage servers 33, and the multiple data storage servers 33 are communicatively connected to the database server 32.

[0042] The client 1 is used to obtain offline data packets of wind turbines in the wind farm within a preset time period and transmit the offline data packets to the upload server 2.

[0043] The upload server 2 is used to decompress the offline data packet into multiple data files and upload the multiple data files in parallel to a target server in the data bus server 31.

[0044] Each of the data storage servers 33 is used to compete with the other data storage servers 33 among the plurality of data storage servers 33 to read the data file in the target server, and after reading the data file, to transmit the data file to the database server 32;

[0045] The database server 32 is used to store the data file.

[0046] The preset time period can be preset according to the data collection needs, and this disclosure does not limit it.

[0047] In this embodiment, the data from the wind farm side in the wind farm is generally stored in the Condition Monitoring System Database (CMS database). Client 1 downloads multiple data files of the wind turbine within a preset time period from the CMS database, packages and compresses the multiple data files into an offline data package, and transmits the offline data package to the upload server 2. The multiple data files in the offline data package are file data organized according to measurement events.

[0048] Upload server 2 decompresses the offline data packet into multiple data files, organizes them according to the measurement events corresponding to each data file, and uploads the multiple data files in parallel to a target server in data bus server 31. Data bus server 31 consists of multiple servers, and each server in data bus server 31 stores data files of the same topic type.

[0049] The data storage server 33 includes multiple message subscription threads and multiple data storage threads. Each data storage server 33 that subscribes to the target server competes to read the data file in the target server through the message subscription thread, and then transmits the read data file to the database server 32 through the data storage thread. The database server 32 saves the data file.

[0050] In the above technical solution, the client communicates with the upload server, and the upload server communicates with the data bus server. Thus, the upload server can upload multiple data files obtained from decompressing offline data packets in parallel to a target server within the data bus server, achieving rapid uploading of multiple data files. The data bus server also communicates with multiple data storage servers. Therefore, each data storage server can compete with the other data storage servers to read data files from the target server within the data bus server, forming a competitive shared subscription mechanism. This shortens the data transmission time and improves the processing efficiency of the wind farm data recovery system. The multiple data storage servers communicate with a database server, allowing them to simultaneously store multiple data files into the database server, thereby improving data storage efficiency.

[0051] To facilitate a better understanding of the wind farm data recovery system provided in this disclosure by those skilled in the art, the wind farm data recovery system will be described in detail below.

[0052] In one embodiment, the client 1 is located at the wind farm site, and the upload server 2 and the data transmission server 3 are located in the remote equipment room of the wind farm.

[0053] In one embodiment, such as Figure 2 As shown, the plurality of clients 1 are connected to one upload server 2, and the number of clients 1 and upload server 2 can be expanded as needed according to the scale of business data.

[0054] In this embodiment, after uploading multiple data files to a target server in the data bus server 31, the upload server 2 can delete multiple data files and send the upload progress information of the multiple data files back to the corresponding client 1.

[0055] In one embodiment, such as Figure 2 As shown, the system also includes a reverse proxy server 4, which is communicatively connected to the client 1 and the upload server 2 respectively.

[0056] The client 1 is used to transmit the offline data packet to the reverse proxy server 4;

[0057] The reverse proxy server 4 is used to transmit the offline data packets to the upload server 2.

[0058] In this embodiment, client 1 includes multiple threads. Client 1 divides the offline data packet into multiple data blocks according to the preset byte stream size, and transmits the multiple data blocks to the reverse proxy server 4 in parallel through multiple threads. The reverse proxy server 4 sequentially allocates multiple data blocks belonging to the same offline data packet to the same upload server 2. The upload server 2 receives the data blocks one by one in sequence, accumulating them into a complete offline data packet.

[0059] In the above technical solution, a multi-instance reverse proxy is implemented between the client and the upload server based on a reverse proxy server, which can achieve dynamic load balancing and high availability of the upload server.

[0060] In one embodiment, the reverse proxy server 4 is an Nginx server.

[0061] In this embodiment, the reverse proxy server can also be an HAProxy server, or other servers that support HTTP proxying. This disclosure does not limit this.

[0062] In one embodiment, such as Figure 2 As shown, there are multiple clients 1.

[0063] In this embodiment, multiple clients 1 respectively obtain offline data packets from different wind turbines in the wind farm within a preset time period. The multiple clients 1 transmit multiple offline data packets to the upload server 2 in parallel using a multi-path parallel HTTP transmission method. In the event of a transmission failure (such as network failure, client operating system failure, etc.), after the transmission failure is cleared, each client 1 resumes transmitting offline data packets to the reverse proxy server 4 according to the transmission progress corresponding to the transmission failure.

[0064] In the above technical solution, offline data packets are transmitted to the upload server through data block and multi-path parallel HTTP transmission on the client side. It also supports resuming interrupted transmission, ensuring the reliability of the offline data packet transmission process.

[0065] In one embodiment, such as Figure 2 As shown, the system also includes a data cache server 5, which is communicatively connected to the data storage server 33;

[0066] The data storage server 33 is used to transmit the data file to the data cache server 5 after reading the data file;

[0067] The data caching server 5 is used to transfer the data file to the database server 32.

[0068] In this embodiment, the data cache server 5 is equipped with a data cache queue built based on the memory and file system of the data storage server. The data storage server 33 competes to read file data from the target server through multiple message subscription threads and writes it into the data cache queue in the data cache server 5. The data storage server 33 transmits the data files of the data cache queue to the database server 32 through the data storage thread.

[0069] In one embodiment, such as Figure 2 As shown, the database server 32 includes a distributed relational database server 321 and a distributed key-value database server 322, and each of the data storage servers 33 is communicatively connected to the distributed relational database server 321 and the distributed key-value database server 322, respectively.

[0070] The distributed relational database server 321 can be a TiDB server, or a MySQL server, or other relational database server. The distributed key-value database server 322 can be an HBase server, or a Cassandra server, or other distributed columnar storage database server. This disclosure does not impose any limitations on it.

[0071] In this embodiment, the data storage server 33 stores the file data that is relational data in the data cache sequence into the distributed relational database server 321 through the data storage thread, and stores the file data that is key value in the data cache sequence into the distributed key-value pair database server 322.

[0072] In one embodiment, the data bus server 31 includes multiple EMQX servers or NanoMQ servers.

[0073] In this embodiment of the disclosure, the data bus server may also be other MQTT message bus servers that support shared subscription groups, and this disclosure does not limit it in this way.

[0074] The data recovery process of the wind farm data recovery system provided in this disclosure is described below using a complete embodiment:

[0075] I. When the wind farm data recycling system is running, the client downloads and compresses the data from the CMS database into offline data packets, and then transmits them sequentially to an upload server on the backend of the reverse proxy server Nginx in small data blocks and multiple parallel HTTP transmission methods. If network abnormalities or client operating system abnormalities occur during transmission, the client can automatically retry. It also supports automatically resuming the transmission from the previous interruption point when the client is reopened and resubmitting the same offline data packets.

[0076] II. An upload server instance on the backend of the Nginx reverse proxy server sequentially receives data blocks, accumulating them into a complete offline data packet file. This file is then decompressed into multiple data files, which are finally sent to the target server (of the corresponding topic type) within the EMQX server for subsequent data storage server instances subscribed to that topic type to competitively read the data files. Upon successful transmission, the upload server deletes the corresponding data file and simultaneously returns upload progress information to the client in real time. The reverse proxy server can effectively distribute the client's transmitted offline data packets across its multiple backend upload servers.

[0077] III. After the data storage server in the same shared subscription group subscribes to the data file of the target server through the message subscription thread in a competitive manner, it stores the data file in the data cache queue of the data cache server. At the same time, the data storage thread in the data storage server reads the data file in the data cache queue in a loop, stores the relational data belonging to the feature value in the data cache queue into the TiDB server, and stores the key-value pair data belonging to the vibration waveform in the data cache queue into the HBase server.

[0078] In the aforementioned technical solution, the wind farm data recycling system, based on a reverse proxy mechanism and a competitive shared subscription mechanism, can achieve data recycling through multiple parallel processes, support HTTP multi-data-block transmission and breakpoint resumption, thereby improving the reliability of data transmission in the wind farm data recycling system. Furthermore, the number of clients can be expanded as needed, maximizing the utilization of infrastructure resources such as network bandwidth, memory, CPU, and disk, thus improving the processing efficiency of the wind farm data recycling system. On the other hand, a data cache queue is used as a cache queue for the data storage server, giving the entire wind farm data recycling system sufficiently powerful throughput capabilities, and the data storage server can also be expanded as needed.

[0079] Based on the same inventive concept, this disclosure also provides a wind farm, including the above-mentioned wind farm data recovery system.

[0080] The preferred embodiments of this disclosure have been described in detail above with reference to the accompanying drawings. However, this disclosure is not limited to the specific details of the above embodiments. Within the scope of the technical concept of this disclosure, various simple modifications can be made to the technical solutions of this disclosure, and these simple modifications all fall within the protection scope of this disclosure.

[0081] It should also be noted that the various specific technical features described in the above embodiments can be combined in any suitable manner without contradiction. To avoid unnecessary repetition, this disclosure will not describe the various possible combinations separately.

[0082] Furthermore, various different embodiments of this disclosure can be combined in any way, as long as they do not violate the spirit of this disclosure, they should also be regarded as the content disclosed in this disclosure.

Claims

1. A wind farm data recovery system, characterized in that, The system includes a client (1), an upload server (2), and a data transmission server (3). The data transmission server (3) includes a data bus server (31), a database server (32), and multiple data storage servers (33). The client (1) is communicatively connected to the upload server (2). The upload server (2) is communicatively connected to the data bus server (31). The data bus server (31) is communicatively connected to the multiple data storage servers (33) respectively. The multiple data storage servers (33) are communicatively connected to the database server (32) respectively. The client (1) is used to obtain offline data packets of wind turbines in the wind farm within a preset time period and transmit the offline data packets to the upload server (2). The upload server (2) is used to decompress the offline data packet into multiple data files and upload the multiple data files in parallel to a target server in the data bus server (31); Each of the data storage servers (33) is used to compete with the other data storage servers (33) among the plurality of data storage servers (33) to read the data file in the target server, and after reading the data file, to transmit the data file to the database server (32). The database server (32) is used to store the data file.

2. The wind farm data recovery system according to claim 1, characterized in that, The system also includes a reverse proxy server (4), which is communicatively connected to the client (1) and the upload server (2) respectively; The client (1) is used to transmit the offline data packet to the reverse proxy server (4). The reverse proxy server (4) is used to transmit the offline data packets to the upload server (2).

3. The wind farm data recovery system according to claim 2, characterized in that, The reverse proxy server (4) is an Nginx server.

4. The wind farm data recovery system according to claim 1, characterized in that, The system also includes a data cache server (5), which is communicatively connected to the data storage server (33); The data storage server (33) is used to transmit the data file to the data cache server (5) after reading the data file. The data cache server (5) is used to transfer the data file to the database server (32).

5. The wind farm data recovery system according to any one of claims 1-4, characterized in that, There are multiple clients (1).

6. The wind farm data recovery system according to any one of claims 1-4, characterized in that, The database server (32) includes a distributed relational database server (321) and a distributed key-value database server (322), and each of the data storage servers (33) is communicatively connected to the distributed relational database server (321) and the distributed key-value database server (322).

7. The wind farm data recovery system according to any one of claims 1-4, characterized in that, The data bus server (31) includes multiple EMQX servers or NanoMQ servers.

8. The wind farm data recovery system according to any one of claims 1-4, characterized in that, The client (1) is located on the site side of the wind farm, and the upload server (2) and the data transmission server (3) are located in the remote computer room of the wind farm.

9. A wind farm, characterized in that, Includes the wind farm data recovery system as described in any one of claims 1-8.

Images