Energy storage power station operation data management method and system

Abstract

The invention provides an energy storage power station operation data management method and system in the technical field of energy storage power stations, and the method comprises the steps: S1, enabling a middle computer of an energy storage power station to collect the operation data of all equipment, and carrying out the preprocessing of all operation data; s2, the middle computer sends all the operation data to the upper computer in real time through MQTT; s3, the upper computer receives the operation data in real time and stores the operation data in a pre-created message queue; s4, the upper computer takes out the operation data from the message queue, and generates a memory mapping file based on the read operation data; s5, the upper computer obtains an off-line file generated by automatically caching the running data after the MQTT is disconnected from the upper computer through the FTP, the off-line file is spliced to the end of the memory mapping file, and a spliced mapping file is obtained and stored; and step S6, reading the operation data based on the spliced mapping file. The method has the advantages that the storage reliability and the access efficiency of the operation data of the energy storage power station are greatly improved.

Description

Technical Field

[0001] The present invention relates to the technical field of energy storage power stations, and in particular to an energy storage power station operation data management method and system. Background Art

[0002] Various equipment in energy storage power stations, such as charging piles, energy storage inverters, and energy storage batteries, generate a large amount of operating data every moment. These operating data are transmitted to the host computer through the intermediate computer, and the host computer stores these operating data. The integrity of a large amount of operating data needs to be ensured during the transmission process.

[0003] When the host computer has limited CPU and storage hard disk, it is necessary to ensure the stable storage and long-term storage of operation data. If the host computer is used to directly store operation data, a large amount of operation data may be lost and lose integrity when the host computer crashes abnormally or is directly shut down. At the same time, storing a large amount of operation data will take up a lot of storage space, and reading will be difficult.

[0004] Therefore, how to provide a method and system for managing the operation data of an energy storage power station to improve the reliability and access efficiency of the operation data storage of the energy storage power station has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The technical problem to be solved by the present invention is to provide a method and system for managing operation data of an energy storage power station, so as to improve the reliability and access efficiency of the operation data storage of the energy storage power station.

[0006] In a first aspect, the present invention provides a method for managing operation data of an energy storage power station, comprising the following steps:

[0007] Step S1, the central computer of the energy storage power station collects the operating data of each device and pre-processes the operating data;

[0008] Step S2, the intermediate computer sends the operation data to the upper computer in real time through MQTT;

[0009] Step S3: The host computer receives the operation data in real time and stores it in a pre-created message queue;

[0010] Step S4: The host computer retrieves the operation data from the message queue and generates a memory mapping file based on the read operation data;

[0011] Step S5, the upper computer obtains the offline file automatically cached and generated by the operation data after the MQTT is disconnected from the intermediate computer through FTP, and splices the offline file at the end of the memory mapping file to obtain the spliced ​​mapping file and store it;

[0012] Step S6: Read the operation data based on the splicing mapping file.

[0013] Furthermore, the step S1 is specifically as follows:

[0014] The central computer of the energy storage power station collects the operating data of each device in real time, converts the data type of each operating data based on the data structure version, and sorts the operating data after the data type conversion based on the device type to complete the preprocessing of each operating data; the operating data carries at least device information and operating time.

[0015] Furthermore, the step S4 is specifically as follows:

[0016] The host computer creates a memory mapping file, cyclically retrieves the operation data from the message queue in sequence, periodically converts each of the read operation data into binary data, and stores the binary data in the memory mapping file.

[0017] Furthermore, in step S5, the file structure of the offline file is the same as the file structure of the memory-mapped file.

[0018] Furthermore, the step S6 is specifically as follows:

[0019] The host computer obtains a data read request carrying device information and running time, matches the data structure version based on the device information and running time, searches for the splicing mapping file, reversely converts the binary data stored in the splicing mapping file to obtain running data, converts the data type of the running data based on the data structure version, and feeds back the running data after the data type conversion as a reading result.

[0020] In a second aspect, the present invention provides an energy storage power station operation data management system, comprising the following modules:

[0021] An operation data acquisition module is used for the central computer of the energy storage power station to collect the operation data of each device and pre-process the operation data;

[0022] An operation data sending module is used for the intermediate computer to send each of the operation data to the upper computer in real time through MQTT;

[0023] An operation data storage module is used for the host computer to receive the operation data in real time and store it in a pre-created message queue;

[0024] A memory mapping file generation module, used for the host computer to fetch the operation data from the message queue and generate a memory mapping file based on the read operation data;

[0025] A splicing mapping file storage module is used for the upper computer to obtain the offline file automatically cached and generated by the running data after the MQTT is disconnected from the middle computer through FTP, splicing the offline file at the end of the memory mapping file, obtaining the splicing mapping file and storing it;

[0026] The operation data reading module is used to read the operation data based on the splicing mapping file.

[0027] Furthermore, the operation data collection module is specifically used for:

[0028] The central computer of the energy storage power station collects the operating data of each device in real time, converts the data type of each operating data based on the data structure version, and sorts the operating data after the data type conversion based on the device type to complete the preprocessing of each operating data; the operating data carries at least device information and operating time.

[0029] Furthermore, the memory mapping file generation module is specifically used for:

[0030] The host computer creates a memory mapping file, cyclically retrieves the operation data from the message queue in sequence, periodically converts each of the read operation data into binary data, and stores the binary data in the memory mapping file.

[0031] Furthermore, in the splicing mapping file storage module, the file structure of the offline file is the same as the file structure of the memory mapping file.

[0032] Furthermore, the operation data reading module is specifically used for:

[0033] The host computer obtains a data read request carrying device information and running time, matches the data structure version based on the device information and running time, searches for the splicing mapping file, reversely converts the binary data stored in the splicing mapping file to obtain running data, converts the data type of the running data based on the data structure version, and feeds back the running data after the data type conversion as a reading result.

[0034] The advantages of the present invention are:

[0035] The central computer of the energy storage power station collects the operating data of each device, pre-processes each operating data, and sends each operating data to the upper computer in real time through MQTT; then the upper computer receives each operating data in real time and stores it in a pre-created message queue, takes out the operating data from the message queue, generates a memory mapping file based on the read operating data, obtains the offline file automatically cached by the operating data after MQTT is disconnected from the central computer through FTP, splices the offline file at the end of the memory mapping file to obtain the spliced ​​mapping file and stores it, and finally reads the operating data based on the spliced ​​mapping file; due to the pre-processing of the operating data, based on The data structure version converts the data type of each operating data, and sorts the operating data after data type conversion based on the device type, that is, the complete data is adjusted to data with a fixed order and unified data type to make the transmission simpler and more efficient. The combination of MQTT and message queues can ensure the stability of transmission; after monitoring the disconnection of MQTT, the offline cache of the operating data is automatically triggered, and the cached offline files are obtained through FTP to ensure the integrity of the operating data. The use of binary storage memory-mapped files can effectively improve the disk storage efficiency, which ultimately greatly improves the reliability and access efficiency of the energy storage power station's operating data storage. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The present invention will be further described below in conjunction with embodiments with reference to the accompanying drawings.

[0037] Figure 1 It is a flow chart of a method for managing operating data of an energy storage power station according to the present invention.

[0038] Figure 2 It is a structural schematic diagram of an energy storage power station operation data management system of the present invention. DETAILED DESCRIPTION

[0039] The technical solution in the embodiments of the present application has the following overall idea: data types of various operating data are converted through data structure versions, and the operating data after data type conversion are sorted based on device types, that is, the complete data is adjusted to data with a fixed order and uniform data type, so that the transmission is simpler and more efficient. The stability of the transmission can be guaranteed by combining MQTT and message queues. After monitoring the disconnection of MQTT, the offline cache of the operating data is automatically triggered, and the cached offline files are obtained through FTP to ensure the integrity of the operating data. The memory-mapped files with binary storage can effectively improve the disk storage efficiency, thereby improving the reliability and access efficiency of the operating data storage of the energy storage power station.

[0040] Please refer to Figure 1 to Figure 2 As shown, a preferred embodiment of a method for managing operation data of an energy storage power station of the present invention comprises the following steps:

[0041] Step S1, the central computer of the energy storage power station collects the operating data of each device and pre-processes the operating data;

[0042] Step S2, the intermediate computer sends the operation data to the upper computer in real time through MQTT;

[0043] Step S3: The host computer receives the operation data in real time and stores it in a pre-created message queue;

[0044] Step S4, the host computer takes out the operation data from the message queue, and generates a memory mapping file based on the read operation data; after taking out the operation data from the message queue, the message queue deletes the corresponding operation data to release the occupied storage space;

[0045] Step S5, the upper computer obtains the offline file automatically cached and generated by the operation data after the MQTT is disconnected from the intermediate computer through FTP, and splices the offline file at the end of the memory mapping file to obtain the spliced ​​mapping file and store it;

[0046] Step S6: Read the operation data based on the splicing mapping file.

[0047] The present invention combines MQTT, message queue, FTP and memory file mapping, uses MQTT and message queue to store operation data, ensures the integrity of operation data storage, and converts the operation data into the same data structure version, and saves it into a memory mapping file according to certain rules.

[0048] The step S1 is specifically as follows:

[0049] The central computer of the energy storage power station collects the operating data of each device in real time, converts the data type of each operating data based on the data structure version, and sorts the operating data after the data type conversion based on the device type to complete the preprocessing of each operating data; the operating data carries at least device information and operating time.

[0050] The step S4 is specifically as follows:

[0051] The host computer creates a memory mapping file, sequentially retrieves the operation data from the message queue in a loop, periodically converts the read operation data into binary data and stores it in the memory mapping file. In specific implementation, the corresponding memory mapping file can be generated by hour and device information group.

[0052] In step S5, the file structure of the offline file is the same as the file structure of the memory-mapped file.

[0053] The step S6 is specifically as follows:

[0054] The host computer obtains a data read request carrying device information and running time, matches the data structure version based on the device information and running time, searches for the splicing mapping file, reversely converts the binary data stored in the splicing mapping file to obtain running data, converts the data type of the running data based on the data structure version, and feeds back the running data after the data type conversion as a reading result.

[0055] A preferred embodiment of an energy storage power station operation data management system of the present invention includes the following modules:

[0056] An operation data acquisition module is used for the central computer of the energy storage power station to collect the operation data of each device and pre-process the operation data;

[0057] An operation data sending module is used for the intermediate computer to send each of the operation data to the upper computer in real time through MQTT;

[0058] An operation data storage module is used for the host computer to receive the operation data in real time and store it in a pre-created message queue;

[0059] A memory mapping file generation module, used for the host computer to take out the operation data from the message queue, and generate a memory mapping file based on the read operation data; after taking out the operation data from the message queue, the message queue deletes the corresponding operation data to release the occupied storage space;

[0060] A splicing mapping file storage module is used for the upper computer to obtain the offline file automatically cached and generated by the running data after the MQTT is disconnected from the middle computer through FTP, splicing the offline file at the end of the memory mapping file, obtaining the splicing mapping file and storing it;

[0061] The operation data reading module is used to read the operation data based on the splicing mapping file.

[0062] The present invention combines MQTT, message queue, FTP and memory file mapping, uses MQTT and message queue to store operation data, ensures the integrity of operation data storage, and converts the operation data into the same data structure version, and saves it into a memory mapping file according to certain rules.

[0063] The operation data acquisition module is specifically used for:

[0064] The central computer of the energy storage power station collects the operating data of each device in real time, converts the data type of each operating data based on the data structure version, and sorts the operating data after the data type conversion based on the device type to complete the preprocessing of each operating data; the operating data carries at least device information and operating time.

[0065] The memory mapping file generation module is specifically used for:

[0066] The host computer creates a memory mapping file, sequentially retrieves the operation data from the message queue in a loop, periodically converts the read operation data into binary data and stores it in the memory mapping file. In specific implementation, the corresponding memory mapping file can be generated by hour and device information group.

[0067] In the splicing mapping file storage module, the file structure of the offline file is the same as the file structure of the memory mapping file.

[0068] The operation data reading module is specifically used for:

[0069] The host computer obtains a data read request carrying device information and running time, matches the data structure version based on the device information and running time, searches for the splicing mapping file, reversely converts the binary data stored in the splicing mapping file to obtain running data, converts the data type of the running data based on the data structure version, and feeds back the running data after the data type conversion as a reading result.

[0070] In summary, the advantages of the present invention are:

[0071] The central computer of the energy storage power station collects the operating data of each device, pre-processes each operating data, and sends each operating data to the upper computer in real time through MQTT; then the upper computer receives each operating data in real time and stores it in a pre-created message queue, takes out the operating data from the message queue, generates a memory mapping file based on the read operating data, obtains the offline file automatically cached by the operating data after MQTT is disconnected from the central computer through FTP, splices the offline file at the end of the memory mapping file to obtain the spliced ​​mapping file and stores it, and finally reads the operating data based on the spliced ​​mapping file; due to the pre-processing of the operating data, based on The data structure version converts the data type of each operating data, and sorts the operating data after data type conversion based on the device type, that is, the complete data is adjusted to data with a fixed order and unified data type to make the transmission simpler and more efficient. The combination of MQTT and message queues can ensure the stability of transmission; after monitoring the disconnection of MQTT, the offline cache of the operating data is automatically triggered, and the cached offline files are obtained through FTP to ensure the integrity of the operating data. The use of binary storage memory-mapped files can effectively improve the disk storage efficiency, which ultimately greatly improves the reliability and access efficiency of the energy storage power station's operating data storage.

[0072] Although the specific implementation modes of the present invention are described above, those skilled in the art should understand that the specific implementation modes described are only illustrative and are not intended to limit the scope of the present invention. Equivalent modifications and changes made by those skilled in the art in accordance with the spirit of the present invention should be included in the scope of protection of the claims of the present invention.

Claims

1. A method for managing operation data of an energy storage power station, characterized in that: The steps include: Step S1, the central computer of the energy storage power station collects the operating data of each device and pre-processes the operating data; Step S2, the intermediate computer sends the operation data to the upper computer in real time through MQTT; Step S3: The host computer receives the operation data in real time and stores it in a pre-created message queue; Step S4: The host computer retrieves the operation data from the message queue and generates a memory mapping file based on the read operation data; Step S5, the upper computer obtains the offline file automatically cached and generated by the operation data after the MQTT is disconnected from the intermediate computer through FTP, and splices the offline file at the end of the memory mapping file to obtain the spliced ​​mapping file and store it; Step S6: Read the operation data based on the splicing mapping file.

2. A method for managing operation data of an energy storage power station according to claim 1, characterized in that: The step S1 is specifically as follows: The central computer of the energy storage power station collects the operating data of each device in real time, converts the data type of each operating data based on the data structure version, and sorts the operating data after the data type conversion based on the device type to complete the preprocessing of each operating data; the operating data carries at least device information and operating time.

3. A method for managing operation data of an energy storage power station according to claim 1, characterized in that: The step S4 is specifically as follows: The host computer creates a memory mapping file, cyclically retrieves the operation data from the message queue in sequence, periodically converts each of the read operation data into binary data, and stores the binary data in the memory mapping file.

4. The method for managing operation data of an energy storage power station according to claim 1, characterized in that: In step S5, the file structure of the offline file is the same as the file structure of the memory-mapped file.

5. The method for managing operation data of an energy storage power station according to claim 1, characterized in that: The step S6 is specifically as follows: The host computer obtains a data read request carrying device information and running time, matches the data structure version based on the device information and running time, searches for the splicing mapping file, reversely converts the binary data stored in the splicing mapping file to obtain running data, converts the data type of the running data based on the data structure version, and feeds back the running data after the data type conversion as a reading result.

6. An energy storage power station operation data management system, characterized by: Includes the following modules: An operation data acquisition module is used for the central computer of the energy storage power station to collect the operation data of each device and pre-process the operation data; An operation data sending module is used for the intermediate computer to send each of the operation data to the upper computer in real time through MQTT; An operation data storage module is used for the host computer to receive the operation data in real time and store it in a pre-created message queue; A memory mapping file generation module, used for the host computer to fetch the operation data from the message queue and generate a memory mapping file based on the read operation data; A splicing mapping file storage module is used for the upper computer to obtain the offline file automatically cached and generated by the running data after the MQTT is disconnected from the middle computer through FTP, splicing the offline file at the end of the memory mapping file, obtaining the splicing mapping file and storing it; The operation data reading module is used to read the operation data based on the splicing mapping file.

7. An energy storage power station operation data management system as claimed in claim 6, characterized in that: The operation data acquisition module is specifically used for: The central computer of the energy storage power station collects the operating data of each device in real time, converts the data type of each operating data based on the data structure version, and sorts the operating data after the data type conversion based on the device type to complete the preprocessing of each operating data; the operating data carries at least device information and operating time.

8. The energy storage power station operation data management system according to claim 6, characterized in that: The memory mapping file generation module is specifically used for: The host computer creates a memory mapping file, cyclically retrieves the operation data from the message queue in sequence, periodically converts each of the read operation data into binary data, and stores the binary data in the memory mapping file.

9. The energy storage power station operation data management system according to claim 6, characterized in that: In the splicing mapping file storage module, the file structure of the offline file is the same as the file structure of the memory mapping file.

10. The energy storage power station operation data management system according to claim 6, characterized in that: The operation data reading module is specifically used for: The host computer obtains a data read request carrying device information and running time, matches the data structure version based on the device information and running time, searches for the splicing mapping file, reversely converts the binary data stored in the splicing mapping file to obtain running data, converts the data type of the running data based on the data structure version, and feeds back the running data after the data type conversion as a reading result.

Images