A system and method for processing electric power data files

Abstract

The present invention provides a processing system and method for power data files, the processing system comprising: a load control server and a parsing and calculating server; when receiving power data files sent by multiple acquisition terminals, the load control server distributes the power data files to the parsing and calculating server according to a preset load balancing strategy, so that the parsing and calculating server parses and processes the power data files and stores the processing results to a specified location according to preset conditions; wherein the load control server periodically adjusts the number of parsing service instances in operation in the parsing and calculating server according to the load value of the parsing and calculating server. The power data files are flexibly distributed through the load balancing strategy, and the number of parsing service instances is flexibly adjusted, so as to realize efficient processing of the power data files.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a system and method for processing power data files. Background Art

[0002] Due to business needs, it is necessary to receive and process multiple power data files collected by power data acquisition devices. However, on the one hand, the number of power data acquisition devices may be as high as tens of thousands or more, and on the other hand, the acquisition frequency of each power data acquisition device may be as high as once every tens of microseconds and the collected multiple data are packaged into a file (each file may contain tens of thousands of lines of data); therefore, the above two factors will lead to low efficiency in processing power data files. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a system and method for processing a power data file to solve the problem of low efficiency in processing a power data file.

[0004] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0005] A first aspect of an embodiment of the present invention discloses a system for processing power data files, the system comprising at least: a load control server and a plurality of analytical calculation servers;

[0006] The load control server is used to receive power data files sent by multiple acquisition terminals, and distribute the power data files to the analysis and calculation server according to a preset load balancing strategy, wherein the load control server is also used to: periodically adjust the number of analysis service instances in operation in the analysis and calculation server according to the load value of the analysis and calculation server;

[0007] The analysis and calculation server is used to, upon receiving the power data file, use the analysis service instance in operation to parse the power data file to obtain a processing result, and store the processing result to a designated location according to preset conditions.

[0008] Preferably, the load control server that periodically adjusts the number of resolution service instances in operation in the resolution computing server according to the load value of the resolution computing server is specifically used to:

[0009] Periodically obtaining a first number ratio of the resolution computing servers whose load values ​​are greater than a first threshold, and when the first number ratio is not less than a first preset ratio, starting a new resolution service instance in any of the resolution computing servers until the load values ​​of all the resolution computing servers are no greater than a second threshold;

[0010] A second number ratio of the analysis and computing servers whose load values ​​are less than a third threshold is periodically obtained; when the second number ratio is not less than a second preset ratio, analysis service instances in the analysis and computing servers whose load values ​​are less than the third threshold are stopped one by one until the load value rises to a preset load range.

[0011] Preferably, the processing result includes multiple pieces of data;

[0012] The analytical calculation server is used to store the processing results to a specified location according to preset conditions, specifically for:

[0013] The data in the processing results that meet different preset conditions are stored in a cache, a message queue, a time series database, and a relational database respectively.

[0014] Preferably, the system further comprises: an application server;

[0015] The application server is used to read the data to be displayed from the time series database and / or the relational database, and display the data to be displayed.

[0016] Preferably, the system further comprises: a time synchronization server;

[0017] The timing server is used to obtain time information from the Beidou system or GPS, and send the obtained time information to the load control server, the analysis and calculation server and the application server for time calibration.

[0018] Preferably, the load control server is also used for:

[0019] After distributing the power data file to the analysis and calculation servers, when it is detected that any of the analysis service instances in the analysis and calculation servers receiving the power data file fails, the power data file sent to the failed analysis service instance is forwarded to other analysis service instances.

[0020] A second aspect of an embodiment of the present invention discloses a method for processing a power data file, the method comprising:

[0021] Receive power data files sent by multiple acquisition terminals;

[0022] Distribute the power data file to the parsing and computing server according to a preset load balancing strategy, so that the parsing and computing server uses the parsing service instance in operation to parse and process the power data file and store the processing result to a designated location according to preset conditions;

[0023] Wherein, the number of the resolution service instances in operation in the resolution computing server is adjusted periodically according to the load value of the resolution computing server.

[0024] Preferably, the periodically adjusting the number of running resolution service instances in the resolution computing server according to the load value of the resolution computing server includes:

[0025] Periodically obtaining a first quantity ratio of the analysis and calculation servers having a load value greater than a first threshold;

[0026] When the first number ratio is not less than a first preset ratio, starting a new resolution service instance in any of the resolution computing servers until the load values ​​of all the resolution computing servers are not greater than a second threshold;

[0027] Periodically obtaining a second quantity ratio of the analysis and calculation servers whose load values ​​are less than a third threshold;

[0028] When the second quantity ratio is not less than a second preset ratio, the resolution service instances in the resolution computing servers whose load values ​​are less than the third threshold are stopped one by one until the load values ​​rise to a preset load interval.

[0029] Preferably, the method further comprises:

[0030] The time information sent by the time synchronization server is received and time calibration is performed according to the time synchronization server, wherein the time information is obtained by the time synchronization server from the Beidou system or GPS.

[0031] Preferably, after distributing the power data file to the analysis and calculation server according to a preset load balancing strategy, the method further includes:

[0032] When it is detected that any of the resolution service instances in the resolution calculation server receiving the power data file fails, the power data file sent to the failed resolution service instance is forwarded to other resolution service instances.

[0033] Based on the above-mentioned embodiment of the present invention, a processing system and method for power data files are provided. The processing system includes: a load control server and a parsing and computing server; when the load control server receives power data files sent by multiple acquisition terminals, it distributes the power data files to the parsing and computing server according to a preset load balancing strategy, so that the parsing and computing server parses and processes the power data files and stores the processing results to a specified location according to preset conditions; wherein the load control server adjusts the number of parsing service instances in operation in the parsing and computing server according to the load value of the parsing and computing server. The power data files are flexibly distributed through the load balancing strategy, and the number of parsing service instances is flexibly adjusted, so as to realize efficient processing of power data files. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0035] Figure 1 A structural block diagram of a power data file processing system provided by an embodiment of the present invention;

[0036] Figure 2 Another structural block diagram of a power data file processing system provided by an embodiment of the present invention;

[0037] Figure 3 Another structural block diagram of a power data file processing system provided by an embodiment of the present invention;

[0038] Figure 4 A flowchart of a method for processing a power data file provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0040] In this application, the terms "comprises", "comprising" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element.

[0041] From the background technology, we can see that, on the one hand, due to the large number of power data acquisition devices, on the other hand, the acquisition frequency of each power data acquisition device may be as high as once every tens of microseconds and the multiple collected data are packaged into a file (each file may contain tens of thousands of lines of data). These two aspects lead to low efficiency in processing power data files.

[0042] Therefore, an embodiment of the present invention provides a system and method for processing power data files. When receiving power data files sent by multiple acquisition terminals, the power data files are distributed to the parsing and computing servers according to a preset load balancing strategy, so that the parsing and computing servers parse and process the power data files and store the processing results to a designated location according to preset conditions; wherein the load control server periodically adjusts the number of parsing service instances in operation in the parsing and computing servers according to the load values ​​of each parsing and computing server, thereby realizing dynamic expansion of the parsing and computing servers and improving the efficiency of processing power data files.

[0043] It should be noted that the power data file processing system provided in the embodiment of the present invention can be used to receive and parse power data files sent by multiple acquisition terminals, and the content stored in the power data files is the voltage and current data of a certain device over a certain period of time.

[0044] For example, it can be used to receive, parse and process TDMS (Technical Data Management Streaming) files.

[0045] See also Figure 1 , shows a structural block diagram of a power data file processing system provided by an embodiment of the present invention, the processing system includes: a load control server 100 and multiple analysis and calculation servers 200.

[0046] It is understandable that after the multiple acquisition terminals generate the power data files, they send the power data files to the load control server 100 according to a specified protocol (eg, HTTP protocol) and a specified frequency (eg, once every 2 seconds).

[0047] The load control server 100 is used to receive power data files sent by multiple acquisition terminals and distribute the power data files to the analysis and calculation server 200 according to a preset load balancing strategy, wherein the load control server 100 is also used to periodically adjust the number of analysis service instances in operation in the analysis and calculation server 200 according to the load value of the analysis and calculation server 200.

[0048] In some embodiments, the load control server 100 distributes the power data file to the analysis and calculation server 200 in a balanced manner according to the load balancing strategy, for example: preferentially distributing the power data file to the analysis and calculation server 200 with a lower load value; the specific content of the load balancing strategy is not limited here.

[0049] In some embodiments, the load control server 100 includes a service management service, which adjusts the number of running resolution service instances in the resolution computing server 200 through the service management service; specifically, the service management service adjusts the number of running resolution service instances in the resolution computing server 200 based on the load value of the resolution computing server 200.

[0050] It is understandable that the way to adjust the number of resolution service instances in operation in the resolution computing server 200 specifically includes two ways: starting and / or stopping the resolution service instance. Starting the resolution service instance is to start a new resolution service instance; stopping the resolution service instance is to stop the resolution service instance in operation.

[0051] It should be noted that when each resolution service instance is stopped, the stopped resolution service instance will be destroyed and cannot be started again.

[0052] The specific method of starting the parsing service instance is: periodically obtaining a first quantity ratio of the parsing computing servers 200 whose load values ​​are greater than a first threshold, wherein the first quantity ratio is: the ratio of the number of parsing computing servers 200 whose load values ​​are greater than the first threshold to all parsing computing servers 200; when the first quantity ratio is not less than the first preset ratio, starting a new parsing service instance in any parsing computing server 200, and the parsing service instance after starting is in a running state until the load values ​​of all parsing computing servers 200 are no greater than a second threshold.

[0053] For example, when the proportion of the number of parsing computing servers 200 with load values ​​greater than 70% is greater than 40%, a new parsing service instance in any parsing computing server 200 is started until the load values ​​of all parsing computing servers 200 are no greater than the preset second threshold.

[0054] It should be noted that when the service management service starts a parsing service instance in any parsing computing server 200, it can start the parsing service instance by executing a command to start the parsing service instance, for example, by executing the command "java-jarxxx.jar" to start a new parsing service instance.

[0055] The specific method of stopping the parsing service instance is: periodically obtaining the second number ratio of the parsing computing servers 200 whose load values ​​are less than the third threshold, wherein the second number ratio is: the ratio of the number of the parsing computing servers 200 whose load values ​​are less than the third threshold to all the parsing computing servers 200; when the second number ratio is not less than the second preset ratio, the parsing service instances in the parsing computing servers 200 whose load values ​​are less than the third threshold are stopped one by one until the load value rises to the preset load range. Specifically, the preset load range can be set according to actual conditions, for example, the preset load range needs to be greater than or equal to the third threshold and less than the first threshold.

[0056] For example, when the second number ratio of the parsing computing servers 200 with load values ​​less than 20% is greater than 50%, the parsing service instances in the parsing computing servers 200 with load values ​​less than 20% are stopped one by one until the load value rises to 40%.

[0057] The above is the relevant instructions on adjusting the number of running resolution service instances in the resolution computing server 200 according to the load value of the resolution computing server 200. Similarly, the number of running resolution service instances in the resolution computing server 200 can also be adjusted according to the number of collection terminals. See the following instructions for details.

[0058] It is understandable that an increase or decrease in the number of acquisition terminals will directly affect the number of power data files. When the number of power data files increases, that is, the number of acquisition terminals increases, more parsing service instances in the parsing and computing server 200 are needed to parse and process the power data files. When the number of power data files decreases, that is, the number of acquisition terminals decreases, the number of parsing service instances in the parsing and computing server 200 can be reduced, and the resources of the parsing and computing server 200 can be reasonably allocated to achieve dynamic expansion of the parsing and computing server 200.

[0059] The method of adjusting the number of running parsing service instances in the parsing computing server 200 according to the number of collection terminals is as follows: the service management service is used to start a new parsing service instance in any parsing computing server 200 when the number of collection terminals increases; the service management service is also used to stop the number of parsing service instances in some parsing computing servers 200 one by one when the number of collection terminals decreases.

[0060] In some embodiments, the load control server 100 includes a load balancing service, which ensures the distribution of power data files through the load balancing service, and ensures that each power data file can be parsed and processed. The specific method of ensuring the distribution of power data files is as follows: after distributing the power data file to the parsing server, when it is detected that any parsing service instance in the parsing calculation server 200 receiving the power data file fails, the power data file sent to the parsing service instance with the failure is forwarded to other parsing service instances. It is ensured that each power data file can be parsed and processed, thereby ensuring the integrity of the data.

[0061] The parsing and calculating server 200 is used to parse the power data file using the parsing service instance in operation when receiving the power data file to obtain a processing result, and store the processing result to a designated location according to preset conditions.

[0062] It should be noted that each analysis and calculation server 200 includes a plurality of analysis service instances, each instance is distinguished according to a different port number, and the analysis service instance includes an analysis module written in Java language, and the analysis module is used to parse the power data file.

[0063] It is understandable that the analysis and calculation server 200 can support multiple communication protocols and analysis protocols, and can also parse TDMS files and comtrade format (a format for exchanging transient data in power systems) files.

[0064] In some embodiments, the power data file is a binary file, and the data consists of multiple segments, each of which contains index information, metadata information, and content data. When parsing the power data file, the parsing and computing service traverses each segment and obtains the content data in the segment based on the index data and metadata in each segment; the content data may include data such as sampling rate, GPS status, sampling time, voltage, and current. In other words, the processing result obtained by parsing the power data file includes multiple data, and the parsing and computing server 200 stores the data in the processing result that meets different preset conditions in the cache, message queue, time series database, and relational database respectively.

[0065] Instructions for storing the data in the processing result into the cache:

[0066] The analysis and calculation server 200 stores the frequently used data in the processing results and the data whose values ​​are basically unchanged in the cache of the analysis and calculation server 200, and stores the latest data (for example, the data in the last 2 seconds) in the cache of the analysis and calculation server 200. It is understandable that the data stored in the cache can be used for analysis and calculation or for real-time display on the front-end page.

[0067] Instructions for storing the data in the processing result into the message queue:

[0068] The parsing and computing server 200 stores the special events (such as voltage sag events) analyzed when parsing the power data file in the message queue of the parsing and computing server 200. It is understandable that, for example, if an application service subscribes to the message queue, when there is a newly stored special event in the message queue, the application service pushes the newly stored special event to the display page for display.

[0069] Instructions for storing the data in the processing results into a time series database:

[0070] The analysis and calculation server 200 stores the data generated more frequently in the processing results into the time series database; it should be noted that the data generated more frequently specifically refers to: the data in the power data file generated more frequently, for example: a TDMS file is generated every 2 seconds and each TDMS file contains a large amount of voltage and current data. At this time, the data obtained by parsing the TDMS file can be stored in the time series database.

[0071] Instructions for storing the data in the processing results into a relational database:

[0072] The analysis and calculation server 200 divides the time period into minutes based on the processing results obtained after the analysis process, and calculates the maximum value of voltage, the minimum value of voltage, the maximum value of current, the minimum value of current, the average value of voltage, and the average value of current within the time period (such as every minute). The calculated data is summarized and stored in the relational database.

[0073] In the embodiment of the present invention, when receiving power data files sent by multiple acquisition terminals, the load balancing service forwards the multiple power data files to multiple parsing and computing servers, so that the parsing and computing servers parse and process the power data files. The service management service periodically adjusts the number of parsing service instances in operation in the parsing and computing servers according to the load values ​​of the parsing and computing servers, thereby ensuring the dynamic expansion of the parsing and computing servers and improving the parsing efficiency of the power data files.

[0074] Preferably, combined Figure 1 For the contents shown, see Figure 2 The processing system also includes: an application server 300, a time synchronization server 400, and a database server 500.

[0075] The application server 300 is used to read the data to be displayed from the time series database and / or the relational database, and display the data to be displayed.

[0076] It can be understood that the data to be displayed is: any data in the processing results stored in the time series database and the relational database mentioned above; the data to be displayed can be determined according to the business requirements of the application server 300, such as voltage data, current data, etc.

[0077] The timing server 400 is used to obtain time information from the Beidou system or GPS through wireless communication, and send the obtained time information to the load control server 100, the analysis and calculation server 200 and the application server 300 for time calibration.

[0078] It is understandable that when the load control server 100, the analysis and calculation server 200 and the application server 300 receive the time information sent by the time synchronization server 400, they are calibrated according to the time information, that is, the load control server 100, the analysis and calculation server 200 and the application server 300 adjust the internal time to the time in the received time information.

[0079] The database server 500 includes a time series database and a relational database, and is used to store processing results that meet preset conditions.

[0080] In the embodiment of the present invention, a timing server is used to achieve accurate timing of a load control server, an analytical computing server and an application server. At the same time, the application server is used to obtain data to be displayed from a database for display, so as to facilitate viewing of data.

[0081] To better explain the above embodiments of the present invention Figure 1 and Figure 2 The processing system of the power data files provided is shown in Figure 3 , showing another structural block diagram of the processing system.

[0082] The system includes a time synchronization server 400 , a load control server 100 , an analytical calculation server 200 , an application server 300 and a database server 500 .

[0083] The timing server 400 is used to obtain time information from the Beidou system or GPS outside the system, and send the obtained time information to the load control server 100, the analysis and calculation server 200 and the application server 300 of the system for time calibration.

[0084] The load control server 100 is used to receive power data files (such as TDMS binary file streams or byte streams encapsulated by specific protocols) sent by power data acquisition terminals outside the system through 5G communication; the load control server 100 includes load balancing services and service management services.

[0085] The load balancing service is used to receive the power data file and distribute the power data file to multiple analysis and calculation servers 200 according to a preset load balancing strategy.

[0086] The service management service is used to periodically adjust the number of running parsing service instances in the parsing and computing server 200 according to the number of collection terminals and the load value of the parsing and computing server 200 .

[0087] The parsing and calculating server 200 is used to parse and process the power data file, obtain the processing results, and store the processing results in the cache, message queue, time series database and relational database according to preset conditions.

[0088] In some embodiments, the analysis and calculation server 200 may also read data from a time series database and / or a relational database.

[0089] The application server 300 is used to read the data to be displayed from the time series database and / or relational database in the database server 500 and display the data to be displayed.

[0090] The database server 500 includes a time series database and a relational database, and is used to store processing results that meet preset conditions.

[0091] It should be noted that for the detailed working principles of each part of the system, see Figure 1 and Figure 2 The contents in will not be repeated here.

[0092] Corresponding to the power data file processing system provided by the above embodiment of the present invention, see Figure 4 The embodiment of the present invention further provides a flowchart of a method for processing a power data file. The processing method is applicable to the power data file processing system in the above embodiment of the present invention. The processing method includes:

[0093] Step S401: receiving power data files sent by multiple acquisition terminals.

[0094] In the specific implementation of step S401, the power data files generated and sent by multiple acquisition terminals are received through a preset protocol (eg, http protocol) and a preset frequency (eg, every 2 seconds).

[0095] Step S402: Distribute the power data file to the analysis and calculation server according to the preset load balancing strategy.

[0096] It is understandable that the preset load balancing strategy may be to distribute the power data files to the analysis and calculation servers in a balanced manner according to the load values ​​of the analysis and calculation servers.

[0097] It should be noted that when a failure is detected in any parsing service instance in the parsing computing server receiving the power data file, the power data file sent to the failed parsing service instance will be forwarded to other parsing service instances to ensure that each power data file can be parsed and processed.

[0098] In some specific embodiments, the number of running resolution service instances in the resolution computing server is adjusted periodically according to the load value of the resolution computing server.

[0099] It should be noted that a first number ratio of analysis and computing servers whose load values ​​are greater than a first threshold is periodically obtained; when the first number ratio is not less than a first preset ratio, a new analysis service instance is started in any analysis and computing server until the load values ​​of all analysis and computing servers are no greater than a second threshold.

[0100] Periodically obtain a second number ratio of analysis computing servers whose load values ​​are less than a third threshold; when the second number ratio is not less than a second preset ratio, stop the analysis service instances in the analysis computing servers whose load values ​​are less than the third threshold one by one until the load value rises to a preset load range.

[0101] In some specific embodiments, when the number of acquisition terminals increases, a new parsing service instance in the parsing computing server can also be started; when the number of acquisition terminals decreases, the parsing service instances in the parsing computing server with load values ​​less than the third threshold can also be stopped one by one to achieve dynamic expansion of the resources of the parsing computing server and improve the efficiency of processing power data files.

[0102] It should be noted that when the time information sent by the time synchronization server is received, time calibration is performed according to the time information, which is obtained by the time synchronization server from the Beidou system or GPS.

[0103] In an embodiment of the present invention, multiple received power data files are distributed to multiple parsing and computing servers according to a preset load balancing strategy, so that the parsing and computing servers parse and process the power data files, obtain processing results, and store the processing results in a cache, a message queue, a time series database, and a relational database according to preset conditions. Among them, the number of parsing service instances in operation in the parsing and computing servers is periodically adjusted according to the load value of the parsing and computing servers, and the resources of the parsing and computing servers are flexibly adjusted. The processing and parsing efficiency of power data files is improved.

[0104] In summary, the embodiments of the present invention provide a processing system and method for power data files. By using a time synchronization server, accurate time calibration can be achieved for the load control server, application server, and parsing and computing server. By using the application server, data to be displayed can be obtained from the time series database and / or relational database according to business requirements and displayed. The load control server receives power data files and evenly distributes the power data files to the parsing and computing server according to a preset load balancing strategy, and also dynamically adjusts the number of parsing service instances in the running state in the parsing and computing server according to the load value of the parsing and computing server. The parsing service instances in the parsing and computing server parse and process the power data files, and store the processed data at a specified location according to preset conditions. The efficiency of parsing and processing a large number of power data files sent by multiple acquisition terminals is improved.

[0105] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for a system or system embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For the relevant parts, reference can be made to the description of the method embodiment. The systems and system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative work.

[0106] Those skilled in the art can further realize that the units and algorithm steps of each example described in combination with the embodiments disclosed in this article can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been generally described according to their functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Skilled professionals can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0107] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A system for processing power data files, It is characterized in that The system at least comprises: a load control server and a plurality of analytical computing servers; The load control server is used to receive power data files sent by multiple acquisition terminals, and distribute the power data files to the analysis and calculation server according to a preset load balancing strategy, wherein the load control server is also used to: periodically adjust the number of analysis service instances in operation in the analysis and calculation server according to the load value of the analysis and calculation server; The analysis and calculation server is used to, when receiving the power data file, use the analysis service instance in operation to analyze the power data file to obtain a processing result, and store the processing result in a designated location according to a preset condition; The load control server that periodically adjusts the number of resolution service instances in operation in the resolution computing server according to the load value of the resolution computing server is specifically used to: Periodically obtaining a first number ratio of the resolution computing servers whose load values ​​are greater than a first threshold, and when the first number ratio is not less than a first preset ratio, starting a new resolution service instance in any of the resolution computing servers until the load values ​​of all the resolution computing servers are no greater than a second threshold; A second number ratio of the analysis and computing servers whose load values ​​are less than a third threshold is periodically obtained; when the second number ratio is not less than a second preset ratio, analysis service instances in the analysis and computing servers whose load values ​​are less than the third threshold are stopped one by one until the load value rises to a preset load range.

2. The system according to claim 1, It is characterized in that The processing result includes multiple pieces of data; The analytical calculation server is used to store the processing results to a specified location according to preset conditions, specifically for: The data in the processing results that meet different preset conditions are stored in a cache, a message queue, a time series database, and a relational database respectively.

3. The system according to claim 2, It is characterized in that The system also includes: an application server; The application server is used to read the data to be displayed from the time series database and / or the relational database, and display the data to be displayed.

4. A system according to any one of claims 1 to 3, It is characterized in that The system also includes: a time synchronization server; The timing server is used to obtain time information from the Beidou system or GPS, and send the obtained time information to the load control server, the analysis and calculation server and the application server respectively for time calibration.

5. The system according to claim 1, It is characterized in that The load control server is also used for: After distributing the power data file to the analysis and calculation servers, when it is detected that any of the analysis service instances in the analysis and calculation servers receiving the power data file fails, the power data file sent to the failed analysis service instance is forwarded to other analysis service instances.

6. A method for processing power data files, characterized in that, the method includes: Receiving power data files sent by multiple acquisition terminals; Distributing the power data files to parsing and computing servers according to a preset load balancing strategy, so that the parsing and computing servers use the parsing service instances in the running state to parse and process the power data files and store the processing results at a specified location according to preset conditions; wherein, periodically adjusting the number of parsing service instances in the running state in the parsing and computing servers according to the load values of the parsing and computing servers; wherein, the periodically adjusting the number of parsing service instances in the running state in the parsing and computing servers according to the load values of the parsing and computing servers includes: Periodically obtaining the first quantity ratio of the parsing and computing servers with load values greater than a first threshold; When the first quantity ratio is not less than a first preset ratio, starting new parsing service instances in any of the parsing and computing servers until the load values of all the parsing and computing servers are not greater than a second threshold; Periodically obtaining the second quantity ratio of the parsing and computing servers with load values less than a third threshold; When the second quantity ratio is not less than a second preset ratio, stopping the parsing service instances in the parsing and computing servers with load values less than the third threshold one by one until the load values rise to a preset load range.

7. The method according to claim 6, characterized in that, the method further includes: Receiving time information sent by a time synchronization server and performing time calibration according to it, and the time information is obtained by the time synchronization server from the Beidou system or GPS.

8. The method according to claim 6, characterized in that, after distributing the power data files to parsing and computing servers according to a preset load balancing strategy, it further includes: When it is detected that any of the parsing service instances in the parsing and computing server receiving the power data file fails, forwarding the power data file sent to the failed parsing service instance to other parsing service instances.

Images