Data processing method and device, electronic equipment and storage medium

Abstract

Embodiments of the invention disclose a data processing method and apparatus, an electronic device and a storage medium. The method comprises the steps of obtaining to-be-analyzed data of each transformer area according to a preset time interval; for each transformer area, determining a type problem sub-table of each type of the to-be-analyzed data of the current transformer area based on each predetermined type sub-table; wherein the type problem sub-table comprises a heavy overload sub-table, a low voltage sub-table or a photovoltaic consumption imbalance sub-table; for each type of problem sub-table of the current transformer area, performing data quality inspection on the data of the current type of problem sub-table according to each type of predetermined rule table to obtain a table quality inspection result of the data of the current type of problem sub-table; and determining target data of the current type of problem sub-table based on the table quality inspection result, and displaying the target data to the user. The method can improve the working efficiency, reduce the waste of human resources, improve the accuracy of information data, and further shorten the solving period of the power supply quality problem of the transformer area.

Description

Technical Field

[0001] Embodiments of the present invention relate to the technical field of power data processing, and in particular to a data processing method, device, electronic device and storage medium. Background Art

[0002] The grass-roots power supply station is the front-line unit directly responsible for power supply and customer service in the power system. It is mainly responsible for the operation and maintenance of the power grid, power service and fault repair in a specific area. In the management of power supply quality issues, it is a key task for each power supply station to carry out "one substation, one analysis report document preparation" (conducting detailed analysis and evaluation of the power supply quality of each substation, and compiling corresponding report documents). Each substation has its own unique power supply situation and problems. By carrying out "one substation, one analysis report document preparation", the power supply quality of each substation can be analyzed and evaluated in detail, the existing problems can be found and corresponding solutions can be proposed.

[0003] In the current process of "preparing one analysis report document for each substation", most of the data collection, data processing and document editing are done manually by the grassroots staff of the power supply station. Since the data systems and operating data of each substation have different characteristics, the grassroots staff are faced with the difficulty of being familiar with each data system. This method increases the workload of the staff and is prone to errors. After the staff completes the report document corresponding to the "preparation of one analysis report document for each substation", the functional departments will repeatedly send the work documents back to the grassroots power supply station for revision and improvement, which greatly dampens the enthusiasm of the power supply station and reduces the work efficiency of the power supply station. Summary of the invention

[0004] The embodiments of the present invention provide a data processing method, device, electronic device and storage medium, which can automatically generate report documents for each substation under the responsibility of the power supply bureau, reduce waste of human resources, improve the accuracy of information data, improve the work efficiency of the power supply station, and further shorten the problem-solving cycle of power supply quality in the substation.

[0005] In a first aspect, an embodiment of the present invention provides a data processing method, the method comprising:

[0006] Obtain the data to be analyzed in each area according to the preset time interval;

[0007] For each substation, based on the predetermined sub-tables of each type, a sub-table of each type of problem of the data to be analyzed in the current substation is determined; wherein the sub-table of each type of problem includes a heavy overload sub-table, a low voltage sub-table or a photovoltaic absorption imbalance sub-table;

[0008] For each type of problem sub-table in the current station area, data quality inspection is performed on the data of the current type of problem sub-table according to each type of rule table determined in advance, and a table quality inspection result of the data of the current type of problem sub-table is obtained;

[0009] The target data of the current type problem sub-table is determined based on the table quality inspection result, and the target data is displayed to the user.

[0010] In a second aspect, an embodiment of the present invention provides a computer program product, including a computer program, wherein the computer program implements a data processing method as described in any one of the embodiments of the present invention when executed by a processor.

[0011] In a third aspect, an embodiment of the present invention provides a data processing device, applied to a centralized server, comprising:

[0012] A first determination module is used to determine, for each substation, each type of type problem subtable of the data to be analyzed in the current substation based on each pre-determined type subtable; wherein the type problem subtable includes a heavy overload subtable, a low voltage subtable or a photovoltaic absorption imbalance subtable;

[0013] The second determination module is used to perform data quality inspection on the data of the current type of problem sub-table according to the predetermined type of rule table for each type of problem sub-table in the current station area, and obtain the table quality inspection result of the data of the current type of problem sub-table;

[0014] A data display module is used to determine the target data of the current type problem sub-table based on the table quality inspection result, and display the target data to the user.

[0015] In a fourth aspect, an embodiment of the present invention further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a data processing method as described in any one of the embodiments of the present invention is implemented.

[0016] In a fifth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a data processing method as described in any one of the embodiments of the present invention.

[0017] In an embodiment of the present invention, the data to be analyzed of each substation is obtained at a preset time interval; for each substation, the type problem subtables of the data to be analyzed of the current substation are determined based on the predetermined types of subtables; wherein the type problem subtables include heavy overload subtables, low voltage subtables or photovoltaic absorption imbalance subtables; for the types of problem subtables of the current substation, data quality inspection is performed on the data of the current type problem subtable according to the predetermined types of rule tables, and the table quality inspection results of the data of the current type problem subtable are obtained; based on the table quality inspection results, the target data of the current type problem subtable is determined, and the target data is displayed to the user. That is, in an embodiment of the present invention, for different types of problem data, the predetermined types of subtables are used to automatically classify the data, and the predetermined types of rule tables are used to automatically inspect the data, which not only improves the efficiency of data processing, but also reduces the errors caused by human factors, and ensures the consistency of the quality inspection results. The present invention can improve work efficiency, reduce waste of human resources, improve the accuracy of information data, and further shorten the problem-solving cycle of power supply quality in the substation. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments are briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 A first flow chart of a data processing method provided by an embodiment of the present invention;

[0020] Figure 2 A second flow chart of a data processing method provided by an embodiment of the present invention;

[0021] Figure 3 A schematic diagram of the structure of a data processing device provided by an embodiment of the present invention;

[0022] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0023] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

[0024] Figure 1This is the first flow chart of a data processing method provided by an embodiment of the present invention. The method of the embodiment of the present invention can automatically generate report documents for each substation that the power supply bureau is responsible for, reduce waste of human resources, improve the accuracy of information data, improve the work efficiency of the power supply station, and further shorten the problem-solving cycle of power supply quality in the substation. The method can be executed by a data processing device provided by an embodiment of the present invention, and the device can be implemented in software and / or hardware. The following embodiments will be described by taking the device integrated in an electronic device as an example. The electronic device can be a computer device or a server. Reference Figure 1 , the method may specifically include the following steps:

[0025] Step 101: Obtain the data to be analyzed from each substation at a preset time interval.

[0026] Among them, the substation refers to the area under the responsibility of the power supply bureau and powered by a transformer. The preset time interval is predetermined based on the field data, and the preset time interval can be 0. The data to be analyzed includes the operation data generated by the substation during the preset time interval and the basic data of the substation. The operation data includes the load current, transformer capacity, voltage measurement value, photovoltaic power generation, load power consumption and absorption capacity of the substation. The basic data of the substation includes the geographical location, number of users and power equipment information.

[0027] In this solution, the data to be analyzed in each substation can be classified and stored in the general data platform in the form of Excel tables. For example, the substation load current and transformer capacity used to determine whether the substation is heavily overloaded are stored in a heavily overloaded Excel table. The photovoltaic power generation and load power consumption used to determine whether the substation has photovoltaic absorption imbalance are stored in a photovoltaic absorption imbalance Excel table. Each power supply bureau can search and download the tables corresponding to the data to be analyzed through the general data platform to obtain the data to be analyzed.

[0028] Step 102: for each substation, determine the type problem subtables of each type of data to be analyzed in the current substation based on the predetermined type subtables.

[0029] Among them, the type problem subtable includes a heavy overload subtable, a low voltage subtable or a photovoltaic absorption imbalance subtable. The type of data to be analyzed is a heavy overload type, a low voltage type or a photovoltaic absorption imbalance type. Each type of subtable is a table pre-established by each power supply bureau and meets the data format requirements of each power supply bureau. The type problem subtable is a table obtained by storing the data to be analyzed in each type of subtable according to the corresponding type. In this scheme, optionally, based on the predetermined subtables of each type, the type problem subtables of each type of data to be analyzed in the current substation are determined, including: performing keyword extraction on the data to be analyzed in the current substation according to the predetermined keywords of each type to obtain the data types of the data to be analyzed in the current substation; inputting the data to be analyzed of each data type into the corresponding subtables of each type to obtain the type problem subtables of each type of data to be analyzed in the current substation.

[0030] Among them, the keyword is used to indicate the type of each data to be analyzed. In an optional implementation, the general data platform stores the data to be analyzed in each substation in different Excel tables according to their types, and the table format of the table follows the data format of the general data platform. After the power supply bureau downloads each table from the general data platform, it can extract the keyword of the table from the table header, and determine the data type corresponding to the table according to its keyword. Exemplarily, the power supply bureau obtains 3 Excel tables of a certain substation from the data general platform, and the table headers of the tables are: the subtable of source data of the substation with heavy overload problem, the subtable of source data of the substation with low voltage problem, and the subtable of source data of photovoltaic absorption imbalance. The power supply bureau can obtain the keywords "heavy overload problem", "low voltage problem" and "photovoltaic absorption imbalance" according to its header. Further, according to the keywords, it is determined that the data type of the data to be divided in the substation includes heavy overload type, low voltage type or photovoltaic absorption imbalance type.

[0031] Specifically, the general data platform is used to aggregate the data of each substation of each power supply bureau, and the data format or table format required by each power supply bureau may be different. Therefore, after determining the data type corresponding to each data table of the data to be analyzed, the data tables to be analyzed can be batch-entered into the corresponding type sub-table according to their type, and the format of each data table is automatically converted to obtain the type problem sub-tables of each type that meet the format requirements of the power supply bureau.

[0032] In the above steps, keyword extraction can quickly locate the data types in the data to be analyzed, avoiding the tedious process of manual screening one by one, and improving the efficiency and accuracy of data processing. Storing different types of data in corresponding type subtables makes subsequent data quality inspection and analysis more convenient and efficient.

[0033] Step 103: for each type of problem sub-table in the current substation, perform data quality inspection on the data of the current type of problem sub-table according to each type of rule table determined in advance, and obtain the table quality inspection result of the current type of problem sub-table.

[0034] Among them, the type rule table is a data table that is pre-determined by the power supply bureau based on field big data and actual needs, including quality inspection rules for various types of data. The quality inspection rules in the type rule table can be pre-set formulas or conditional summation statements. According to the quality inspection rules, it can be determined whether the data meets specific standards or thresholds, thereby determining whether the data in each type of problem subtable is abnormal. The data in each type of problem subtable is input into the corresponding type rule table, and the data in the type problem subtable is calculated according to the rules in the type rule table, and whether each data is normal is determined based on the calculation results, thereby obtaining the table quality inspection results of each type of problem subtable.

[0035] In an optional implementation, after obtaining each type of problem sub-table of the current substation, a type rule table corresponding to each type of problem sub-table is determined in each type of rule table; the data name of each data in the type problem sub-table and the data name of each data in the current type rule table are extracted, and each data in the type problem sub-table with the same data name as that in the type rule table is determined as quality inspection data, and the quality inspection data is input into the type rule table to obtain a type quality inspection table corresponding to the type problem sub-table; quality inspection is performed on the corresponding quality inspection data in the type quality inspection table according to each quality inspection rule in the type rule table to obtain each quality inspection result for each quality inspection data; and the table quality inspection result of the type problem sub-table is determined according to all quality inspection results.

[0036] Step 104: Determine the target data of the current type of problem sub-table based on the table quality inspection result, and display the target data to the user.

[0037] Among them, the target data is determined according to the table quality inspection results, and can reflect the power supply quality of each substation. Specifically, the quality inspection rules of each substation are generally the same, but the requirements for power supply quality may be different in different substations or different power supply bureaus. For example, when the quality inspection rule is that when the load rate is greater than a, it is determined that the substation is severely overloaded. The power supply quality qualification standard of substation A is: if there are 2 severe overloads within a preset time interval, it is determined that substation A has a severe overload problem. The power supply quality qualification standard of substation B is: if there are 3 severe overloads within a preset time interval, it is determined that substation A has a severe overload problem.

[0038] In an optional implementation, after obtaining the table quality inspection results of the data of the type problem subtable, the table quality inspection results can be analyzed according to the pre-acquired rule requirement data to obtain the core result data of the current problem data table; the rule requirement data includes the requirements of each station or power supply bureau for power supply quality. Generate the substation operation data column of the current problem data table according to the core result data; extract the basic data of the current substation in the current problem data table, and generate the substation basic data column of the current problem data table according to the basic data; generate the target data table of the current problem data table according to the substation operation data column, the substation basic data column and the table quality inspection results; visualize the target data table to obtain the target data.

[0039] The technical solution of this embodiment obtains the data to be analyzed in each substation according to a preset time interval; for each substation, based on the predetermined types of subtables, the types of type problem subtables of the data to be analyzed in the current substation are determined; wherein the type problem subtables include heavy overload subtables, low voltage subtables or photovoltaic absorption imbalance subtables; for the types of problem subtables in the current substation, data quality inspection is performed on the data of the current type problem subtable according to the predetermined types of rule tables, and the table quality inspection results of the data of the current type problem subtable are obtained; based on the table quality inspection results, the target data of the current type problem subtable is determined, and the target data is displayed to the user. The technical solution of this embodiment, for different types of problem data, uses predetermined types of subtables to automatically classify data, and uses predetermined types of rule tables to automatically inspect data, which not only improves the efficiency of data processing, but also reduces errors caused by human factors, and ensures the consistency of quality inspection results. The present invention can improve work efficiency, reduce waste of human resources, improve the accuracy of information data, and further shorten the problem-solving cycle of power supply quality in the substation.

[0040] Figure 2 The second flow chart of a data processing method provided by an embodiment of the present invention is a refinement of the above embodiment. The specific method can be as follows Figure 2 As shown, the method may include the following steps:

[0041] Step 201: Obtain the data to be analyzed from each substation at a preset time interval.

[0042] Step 202: for each substation, determine the type problem subtables of each type of data to be analyzed in the current substation based on the predetermined type subtables.

[0043] Among them, the type problem sub-meters include heavy overload sub-meter, low voltage sub-meter or photovoltaic absorption imbalance sub-meter.

[0044] Step 203: Determine the current type rule table corresponding to the current type question sub-table in each type rule table.

[0045] Among them, the type rule table is a table predetermined by the power supply bureau based on field big data and actual needs. The type rule table includes quality inspection rules corresponding to each data. The quality inspection rules can be formulas or conditional summation statements used to determine whether each data in the type problem subtable is qualified.

[0046] Specifically, different types of rule tables include quality inspection rules corresponding to different types of data. After obtaining each type of problem sub-table, the type rule table corresponding to each type of problem sub-table is determined in all types of rule tables.

[0047] Step 204: extract the first identification field of each data item in the current type question subtable and the second identification field of each data item in the current type rule table, and match the first identification field with the second identification field to obtain a matching result.

[0048] The first identification field is used to identify each item of data in the type problem subtable, such as the data name or data number of each item of data. The second identification field is used to identify different items of data in the type rule table. Specifically, the type problem subtable may include multiple items of data, but the quality inspection rules in the type rule table may only require part of the data, that is, only the data corresponding to the second identification field.

[0049] Specifically, after determining the type rule table corresponding to the type problem subtable, extract all the first identification fields in the type problem subtable and all the second identification fields in the type rule table. Match each first identification field with the second identification field. If there is a second identification field that is the same as the first identification field, the matching result is determined to be a successful match. If there is no second identification field that is the same as the first identification field, the matching result is determined to be a failed match. For example, the current type problem subtable includes basic data, voltage data, current data, transformer capacity data, and power generation data of the substation, and the corresponding first field identification includes "foundation, voltage, current, transformer capacity, and power generation". The quality inspection rules of the current type rule table include a calculation formula for calculating heavy overloads, and the data required by the calculation formula include voltage data and transformer capacity data, and the corresponding second field identification includes: "voltage and transformer capacity". Further, it is determined that the matching result of the "voltage and transformer capacity" of the first field identification and the "voltage and transformer capacity" of the second identification field is a successful match.

[0050] Step 205: Perform data quality inspection on the data of the current type problem sub-table according to the matching result and the current type rule table to obtain the table quality inspection result of the current type problem sub-table.

[0051] Among them, the matching result is a successful match or a failed match. If the matching result is a successful match, it means that the data item corresponding to the first identification field needs to be filled in the type rule table. If the matching result is a failed match, it means that the data item corresponding to the first identification field does not need to be filled in the type rule table. After filling the corresponding data item into the type rule table, the filled-in data can be subjected to data quality inspection according to the quality inspection rules in the type rule table to obtain the table quality inspection result of the current type problem sub-table. In the embodiment of the present scheme, optionally, data quality inspection is performed on the data of the current type problem sub-table according to the matching result and the current type rule table to obtain the table quality inspection result of the current type problem sub-table, including the following steps A1-step A2:

[0052] Step A1: Generate quality inspection data corresponding to the current type problem sub-table according to the matching results, and input the quality inspection data into the current type rule table to obtain the current type quality inspection table corresponding to the current type problem sub-table.

[0053] The quality inspection data is the data corresponding to the first identification field whose matching result is successful. After obtaining the matching result, the quality inspection data is determined according to the matching result, and the quality inspection data is input into the value type rule table by copying and pasting, or the server of the power supply bureau automatically imports the quality inspection data into the type rule table to obtain the type quality inspection table corresponding to the type problem subtable.

[0054] Step A2: Perform quality inspection on the corresponding quality inspection data in the current type quality inspection table according to the quality inspection rules in the current type rule table to obtain quality inspection results for each quality inspection data; determine the table quality inspection result of the current type problem subtable based on all quality inspection results.

[0055] After the quality inspection data is automatically imported into the type rule table, the quality inspection data is inspected through the calculation formula or conditional summation statements (quality inspection rules) in the type rule table to obtain the quality inspection results of each quality inspection data. For example, the type rule table includes the formula for calculating the load rate: load rate = (actual load / rated capacity of transformer) × 100%. If the load rate exceeds the load threshold set in the quality inspection rule, it indicates that the transformer may be in an overloaded state, and the quality inspection result of the data is determined to be abnormal. Furthermore, the table quality inspection result of the current type problem subtable is determined based on the quality inspection results of all data items of the current type problem subtable.

[0056] By automatically importing the successfully matched data into the type rule table, the need for manual operation is reduced, the error rate is reduced, and the data of all stations are processed and quality-checked according to the same standards, ensuring the consistency and comparability of the data. According to the quality inspection rules pre-set in the type rule table, the data can be carefully checked, and data items that do not meet the requirements can be effectively identified, and potential problems can be discovered in a timely manner.

[0057] Step 206: Analyze the table quality inspection results according to the pre-acquired rule requirement data to obtain the core result data of the current problem data table, and obtain the target data table of the current problem data table based on the core result data, the current problem data table and the table data quality inspection results.

[0058] Among them, the rule requirement data includes the requirements of each station or power supply bureau for the power supply quality. According to the rule requirement data, it can be analyzed whether there is an abnormality in the substation corresponding to the problem data table. Exemplarily, the problem data table is a heavy overload problem data table, and the rule requirement data includes: if the quality inspection results are abnormal for more than 3 times within a preset time interval, it is determined that a heavy overload problem has occurred in the substation. The type of problem data table is a table where the quality inspection result of the problem word table is 5 heavy overloads. The core result data of the heavy overload problem data table includes: voltage data, transformer capacity data, quality inspection results of each data item, and heavy overload in the substation. The target data table is finally determined by the power supply bureau and is used to generate an Excel table for the final execution volume analysis report of each substation. In this scheme, optionally, a target data table of the current problem data table is obtained based on the core result data, the current problem data table and the table quality inspection results, including: generating a substation operation data column of the current problem data table based on the core result data; extracting the basic data of the current substation in the current problem data table, and generating a substation basic data column of the current problem data table based on the basic data; generating a target data table of the current problem data table based on the substation operation data column, the substation basic data column and the table quality inspection results.

[0059] Among them, the target data table includes the substation operation data column, the substation basic data column and the table quality inspection results. The operation data column includes the operation data of the substation at a preset time interval and the quality inspection results of each data. The substation basic data column includes the basic data of the substation, such as the capacity and model of the equipment in the substation. After obtaining the core result data, the data with abnormal quality inspection results are filtered out from the type rule table according to the core result data, and the quality inspection results of the data with abnormal quality inspection results and the original operation data in the problem data table are imported into the analysis report table with a pre-set format to obtain the substation operation data column of the target data table. Extract the basic data of the substation from the problem data table, import the basic data into the analysis report table, and obtain the substation basic data column of the target data table; import the data in the table quality inspection results corresponding to the problem data table into the analysis report table to obtain the target data table including the substation operation data column, the substation basic data column and the quality inspection result sequence.

[0060] Step 207: Visualize the target data table to obtain target data, and display the target data to the user.

[0061] Among them, the target data includes visualization charts of heavy overload problem areas, visualization charts of low voltage problem areas, and visualization charts of photovoltaic unbalanced consumption. In an optional implementation, after obtaining the target data table corresponding to the heavy overload sub-table, low voltage sub-table, or photovoltaic unbalanced consumption sub-table, a suitable chart type can be selected according to the data characteristics of each target data table, such as a bar chart, a line chart, a pie chart, or a radar chart. After determining the chart type corresponding to each target data table, the data in the target data table is analyzed and converted into a corresponding chart to display the data change trend and comparison results in an intuitive way.

[0062] In the technical solution of this embodiment, the data to be analyzed in each substation is obtained at a preset time interval. For each substation, the type problem subtables of each type of data to be analyzed in the current substation are determined based on the predetermined type subtables. Among them, the type problem subtable includes a heavy overload subtable, a low voltage subtable or a photovoltaic absorption imbalance subtable. The current type rule table corresponding to the current type problem subtable is determined in each type rule table. The first identification field of each data in the current type problem subtable and the second identification field of each data in the current type rule table are extracted, and the first identification field and the second identification field are matched to obtain a matching result. According to the matching result and the current type rule table, the data of the current type problem subtable is subjected to data quality inspection to obtain the table quality inspection result of the current type problem subtable. The table quality inspection result is analyzed according to the rule requirement data obtained in advance to obtain the core result data of the current problem data table. The target data table of the current problem data table is obtained based on the core result data, the current problem data table and the table quality inspection result; the target data table is visualized to obtain the target data, and the target data is displayed to the user. In the technical solution of this embodiment, a large amount of data is quickly processed using fixed-format tables and quality inspection rules, ensuring the accuracy and scientificity of data quality problem determination, while shortening the data processing cycle and reducing the consumption of human resources on repetitive labor. By visualizing the target data table, an intuitive and comprehensive data view can be provided to users, improving user experience.

[0063] Figure 3 Schematic diagram of the structure of a data processing device provided in an embodiment of the present invention, the device is suitable for executing a data processing method provided in an embodiment of the present invention. Figure 3 As shown, the device may specifically include:

[0064] The data acquisition module 301 is used to acquire the data to be analyzed in each area according to a preset time interval;

[0065] The first determination module 302 is used to determine, for each substation, the type problem subtables of the data to be analyzed in the current substation based on the predetermined type subtables; wherein the type problem subtables include a heavy overload subtable, a low voltage subtable or a photovoltaic absorption imbalance subtable;

[0066] The second determination module 303 is used to perform data quality inspection on the data of the current type of problem sub-table according to the predetermined type of rule table for each type of problem sub-table in the current station area, and obtain the table quality inspection result of the current type of problem sub-table;

[0067] The data display module 304 is used to determine the target data of the current type problem sub-table based on the table quality inspection result, and display the target data to the user.

[0068] Optionally, the first determination module 302 is specifically configured to: extract keywords from the data to be analyzed in the current area according to various types of keywords determined in advance, to obtain various data types of the data to be analyzed in the current area;

[0069] The data to be analyzed of each data type is input into the corresponding sub-table of each type, so as to obtain the type problem sub-table of each type of the data to be analyzed in the current station area.

[0070] Optionally, the second determination module 302 is specifically configured to: determine a current type rule table corresponding to the current type question sub-table in the various type rule tables;

[0071] Extracting the first identification field of each data item in the current type question subtable and the second identification field of each data item in the current type rule table, and matching the first identification field with the second identification field to obtain a matching result;

[0072] According to the matching result and the current type rule table, data quality inspection is performed on the data of the current type problem sub-table to obtain a table quality inspection result of the current type problem sub-table.

[0073] Optionally, the second determination module 302 is further used to: generate quality inspection data corresponding to the current type problem sub-table according to the matching result, and input the quality inspection data into the current type rule table to obtain a current type quality inspection table corresponding to the current type problem sub-table;

[0074] Perform quality inspection on the corresponding quality inspection data in the current type quality inspection table according to the quality inspection rules in the current type rule table to obtain quality inspection results for the quality inspection data;

[0075] The table quality inspection result of the current type of problem sub-table is determined based on the quality inspection results of all items.

[0076] Optionally, the data display module 304 is specifically used to: analyze the table quality inspection result according to the rule requirement data obtained in advance to obtain the core result data of the current problem data table;

[0077] Obtaining a target data table of the current problem data table based on the core result data, the current problem data table and the table quality inspection result;

[0078] Visualization processing is performed on the target data table to obtain the target data.

[0079] Optionally, the data display module 304 is further used to: generate a station area operation data column of the current problem data table according to the core result data;

[0080] Extracting the basic data of the current station area in the current problem data table, and generating a station area basic data column of the current problem data table according to the basic data;

[0081] A target data table of the current problem data table is generated according to the substation operation data column, the substation basic data column and the table quality inspection result.

[0082] A data processing device provided in an embodiment of the present invention can execute a data processing method provided in any embodiment of the present invention, and has functional modules and beneficial effects corresponding to the execution method. For contents not described in detail in this embodiment, reference can be made to the description in any method embodiment of the present invention.

[0083] Figure 4 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention, referring to Figure 4 , Figure 4 The electronic device 12 shown is only an example and should not limit the functions and scope of use of the embodiments of the present application. Figure 4 As shown, the electronic device 12 is in the form of a general purpose computing device. The components of the electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that connects various system components (including the system memory 28 and the processing unit 16).

[0084] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. By way of example, these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MAC) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0085] The electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device 12, including volatile and non-volatile media, removable and non-removable media.

[0086] The system memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The electronic device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be used to read and write non-removable, non-volatile magnetic media ( Figure 4 not shown, usually called a "hard drive"). Although Figure 4 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical medium) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present application.

[0087] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in the memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 42 generally perform the functions and / or methods of the embodiments described herein.

[0088] The electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboards, pointing devices, displays 24, etc.), may communicate with one or more devices that enable a user to interact with the electronic device 12, and / or may communicate with any device that enables the electronic device 12 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface 22. Furthermore, the electronic device 12 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with other modules of the electronic device 12 via the bus 18. It should be understood that although Figure 4Not shown, other hardware and / or software modules may be used in conjunction with the electronic device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0089] The processing unit 16 executes various functional applications and data processing by running the program stored in the system memory 28, for example, implementing a data processing method provided by an embodiment of the present invention: obtaining the data to be analyzed in each substation at a preset time interval; for each substation, determining the type problem subtable of each type of data to be analyzed in the current substation based on the predetermined type subtables; wherein the type problem subtable includes a heavy overload subtable, a low voltage subtable or a photovoltaic absorption imbalance subtable; for each type of problem subtable in the current substation, performing data quality inspection on the data of the current type problem subtable according to the predetermined type rule tables, and obtaining the table quality inspection result of the current type problem subtable; determining the target data of the current type problem subtable based on the table quality inspection result, and displaying the target data to the user.

[0090] The embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, a data processing method as provided in all the embodiments of the present invention is implemented: obtaining the data to be analyzed in each substation at a preset time interval; for each substation, determining the type problem subtable of each type of data to be analyzed in the current substation based on the predetermined type subtable; wherein the type problem subtable includes a heavy overload subtable, a low voltage subtable or a photovoltaic absorption imbalance subtable; for each type of problem subtable in the current substation, performing data quality inspection on the data of the current type problem subtable according to the predetermined type rule table, and obtaining the table quality inspection result of the current type problem subtable; determining the target data of the current type problem subtable based on the table quality inspection result, and displaying the target data to the user. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electronic device, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection with one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction-executing electronic device, apparatus, or device.

[0091] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction-executing electronic device, apparatus, or device.

[0092] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0093] Computer program code for performing the operations of the present invention may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0094] The embodiment of the present invention further provides a computer program product, including a computer program, which, when executed by a processor, implements the data processing method provided in any embodiment of the present application.

[0095] In the process of implementation, the computer program product can be written in one or more programming languages ​​or a combination thereof to perform the computer program code of the present invention, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).

[0096] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A data processing method, characterized in that: The method comprises: Obtain the data to be analyzed in each area according to the preset time interval; For each substation, based on the predetermined sub-tables of each type, a sub-table of each type of problem of the data to be analyzed in the current substation is determined; wherein the sub-table of each type of problem includes a heavy overload sub-table, a low voltage sub-table or a photovoltaic absorption imbalance sub-table; For each type of problem sub-table in the current station area, data quality inspection is performed on the data of the current type of problem sub-table according to each type of rule table determined in advance, and a table quality inspection result of the data of the current type of problem sub-table is obtained; The target data of the current type problem sub-table is determined based on the table quality inspection result, and the target data is displayed to the user.

2. The method according to claim 1, characterized in that Determine the type problem sub-tables of the data to be analyzed in the current area based on the predetermined type sub-tables, including: Extract keywords from the data to be analyzed in the current area according to various types of keywords determined in advance, and obtain various types of data to be analyzed in the current area; The data to be analyzed of each data type is input into the corresponding sub-table of each type, so as to obtain the type problem sub-table of each type of the data to be analyzed in the current station area.

3. The method according to claim 1, characterized in that Performing data quality inspection on the data of the current type problem sub-table according to the predetermined rule tables of each type, and obtaining a table quality inspection result of the data of the current type problem sub-table, including: Determine a current type rule table corresponding to the current type question sub-table in the various type rule tables; Extracting the first identification field of each data item in the current type question subtable and the second identification field of each data item in the current type rule table, and matching the first identification field with the second identification field to obtain a matching result; According to the matching result and the current type rule table, data quality inspection is performed on the data of the current type problem sub-table to obtain a table quality inspection result of the current type problem sub-table.

4. The method according to claim 3, characterized in that Performing data quality inspection on the data of the current type problem sub-table according to the matching result and the current type rule table to obtain a table quality inspection result of the current type problem sub-table, including: Generate quality inspection data corresponding to the current type problem sub-table according to the matching result, and input the quality inspection data into the current type rule table to obtain the current type quality inspection table corresponding to the current type problem sub-table; Perform quality inspection on the corresponding quality inspection data in the current type quality inspection table according to the quality inspection rules in the current type rule table to obtain quality inspection results for the quality inspection data; The table quality inspection result of the current type problem sub-table is determined based on the quality inspection results of all items.

5. The method according to claim 1, characterized in that Determining target data of the current type problem sub-table based on the table quality inspection result includes: Analyze the table quality inspection results according to the pre-acquired rule requirement data to obtain the core result data of the current problem data table; Obtaining a target data table of the current problem data table based on the core result data, the current problem data table and the table quality inspection result; Visualization processing is performed on the target data table to obtain the target data.

6. The method according to claim 5, characterized in that The target data table of the current problem data table is obtained based on the core result data, the current problem data table and the table quality inspection result, including: Generate the area operation data column of the current problem data table according to the core result data; Extracting the basic data of the current station area in the current problem data table, and generating a station area basic data column of the current problem data table according to the basic data; A target data table of the current problem data table is generated according to the substation operation data column, the substation basic data column and the table quality inspection result.

7. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the computer program implements the data processing method according to any one of claims 1 to 6.

8. A data processing device, characterized in that: Applied to edge computing units, including: A data acquisition module is used to acquire the data to be analyzed in each area according to a preset time interval; A first determination module is used to determine, for each substation, each type of type problem subtable of the data to be analyzed in the current substation based on each pre-determined type subtable; wherein the type problem subtable includes a heavy overload subtable, a low voltage subtable or a photovoltaic absorption imbalance subtable; The second determination module is used to perform data quality inspection on the data of the current type of problem sub-table according to the predetermined type of rule table for each type of problem sub-table in the current station area, and obtain the table quality inspection result of the data of the current type of problem sub-table; A data display module is used to determine the target data of the current type problem sub-table based on the table quality inspection result, and display the target data to the user.

9. An electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, a data processing method as described in any one of claims 1 to 6 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, a data processing method as claimed in any one of claims 1 to 6 is implemented.

Images